We are seeking a highly skilled Data Engineering Contractor to join our team on a 6-month contract basis. We are focused on building scalable data infrastructure and pipelines to support our analytics and product needs. This role is ideal for someone with strong Python expertise and experience working with AWS-based ETL pipelines.
location: New York, New York
job type: Contract
salary: $75 - 85 per hour
work hours: 9am to 5pm
education: Bachelors
responsibilities:
- Design, develop, and maintain scalable data pipelines and ETL workflows using Python and AWS data services (Lambda, Step Functions, S3, Glue, Athena, DynamoDB).
- Implement Infrastructure as Code (IaC) using AWS CDK or Terraform to automate and manage cloud-based data infrastructure.
- Optimize ETL processes, ensuring efficient data ingestion, transformation, and storage while following best practices for data engineering.
- Troubleshoot complex data issues, monitor pipeline performance, and implement solutions to improve reliability and efficiency.
- Work with structured and unstructured datasets, ensuring proper data modeling and governance.
- Collaborate with data analysts, data scientists, and product teams to support business and analytical needs.
- Maintain high-quality documentation and best practices for data engineering workflows.
- (If applicable) Participate in hybrid team meetings in NYC, providing updates and insights into project progress.
- Stay updated with emerging AWS technologies and best practices in data engineering.
qualifications:
Requirements:
- 5+ years of experience in data engineering.
- Strong proficiency in Python for data processing and automation.
- Hands-on experience with AWS data services, including but not limited to Lambda, Step Functions, S3, Glue, Athena, and DynamoDB.
- Experience with Infrastructure as Code (IaC), preferably using AWS CDK or Terraform.
- Solid understanding of ETL best practices, data modeling, and workflow automation.
- Ability to work independently, troubleshoot complex data issues, and deliver high-quality solutions.
Nice to Have:
- Experience working with batch and streaming data pipelines.
- Familiarity with AWS-native workflow orchestration tools. Familiarity with Iceberg.
- Knowledge of SQL and database performance tuning.
- Prior experience in consulting or contract-based roles.
skills: Required Skills:
- Python - Strong proficiency in Python for data processing and automation.
- AWS Data Services - Hands-on experience with:
- Lambda
- Step Functions
- S3
- Glue
- Athena
- DynamoDB
- ETL Best Practices - Experience with data extraction, transformation, and loading processes.
- Infrastructure as Code (IaC) - Experience with AWS CDK or Terraform.
- Data Modeling & Workflow Automation - Understanding of data structures, schema design, and automated workflows.
- Problem-Solving & Debugging - Ability to troubleshoot complex data issues independently.
- Communication & Collaboration - Ability to work with cross-functional teams and deliver high-quality solutions.
- Batch & Streaming Data Pipelines - Experience with both processing paradigms.
- AWS-native Workflow Orchestration - Familiarity with AWS tools for scheduling and managing workflows.
- Apache Iceberg - Experience with Iceberg for data lake management.
- SQL & Database Performance Tuning - Knowledge of query optimization and database efficiency.
- Consulting/Contracting Experience - Prior experience working in a contract-based or consulting capacity.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
