Randstad Digital is seeking a Lead Data Engineer for an exciting opportunity in Kansas City, MO. This person will lead the design, development, and implementation of scalable data pipelines and ELT processes using Databricks, DLT, dbt, Airflow, and other tools.
location: Kansas City, Missouri
job type: Contract
salary: $65 - 75 per hour
education: Bachelors
responsibilities:
- Lead the design, development, and implementation of scalable data pipelines and ELT processes using Databricks, DLT, dbt, Airflow, and other tools.
- Collaborate with stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize and maintain existing data pipelines to ensure data quality, reliability, and performance.
- Develop and enforce data engineering best practices, including coding standards, testing, and documentation.
- Mentor junior data engineers, providing technical leadership and fostering a culture of continuous learning and improvement.
- Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to business operations.
- Stay up to date with the latest industry trends and technologies, and proactively recommend improvements to our data engineering practices.
qualifications:
- 8+ years of experience in data engineering and/or architecture, with a focus on big data technologies.
- Extensive production experience with Databricks, Apache Spark, and other related technologies.
- Familiarity with orchestration and ELT tools like Airflow, dbt, etc.
- Expert SQL knowledge.
- Proficiency in programming languages such as Python, Scala, or Java.
- Strong understanding of data warehousing concepts.
- Experience with cloud platforms such as Azure, AWS, Google Cloud.
- Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
- Strong communication and leadership skills, with the ability to effectively mentor and guide team members.
skills:
- Extensive production experience with Databricks, Apache Spark, and other related technologies.
- Familiarity with orchestration and ELT tools like Airflow, dbt, etc.
- Expert SQL knowledge.
- Proficiency in programming languages such as Python, Scala, or Java.
- Strong understanding of data warehousing concepts.
- Experience with cloud platforms such as Azure, AWS, Google Cloud.
- Experience with machine learning and data science workflows.
- Knowledge of data governance and security best practices.
- Certification in Databricks, Azure, Google Cloud or related technologies.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.
