As the Azure Data Engineer Lead, you will lead, build, and deliver comprehensive data solutions using Microsoft Azure, Microsoft Fabric, and Azure Databricks. By collaborating closely with clients, you will design, implement, and optimize scalable data platforms tailored to their unique business objectives. Your expertise in Azure and Fabric services will be pivotal in enabling clients to unlock the full potential of their data.
Key Responsibilities
Client Engagement:
- Prioritize and manage multiple fast-paced project deliverables.
- Partner with clients to assess data platform requirements and understand business needs.
- Recommend tailored solutions using Microsoft Fabric technologies.
- Lead and develop end-to-end data solutions leveraging Azure, Microsoft Fabric, including data integration pipelines, data lakes, data warehouses, and advanced analytics platforms.
- Incorporate capabilities such as compute management, performance optimization, and governance.
- Develop and manage ETL/ELT pipelines using tools like Azure Synapse, Azure Data Factory, Fabric Data Pipelines, and Synapse Pipelines and Notebooks.
- Ensure seamless ingestion, transformation, and orchestration of data from diverse sources such as databases, APIs, and files.
- Utilize Microsoft Fabric's integrated analytics capabilities to enhance business intelligence and data visualization.
- Leverage services such as Azure Synapse Analytics, Azure Databricks, Power BI, and Fabric's OneLake to deliver scalable and cost-efficient solutions.
- Implement and manage data governance.
- Ensure solutions align with data governance and security best practices.
- Create comprehensive documentation, including architecture diagrams, workflows, and technical specifications.
- Train and support clients on the effective use of Azure and Fabric-based solutions.
- Stay current with updates and trends in Azure and Microsoft Fabric.
- Share insights on emerging capabilities and innovative practices with the team and clients.
- Proven experience in architecting and delivering solutions on the Azure platform and Databricks.
- Expertise in Microsoft Fabric and Azure, Databricks, including Data Pipelines, OneLake, and Synapse Real-Time Analytics.
- strong proficiency in Azure services such as Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake, Azure Synapse SQL Data Warehouse, and Power BI.
- Advanced SQL, Python, Spark, and data modeling skills, including experience with ELT/ETL workflows.
- Expertise in real-time and near real-time data processing using Databricks or other data platforms.
- Expertise in DevOps and GIT integration.
- Familiarity with data governance and compliance frameworks.
- Excellent communication, client engagement, and problem-solving abilities.
- Nice to have (not mandatory): Relevant Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer), Fabric (DP-600, DP-700) certifications, and Databricks certifications.
location: DURHAM, North Carolina
job type: Contract
salary: $60 - 70 per hour
work hours: 8am to 4pm
education: Bachelors
responsibilities:
Client Engagement:
- Prioritize and manage multiple fast-paced project deliverables.
- Partner with clients to assess data platform requirements and understand business needs.
- Recommend tailored solutions using Microsoft Fabric technologies.
- Lead and develop end-to-end data solutions leveraging Azure, Microsoft Fabric, including data integration pipelines, data lakes, data warehouses, and advanced analytics platforms.
- Incorporate capabilities such as compute management, performance optimization, and governance.
- Develop and manage ETL/ELT pipelines using tools like Azure Synapse, Azure Data Factory, Fabric Data Pipelines, and Synapse Pipelines and Notebooks.
- Ensure seamless ingestion, transformation, and orchestration of data from diverse sources such as databases, APIs, and files.
- Utilize Microsoft Fabric's integrated analytics capabilities to enhance business intelligence and data visualization.
- Leverage services such as Azure Synapse Analytics, Azure Databricks, Power BI, and Fabric's OneLake to deliver scalable and cost-efficient solutions.
- Implement and manage data governance.
- Ensure solutions align with data governance and security best practices.
- Create comprehensive documentation, including architecture diagrams, workflows, and technical specifications.
- Train and support clients on the effective use of Azure and Fabric-based solutions.
- Stay current with updates and trends in Azure and Microsoft Fabric.
qualifications:
- Experience level: Experienced
- Minimum 5 years of experience
- Education: Bachelors
skills:
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
