We're looking for a Senior Databricks Cloud Architect to lead data engineering, analytics, AI/ML, and big data projects on the Databricks platform for one of our clients. You'll drive environment setup, solution design, and technical delivery to solve complex data challenges and unlock business value.
Key skills: Databricks (up to Silver Layer), Azure Data Factory.
Contact us for more information!
location: Lake Forest, California
job type: Permanent
salary: $150,000 - 180,000 per year
work hours: 8am to 5pm
education: Bachelors
responsibilities:
- Assist in architecting, developing, deploying, or migrating their use cases and workloads into production on Databricks Lakehouse.
- Be the first contact for any technical challenge or questions related to development and production
- Collaborate with the users, technical and support teams, to complete projects on a timely manner
- Implement Databricks Product Innovations, Private Previews and Upgrades if needed
- Provide regular internal and external updates on progress and risks/blockers to your leadership
- Contribute to the development of the team by sharing best practices and assets.
- Operate as an expert solution architect and trusted advisor for significant data analytics architecture, design, development, and adoption of the Databricks Data Intelligence Platform.
- Build Databricks serverless platform that powers the big data, machine learning and Gen AI workloads.
- Automatically improves the performance and efficiency of workloads running on the platform.
- Build multi-language (SQL, Python) notebooks with a focus on Data Engineering, Data Science (AI/ML)
qualifications:
- A minimum of a bachelor's degree in computer science, Information system, Engineering, Data Science, or equivalent experience through work experience.
- 5+ years of experience where you have been accountable for technical delivery as an Architect within the domain of Data and AI and where you can contribute to the technical debate and design choices with our customers.
- Experience in architecting and implementing Databricks solution using Medallion architecture.
- Hands-on expertise with Databricks implementation on Azure. Azure security/networking knowledge advantageous.
- Experience designing and developing large-scale distributed systems, and big data technologies such as Apache SparkTM, Hadoop or Cassandra.
- Proficient with writing code in Python, and SQL.
- Proficient in designing/implementing Auto Loader, DLT (Delta Live Tables), and Streaming solutions which handle structured, semi structured and unstructured data in Databricks.
- Understanding of how to attribute business value and outcomes to specific project deliverables.
- Experience conducting discovery workshops, creating strategic roadmaps, conducting business analysis, and managing delivery of complex programs/projects.
- Expertise in implementing Row Level Security, Column Masking, Data encryption and decryption solutions in Databricks.
- Continuous learning and keeping up with the fast evolution of the Databricks Lakehouse platform.
- Nice to have: Databricks Certification and deep hands-on knowledge in Big Data Engineering or DWH technology.
skills:
- Exceptional communication and collaboration skills.
- Ability to manage stakeholders' expectations and influence decisions.
- Strong leadership and team-building capabilities.
- Ability to adapt to changing priorities and work under pressure.
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Qualified applicants in San Francisco with criminal histories will be considered for employment in accordance with the San Francisco Fair Chance Ordinance.
Qualified applicants in the unincorporated areas of Los Angeles County with criminal histories will be considered for employment in accordance with the Los Angeles County's Fair Chance Ordinance for Employers.
We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance.
