Designing and Building ETL pipeline using Sqoop, Hive, Map Reduce and Spark on on-prem and cloud environments.
Functional Programming using Python and Scala for complex data transformations and in-memory computations.
Using Erwin for Logical/Physical data modeling and Dimensional Data Modeling.
Designing and developing UNIX/Linux scripts for handing complex File formats and structures
Orchestration of workflows and jobs using Airflow and Automic,
Creating Multiple Kafka producers and consumers for data transferring
Performing Continous Integration and deployment (CI/CD) using tools like GIT, Jenkin to run test cases and build applications with code coverage using Scala test
Analyzing data using SQL, Big Query monitoring the cluster performance, setting up alerts, documenting the designs, workflow.
Providing production support, troubleshooting and fixing the issues by tracking the status of Running applications to perform System Administrator tasks.
location: Bentonville, Arkansas
job type: Contract
salary: $65 - 72 per hour
work hours: 8am to 4pm
education: Bachelors
responsibilities:
* Designing and Building ETL pipeline using Sqoop, Hive, Map Reduce and Spark on on-prem and cloud environments.
* Designing and developing UNIX/Linux scripts for handing complex File formats and structures
* Creating Multiple Kafka producers and consumers for data transferring
* Performing Continous Integration and deployment (CI/CD) using tools like GIT, Jenkin to run test cases and build applications with code coverage using Scala test
qualifications:
- Experience level: Experienced
- Minimum 5 years of experience
- Education: Bachelors
skills:
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).
This posting is open for thirty (30) days.
