The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices
Job Summary
The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.
Candidates will design and maintain scalable ETL pipelines using AWS Glue, PySpark, and Spark while orchestrating workflows with Apache Airflow.
The position requires implementing data quality checks, ensuring compliance with governance policies, and collaborating with data scientists to deliver solutions.
Matching Summary
The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.
Skills & Requirements
Must-have
12+ years Data Engineering experience
Deep expertise in Apache Airflow
Strong experience with AWS Glue
Proficiency in Python programming
Experience with Hadoop or Teradata
Nice-to-have
Strong problem-solving abilities
Excellent communication skills
Ability to thrive in cross-functional teams
Experience with AI-driven solutions
Knowledge of cloud lakehouses
Key Requirements
Bachelor's or Master's degree in Computer Science or IT