Reduce the deployment time of models by leveraging advanced tools, automation, and modern engineering practices
Job Summary
Reduce the deployment time of models by leveraging advanced tools, automation, and modern engineering practices.
Contributed to the execution of strategic initiatives aimed at improving team effectiveness and engineering performance.
Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks.
Matching Summary
Reduce the deployment time of models by leveraging advanced tools, automation, and modern engineering practices.
Skills & Requirements
Must-have
Apache Airflow expertise
AWS Glue, Lambda, Redshift, S3
PySpark, Hadoop, Teradata
Python programming language
SQL for data processing
Data pipeline development
Nice-to-have
Cross-functional team collaboration
Dynamic environment adaptability
Problem-solving and critical thinking
Communication and documentation skills
Key Requirements
12+ years of experience in Data Engineering
Bachelor’s/Master’s degree in Computer Science/Information Technology