Staff Data Engineer

CommBank

Bangalore, India
12+ years data engineering experience
Deep expertise in apache airflow
Strong experience with aws glue
The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices

Job Summary

  • The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.
  • Candidates will design and maintain scalable ETL pipelines using AWS Glue, PySpark, and Spark while orchestrating workflows with Apache Airflow.
  • The position requires implementing data quality checks, ensuring compliance with governance policies, and working within cross-functional teams.

Matching Summary

The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.

Skills & Requirements

Must-have

  • 12+ years Data Engineering experience
  • Deep expertise in Apache Airflow
  • Strong experience with AWS Glue
  • Proficiency in Python programming
  • Experience with PySpark and Spark

Nice-to-have

  • Collaboration with data scientists
  • Knowledge of Hadoop or Teradata
  • Experience with cloud lakehouses
  • Strong communication skills
  • Ability to thrive in dynamic environments

Key Requirements

  • Bachelor's or Master's degree in Computer Science or IT
  • 12+ years of experience in Data Engineering
  • Deep expertise in Apache Airflow required

Work Rights

Not specified

Tailored Resume

Cover Letter