Staff Data Engineer

CommBank

Bangalore, India
12+ years data engineering experience
Apache airflow orchestration expertise
Aws glue and pyspark development
The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices

Job Summary

  • The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.
  • Candidates will design and maintain scalable ETL pipelines using AWS Glue, PySpark, and Spark to support data predictions and reporting.
  • The position requires strong problem-solving skills and the ability to thrive in dynamic, cross-functional teams within a financial institution.

Matching Summary

The role focuses on reducing model deployment time by leveraging advanced tools, automation, and modern engineering practices.

Skills & Requirements

Must-have

  • 12+ years Data Engineering experience
  • Apache Airflow orchestration expertise
  • AWS Glue and PySpark development
  • Python programming proficiency
  • SQL query optimization skills

Nice-to-have

  • Experience with Hadoop or Teradata systems
  • Knowledge of container build efficiency
  • Strong cross-functional collaboration abilities
  • Familiarity with data governance policies

Key Requirements

  • Bachelor's or Master's degree in Computer Science or IT
  • Minimum 12 years of Data Engineering experience
  • Deep expertise in Apache Airflow required

Work Rights

Not specified

Tailored Resume

Cover Letter