Staff Data Engineer

CommBank

Bangalore, India
Apache airflow
Aws glue, lambda, redshift, s3
Pyspark, hadoop or teradata
Reduce the deployment time of models by leveraging advanced tools, automation, and modern engineering practices

Job Summary

  • Reduce the deployment time of models by leveraging advanced tools, automation, and modern engineering practices.
  • Contribute to the execution of strategic initiatives aimed at improving team effectiveness and engineering performance.
  • Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses.

Matching Summary

Reduce the deployment time of models by leveraging advanced tools, automation, and modern engineering practices.

Skills & Requirements

Must-have

  • Apache Airflow
  • AWS Glue, Lambda, Redshift, S3
  • PySpark, Hadoop or Teradata
  • Python programming language
  • SQL query writing
  • Data pipeline automation

Nice-to-have

  • Cross-functional team collaboration
  • Dynamic work environments
  • Problem-solving and critical thinking
  • Documentation skills

Key Requirements

  • 12+ years of experience in Data Engineering
  • Bachelor’s degree/master’s degree in engineering
  • Must have strong communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter