Staff Data Engineer

CommBank

Bangalore, India
10-15 years data engineering experience
Expertise in apache spark framework
Proficiency in apache airflow
The role involves defining technical strategy for key business areas and driving the adoption of disruptive technologies

Job Summary

  • The role involves defining technical strategy for key business areas and driving the adoption of disruptive technologies.
  • Engineers will design resilient solutions with high fault tolerance while leading complex initiatives across multiple teams.
  • The position requires building a culture of trust where team members feel confident to share ideas and concerns.

Matching Summary

The role involves defining technical strategy for key business areas and driving the adoption of disruptive technologies.

Skills & Requirements

Must-have

  • 10-15 years Data Engineering experience
  • Expertise in Apache Spark framework
  • Proficiency in Apache Airflow
  • Strong Python-based framework development
  • AWS cloud services proficiency
  • Advanced SQL query optimization

Nice-to-have

  • Experience with MSK and Flink
  • Knowledge of Iceberg table format
  • Exposure to EKS and Fargate
  • Familiarity with Sagemaker platform
  • Cloud Development Kit (CDK) skills

Key Requirements

  • Bachelor's or Master's degree in Computer Science or IT
  • 10-15 years of professional experience required
  • Location: Bangalore, India

Work Rights

Not specified

Tailored Resume

Cover Letter