Staff Data Engineer

CommBank

Bangalore, Karnataka, India
10-15 years data engineering experience
Expertise in apache spark framework
Proficiency with apache airflow
The role involves defining technical strategy for key business areas and driving the adoption of disruptive technologies

Job Summary

  • The role involves defining technical strategy for key business areas and driving the adoption of disruptive technologies.
  • Engineers will lead complex initiatives across multiple teams while designing resilient solutions with high fault tolerance.
  • The position requires building a culture of trust where team members feel confident to share ideas and concerns.

Matching Summary

The role involves defining technical strategy for key business areas and driving the adoption of disruptive technologies.

Skills & Requirements

Must-have

  • 10-15 years Data Engineering experience
  • Expertise in Apache Spark framework
  • Proficiency with Apache Airflow
  • Strong Python-based framework development
  • Advanced SQL query optimization skills
  • AWS cloud services expertise (EC2, S3, Lambda)

Nice-to-have

  • Experience with MSK, Flink, Iceberg
  • Knowledge of CloudWatch and User Notification
  • Familiarity with Appflow and Fargate
  • Exposure to EKS and RDS services
  • Understanding of Boto3 library usage

Key Requirements

  • Bachelor's or Master's degree in Computer Science or IT
  • 10-15 years of professional Data Engineering experience
  • Strong analytical and reasoning skills in data-intensive environments

Work Rights

Not specified

Tailored Resume

Cover Letter