Staff Data Engineer

CommBank

Bangalore, India
Remote
Spark framework expertise
Apache airflow expertise
Python-based framework development
Defines technical strategy for key business areas, contributing to roadmaps and identifying disruptive technologies for adoption

Job Summary

  • Defines technical strategy for key business areas, contributing to roadmaps and identifying disruptive technologies for adoption.
  • Leads implementation of complex initiatives with impact across several teams, designing resilient solutions with high fault tolerance.
  • Builds a culture of trust where team members feel confident to share their ideas and concerns, influencing crew leadership on technical matters.

Matching Summary

Defines technical strategy for key business areas, contributing to roadmaps and identifying disruptive technologies for adoption.

Skills & Requirements

Must-have

  • Spark framework expertise
  • Apache Airflow expertise
  • Python-based framework development
  • SQL proficiency
  • AWS cloud services proficiency

Nice-to-have

  • MSK, Flink, Iceberg exposure
  • Cloud Watcher, User Notification, Appflow, Fargate, ECS, EKS, Boto3, RDS, Sagemaker, Cookie Cutter experience

Key Requirements

  • 10-15 years of experience as a Data Engineering professional
  • Bachelor’s degree or master’s degree in engineering
  • Proficiency in AWS cloud services (EC2, S3, Lambda, Athena, Kinesis, Redshift, Glue, EMR, DMS, Event Bridge, DynamoDB, IAM, Secret Manager, KMS, Step functions, SQS, SNS)
  • Experience in Cloud Foundation (CFN), Cloud Development Kit (CDK) and Software Development Kit (SDK)

Work Rights

Not specified

Tailored Resume

Cover Letter