Staff Data Engineer

CommSec

Bangalore, India
Spark framework expertise
Apache airflow expertise
Aws cloud services proficiency
Defines technical strategy for key business areas, contributing to roadmaps and identifying disruptive technologies

Job Summary

  • Defines technical strategy for key business areas, contributing to roadmaps and identifying disruptive technologies.
  • Leads implementation of complex initiatives with impact across several teams, designing resilient solutions with high fault tolerance.
  • Builds a culture of trust where team members feel confident to share their ideas and concerns.

Matching Summary

Defines technical strategy for key business areas, contributing to roadmaps and identifying disruptive technologies.

Skills & Requirements

Must-have

  • Spark framework expertise
  • Apache Airflow expertise
  • AWS cloud services proficiency
  • Python-based framework development
  • SQL for efficient querying

Nice-to-have

  • MSK, Flink, Iceberg exposure
  • Cloud Watcher, User Notification
  • Culture of trust and idea sharing

Key Requirements

  • 10-15 years of Data Engineering experience
  • Bachelor's or Master's degree in Computer Science/IT
  • Proficiency in AWS services (EC2, S3, Lambda, etc.)
  • Experience with Cloud Foundation (CFN), CDK, SDK

Work Rights

Not specified

Tailored Resume

Cover Letter