Staff Data Engineer (aws, Big Data)

Commonwealth Bank of Australia

Sydney, NSW, Australia
Onsite
Big data platform development
Aws cloud technology expertise
Programming in scala, java, or python
We are one of the largest and most advanced Data Engineering teams in the country building state-of-the-art data solutions that power seamless experiences for millions of customers

Job Summary

  • We are one of the largest and most advanced Data Engineering teams in the country building state-of-the-art data solutions that power seamless experiences for millions of customers.
  • The Risk Data Analytics and Insights team supports Risk Management and other business units by creating world-leading capabilities for analytics, information management, decisioning, and Generative AI.
  • We offer a respectful, inclusive, and flexible workplace with options for flexible work locations and arrangements to support work-life balance.

Matching Summary

We are one of the largest and most advanced Data Engineering teams in the country building state-of-the-art data solutions that power seamless experiences for millions of customers.

Skills & Requirements

Must-have

  • Big Data platform development
  • AWS Cloud technology expertise
  • Programming in Scala, Java, or Python
  • Data pipeline and ETL solutions
  • SQL scripting and query optimization
  • Data modelling techniques
  • DevSecOps and CI/CD tooling

Nice-to-have

  • Technical leadership and mentoring
  • Experience with Teradata data warehousing
  • Knowledge of data mesh principles
  • Strong communication and coordination skills
  • Familiarity with serverless frameworks
  • Experience with Cloudera Hadoop ecosystem
  • Ability to fine-tune cost efficiencies

Key Requirements

  • Experience with Hadoop platform and Spark
  • Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS Data Engineer
  • Proficient in Unix/Linux Shell scripting
  • Experience with GitHub Actions and CloudFormation
  • Ability to build enterprise semantic data models
  • Experience mentoring engineers in Agile teams

Work Rights

Not specified

Tailored Resume

Cover Letter