Staff Data Engineer (aws, Big Data)

CBA New Digital Businesses Pty Ltd

Sydney, New South Wales, Australia
On-site
Aws cloud technologies
Big data and data warehouse platforms
Scala, java, or python programming
As a Staff Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you’re ahead of trends and work at the forefront of Big Data and Data warehouse technologies

Job Summary

  • As a Staff Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you’re ahead of trends and work at the forefront of Big Data and Data warehouse technologies.
  • The Risk Data Analytics and Insights team provides data delivery, insights and software delivery outcomes to support Risk Management and other business units.
  • We support the Group’s strategy of building tomorrow’s bank today for our customers, through the work that we do work to create world-leading capabilities for analytics, information management, decisioning and Generative AI.

Matching Summary

As a Staff Data engineer with expertise in software development / programming and a passion for building data-driven solutions, you’re ahead of trends and work at the forefront of Big Data and Data warehouse technologies.

Skills & Requirements

Must-have

  • AWS Cloud technologies
  • Big Data and Data Warehouse platforms
  • Scala, Java, or Python programming
  • Hadoop ecosystem (Spark, Kafka, HDFS)
  • Data modeling techniques (Data Vault, Kimball)
  • SQL scripting for data pipelines
  • DevSecOps and CI/CD tooling

Nice-to-have

  • Thought leadership in data solutions
  • Technical governance and risk management
  • Mentoring other engineers
  • Stakeholder communication and coordination
  • Building data products from scratch
  • Teradata experience
  • CloudFormation, GitOps, serverless frameworks

Key Requirements

  • Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions
  • Experience in building data solution in Hadoop platform
  • Experience in building data solution using AWS Cloud technology
  • Ability to produce conceptual, logical and physical data models
  • Knowledge of building robust data products, and Enterprise Semantic Data Models
  • Strong Unix/Linux Shell scripting and programming skills
  • Proficient in SQL scripting
  • Experience with Source control, DevSecOps, and CI/CD tooling
  • Experience with CloudFormation, GitOps, and serverless frameworks
  • Ability to fine-tune ETL jobs, query performance, and cost efficiencies
  • Familiarity with data warehousing and/or data mart build experience in Teradata is a plus
  • Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS Data Engineer

Work Rights

Not specified

Tailored Resume

Cover Letter