Senior Data Engineer

NCS Australia Group

Sydney, Australia
Not specified; not specified; pyid pyrental leave;...
On-site
Azure databricks experience
Pyspark and spark processing
Delta lake transactional management
The role involves designing and building robust, production-grade data engineering solutions using Azure Databricks and PySpark

Job Summary

  • The role involves designing and building robust, production-grade data engineering solutions using Azure Databricks and PySpark.
  • Candidates will work closely with analytics and business teams to translate requirements into secure, high-quality data solutions.
  • NCS Australia offers comprehensive global learning programs, mentorship from industry leaders, and a supportive culture focused on diversity.

Matching Summary

The role involves designing and building robust, production-grade data engineering solutions using Azure Databricks and PySpark.

Salary

Not specified; Not specified; Paid parental leave; discounted health insurance; product discounts; career development programs

Skills & Requirements

Must-have

  • Azure Databricks experience
  • PySpark and Spark processing
  • Delta Lake transactional management
  • Python and SQL proficiency
  • Azure Data Factory and ADLS
  • CI/CD pipeline implementation

Nice-to-have

  • Agile environment experience
  • Performance tuning expertise
  • Collaboration with data science teams
  • Enterprise cloud-first mindset

Key Requirements

  • Valid work rights for Australia required
  • Background checks including probity and police checks
  • Senior level experience in data engineering

Work Rights

Must have valid work rights for Australia

Tailored Resume

Cover Letter