Senior Data Engineer

Skillfield

Melbourne, Australia
Hybrid
Apache spark development
Scala programming
Hadoop ecosystem experience
Skillfield is a specialist technology consultancy operating at the intersection of cyber, data, and AI delivering scalable solutions across complex environments

Job Summary

  • Skillfield is a specialist technology consultancy operating at the intersection of cyber, data, and AI delivering scalable solutions across complex environments.
  • The Senior Data Engineer will design, develop, and maintain high-performance data pipelines and analytical solutions within large-scale data ecosystems.
  • The role offers a collaborative, outcome-driven consulting environment with flexibility, support, and a focus on sustainable delivery.

Matching Summary

Skillfield is a specialist technology consultancy operating at the intersection of cyber, data, and AI delivering scalable solutions across complex environments.

Skills & Requirements

Must-have

  • Apache Spark development
  • Scala programming
  • Hadoop ecosystem experience
  • ETL and ELT pipeline design
  • Linux-based environment operation
  • Distributed data processing
  • Cloud and on-prem platform experience

Nice-to-have

  • Kafka or streaming platform experience
  • Databricks or managed Spark services
  • Orchestration tools such as Airflow
  • Data security and governance awareness

Key Requirements

  • 6 months contract with extension potential
  • Hands-on Apache Spark experience
  • Strong Scala development skills
  • Experience with HDFS, Hive, and HBase
  • Familiarity with Git workflows and CI/CD pipelines

Work Rights

Not specified

Tailored Resume

Cover Letter