Associate Data Engineer

Amgen Australia Pty Ltd

Not specified; not specified; not specified
Not specified
Hands-on experience with databricks
Strong working knowledge of pyspark
Proven ability to build etl/elt pipelines
Amgen Australia Pty Ltd is seeking an Associate Data Engineer to develop and maintain data pipelines using technologies like Databricks, PySpark, and Python. The role requires a strong background in data engineering principles and offers a collaborative environment with opportunities for learning and growth

Job Summary

  • The role involves developing and maintaining scalable data pipelines using Databricks, PySpark, and Python to support analytics and machine learning initiatives.
  • Candidates will collaborate with cross-functional teams including data engineers, analysts, and scientists to deliver reliable datasets and ensure data quality.
  • This position requires optimizing Spark jobs for performance and cost efficiency while troubleshooting pipeline failures and supporting AI/ML data preparation activities.

Matching Summary

Match Score: 85

Amgen Australia Pty Ltd is seeking an Associate Data Engineer to develop and maintain data pipelines using technologies like Databricks, PySpark, and Python. The role requires a strong background in data engineering principles and offers a collaborative environment with opportunities for learning and growth.

Salary

Not specified; Not specified; Not specified

Skills & Requirements

Must-have

  • Hands-on experience with Databricks
  • Strong working knowledge of PySpark
  • Proven ability to build ETL/ELT pipelines
  • Experience with Delta Lake architecture
  • Proficiency in Python scripting and automation
  • Working knowledge of SQL for data validation

Nice-to-have

  • Familiarity with CI/CD practices
  • Experience with MLflow or scikit-learn
  • Exposure to Unity Catalog or Lakehouse
  • Knowledge of Tableau or Power BI
  • Understanding of data governance concepts
  • Agile/Scrum environment experience

Key Requirements

  • Bachelor's degree in Computer Science or related field
  • 2-6 years of relevant data engineering experience
  • Equivalent practical experience accepted in lieu of degree

Work Rights

Not specified

Tailored Resume

Cover Letter