Data Engineer – Databricks

Air Products

Pune, India
Hybrid
Databricks
Apache spark (pyspark)
Delta lake medallion architectures
You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions

Job Summary

  • You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions.
  • This role will also be involved in migrating enterprise data workloads from AWS-based platforms to Databricks, contributing to our broader data modernization journey.
  • Work on large-scale data platform modernization with hands-on ownership of Databricks Lakehouse architecture.

Matching Summary

You will work on high-impact data engineering initiatives, collaborating with analytics, AI/ML, and business teams to deliver reliable and performant data solutions.

Skills & Requirements

Must-have

  • Databricks
  • Apache Spark (PySpark)
  • Delta Lake Medallion architectures
  • Structured Streaming
  • AWS
  • Python

Nice-to-have

  • Unity Catalog and data governance
  • CI/CD pipelines and DevOps
  • Terraform, dbt, or Airflow
  • Databricks certification

Key Requirements

  • 4-6+ years of experience in Data Engineering
  • Hands-on experience with Databricks on AWS
  • Experience with Terraform (IAC)
  • Experience with SQL
  • Experience building scalable, production-grade data pipelines

Work Rights

Not specified

Tailored Resume

Cover Letter