Data Engineer – Databricks

Air Products Inc

Pune, India
Hybrid
Databricks platform experience
Apache spark pyspark development
Delta lake medallion architecture
The role involves migrating enterprise data workloads from AWS-based platforms to Databricks as part of a broader data modernization journey

Job Summary

  • The role involves migrating enterprise data workloads from AWS-based platforms to Databricks as part of a broader data modernization journey.
  • Candidates will build scalable batch and streaming pipelines while optimizing Spark workloads for performance and cost efficiency.
  • Air Products offers an environment focused on safety, diversity, and innovation in solving global energy and environmental sustainability challenges.

Matching Summary

The role involves migrating enterprise data workloads from AWS-based platforms to Databricks as part of a broader data modernization journey.

Skills & Requirements

Must-have

  • Databricks platform experience
  • Apache Spark PySpark development
  • Delta Lake Medallion architecture
  • AWS cloud infrastructure skills
  • Terraform Infrastructure as Code
  • Structured Streaming pipelines
  • Data migration from AWS Glue

Nice-to-have

  • Unity Catalog governance experience
  • CI/CD pipeline familiarity
  • dbt or Airflow knowledge
  • Databricks certification preferred
  • Mentoring junior engineers
  • Cross-functional collaboration
  • DevOps best practices

Key Requirements

  • 4-8 years Data Engineering experience
  • Strong hands-on Databricks expertise
  • Production-grade pipeline building
  • Cloud-native architecture understanding
  • Problem-solving and communication skills

Work Rights

Not specified

Tailored Resume

Cover Letter