Data Engineer – Databricks

381

Pune, India
Hybrid
Databricks on aws experience
Apache spark pyspark development
Delta lake medallion architecture
The role involves migrating enterprise data workloads from AWS-based platforms to Databricks as part of a broader data modernization journey

Job Summary

  • The role involves migrating enterprise data workloads from AWS-based platforms to Databricks as part of a broader data modernization journey.
  • Candidates will build scalable production-grade data pipelines using Databricks Jobs, Workflows, and SQL while optimizing for performance and cost efficiency.
  • This position offers the opportunity to work closely with AI/ML teams and contribute to large-scale data platform modernization at a leading industrial gas company.

Matching Summary

The role involves migrating enterprise data workloads from AWS-based platforms to Databricks as part of a broader data modernization journey.

Skills & Requirements

Must-have

  • Databricks on AWS experience
  • Apache Spark PySpark development
  • Delta Lake Medallion architecture
  • Terraform Infrastructure as Code
  • AWS Glue Redshift migration
  • Structured Streaming pipelines

Nice-to-have

  • Unity Catalog data governance
  • CI/CD pipeline familiarity
  • dbt or Airflow experience
  • Databricks certification preferred
  • Mentoring junior engineers

Key Requirements

  • 4-8 years Data Engineering experience
  • Strong hands-on Databricks skills
  • Advanced Apache Spark knowledge
  • Experience with Terraform IAC
  • Production-grade pipeline building

Work Rights

Not specified

Tailored Resume

Cover Letter