Data Engineer

Datamatics Technologies

Mumbai, India
On-site
Azure data factory (adf)
Azure data lake storage (adls)
Pyspark programming skills
The role involves designing and maintaining scalable data pipelines within the Azure ecosystem to enable data-driven insights

Job Summary

  • The role involves designing and maintaining scalable data pipelines within the Azure ecosystem to enable data-driven insights.
  • Candidates will be responsible for building and optimizing data transformations using PySpark and SQL while ensuring data quality.
  • This position offers a clear career progression pathway to a Senior Data Engineer role with responsibilities in end-to-end architecture design.

Matching Summary

The role involves designing and maintaining scalable data pipelines within the Azure ecosystem to enable data-driven insights.

Skills & Requirements

Must-have

  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • PySpark programming skills
  • SQL optimization expertise
  • ETL/ELT pipeline development
  • Lakehouse architecture knowledge

Nice-to-have

  • Azure Databricks experience
  • Agile/Scrum environment exposure
  • Data governance frameworks
  • Strong stakeholder collaboration
  • Remote work independence

Key Requirements

  • 3-5 years of relevant experience
  • Hands-on experience with Azure services
  • Strong problem-solving and debugging skills

Work Rights

Not specified

Tailored Resume

Cover Letter