Data Engineer

Datamatics Technologies

Chennai, India
**
Azure data factory (adf)
Azure data lake storage (adls)
Pyspark programming skills
** Datamatics Technologies is seeking a Data Engineer with 3-5 years of experience to design and maintain scalable data pipelines within the Azure ecosystem. This role involves working with Azure Data Factory and Data Lake Storage, focusing on data quality and enabling analytics and reporting. **

Job Summary

  • The role involves designing and maintaining scalable data pipelines within the Azure ecosystem to enable data-driven insights.
  • Candidates will work with structured and unstructured data sources while ensuring data quality and integrity across all pipelines.
  • This position offers a clear career progression pathway to a Senior Data Engineer role involving Microsoft Fabric and advanced Azure services.

Matching Summary

Match Score: 75

** Datamatics Technologies is seeking a Data Engineer with 3-5 years of experience to design and maintain scalable data pipelines within the Azure ecosystem. This role involves working with Azure Data Factory and Data Lake Storage, focusing on data quality and enabling analytics and reporting. **

Skills & Requirements

Must-have

  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS)
  • PySpark programming skills
  • SQL optimization expertise
  • ETL/ELT pipeline development
  • Lakehouse architecture knowledge

Nice-to-have

  • Azure Databricks experience
  • Data modeling concepts
  • Agile/Scrum environment exposure
  • Strong stakeholder collaboration
  • Proactive problem-solving approach

Key Requirements

  • 3-5 years of relevant experience
  • Hands-on experience with Azure Data Factory
  • Strong programming skills in PySpark and SQL

Work Rights

Not specified

Tailored Resume

Cover Letter