Data Migration Engineer (ADF + Databricks)

OX CONSULTANCY PTE. LTD.

Singapore, Singapore
Not specified
Azure data factory metadata-driven pipelines
Cloudera to cloud migration experience
Large-volume historical data migration
OX CONSULTANCY PTE. LTD. is seeking a Data Migration Engineer to join their team in Singapore, focusing on Azure Data Factory and Databricks for large-volume data migration projects. The ideal candidate will have experience with Cloudera to cloud migrations and data reconciliation processes

Job Summary

  • The role involves executing mandatory migrations from Cloudera environments to the cloud using Azure technologies.
  • Candidates must possess strong skills in Azure Data Factory for building metadata-driven pipelines and Azure Databricks for data processing.
  • The position requires ensuring data integrity through rigorous reconciliation and formal audit sign-offs.

Matching Summary

Match Score: 85

OX CONSULTANCY PTE. LTD. is seeking a Data Migration Engineer to join their team in Singapore, focusing on Azure Data Factory and Databricks for large-volume data migration projects. The ideal candidate will have experience with Cloudera to cloud migrations and data reconciliation processes.

Skills & Requirements

Must-have

  • Azure Data Factory metadata-driven pipelines
  • Cloudera to Cloud migration experience
  • Large-volume historical data migration
  • Azure Databricks Spark SQL processing
  • Data reconciliation and audit sign-off

Nice-to-have

  • Azure Data Box-based migration experience
  • Bulk history extraction using Data Box
  • Landing data into ADLS Gen2
  • Processing history in Databricks Delta
  • Orchestrating incrementals via ADF

Work Rights

Not specified

Tailored Resume

Cover Letter