Databricks Cloudera Data Engineer

TOSS-EX PR PTE. LTD.

Singapore, Singapore
Not specified
Azure data factory metadata-driven pipelines
Cloudera to cloud migration experience
Large-volume historical data migration
TOSS-EX PR PTE. LTD. is seeking a Databricks Cloudera Data Engineer with over six years of experience in large-scale data platform and migration projects. The ideal candidate will be responsible for end-to-end data migration from Cloudera to cloud environments, specifically leveraging Azure Data Factory and Databricks

Job Summary

  • The role requires owning end-to-end historical data migration from Cloudera and legacy systems to cloud platforms.
  • Candidates must design restartable, idempotent migration pipelines with full metadata-driven orchestration via Azure Data Factory.
  • The position involves acting as the single point of contact for platform, ingestion, and business teams during parallel runs and cutover.

Matching Summary

Match Score: 85

TOSS-EX PR PTE. LTD. is seeking a Databricks Cloudera Data Engineer with over six years of experience in large-scale data platform and migration projects. The ideal candidate will be responsible for end-to-end data migration from Cloudera to cloud environments, specifically leveraging Azure Data Factory and Databricks.

Skills & Requirements

Must-have

  • Azure Data Factory metadata-driven pipelines
  • Cloudera to Cloud migration experience
  • Large-volume historical data migration
  • Azure Databricks Spark SQL development
  • Data reconciliation and audit sign-off

Nice-to-have

  • Azure Data Box-based migration experience
  • Bulk history extraction using Data Box
  • Delta Lake processing in Databricks
  • Automated testing pack development
  • Schema drift handling expertise

Key Requirements

  • 6+ years experience in large data platform
  • Mandatory Cloudera working knowledge
  • Proven track record in large-scale data migration

Work Rights

Not specified

Tailored Resume

Cover Letter