Data Engineer

PERSOL SINGAPORE PTE. LTD.

Singapore, Singapore
Talend to spark migration experience
Pyspark or scala development skills
Informatica idmc implementation
The role involves analyzing existing Talend ETL jobs and designing equivalent Spark-based pipelines for migration and optimization

Job Summary

  • The role involves analyzing existing Talend ETL jobs and designing equivalent Spark-based pipelines for migration and optimization.
  • Candidates will collaborate with data architects to define scalable data lake and lakehouse solutions while working on BI projects.
  • The position requires integration of Spark pipelines with major cloud platforms including AWS, Azure, and GCP using orchestration tools.

Matching Summary

The role involves analyzing existing Talend ETL jobs and designing equivalent Spark-based pipelines for migration and optimization.

Skills & Requirements

Must-have

  • Talend to Spark migration experience
  • PySpark or Scala development skills
  • Informatica IDMC implementation
  • Databricks platform expertise
  • Cloud services AWS Azure GCP

Nice-to-have

  • Airflow orchestration tools
  • Data lakehouse architecture design
  • Systems impact analysis support
  • Scalable data warehousing concepts

Key Requirements

  • Minimum 6 years of data engineering experience
  • Degree in Computer Science or related field
  • Implementation involvement in at least 4 project cycles
  • Solid understanding of SQL and data warehousing

Work Rights

Not specified

Tailored Resume

Cover Letter