Data Engineer

ANCHOR SEARCH GROUP PTE. LTD.

Singapore
Strong python programming skills
Advanced sql with window functions
Experience with apache airflow or prefect
The role involves designing and maintaining idempotent, scalable, and fault-tolerant data pipelines using Python and SQL

Job Summary

  • The role involves designing and maintaining idempotent, scalable, and fault-tolerant data pipelines using Python and SQL.
  • Candidates must handle package dependency management, resolve security vulnerabilities from scans, and ensure compliance in restricted environments.
  • The position requires refactoring legacy code for data ingestion, transformation, and model training while implementing robust testing and monitoring.

Matching Summary

Match Score: 85

The role involves designing and maintaining idempotent, scalable, and fault-tolerant data pipelines using Python and SQL.

Skills & Requirements

Must-have

  • Strong Python programming skills
  • Advanced SQL with window functions
  • Experience with Apache Airflow or Prefect
  • Hands-on Pandas and Kafka integration
  • Package and dependency management expertise

Nice-to-have

  • Experience in regulated high-security environments
  • Knowledge of secure coding practices
  • Ability to work across API and ML layers

Key Requirements

  • 2-3 years of experience in data engineering
  • Prior production pipeline experience
  • Experience handling dependency conflicts and library upgrades

Work Rights

Not specified

Tailored Resume

Cover Letter