Data Engineer, Parameta Solutions

TP ICAP

Singapore, Singapore
Hybrid
Python (pandas, dask, pyspark)
SQL
Aws or gcp
Design, build, and maintain performant batch and streaming data pipelines to support both real-time market data and large-scale batch processing

Job Summary

  • Design, build, and maintain performant batch and streaming data pipelines to support both real-time market data and large-scale batch processing.
  • Architect and manage cloud-based infrastructure (AWS or GCP) to ensure resilience, scalability, and efficiency.
  • Partner with stakeholders across functions to deliver reliable data services and enable analytical product development.

Matching Summary

Design, build, and maintain performant batch and streaming data pipelines to support both real-time market data and large-scale batch processing.

Skills & Requirements

Must-have

  • Python (Pandas, Dask, PySpark)
  • SQL
  • AWS or GCP
  • Snowflake
  • Apache Airflow
  • Apache Kafka
  • Apache Flink
  • CI/CD pipelines (Jenkins, GitLab)

Nice-to-have

  • Financial market data exposure
  • Capital markets environments
  • Additional programming languages

Key Requirements

  • Demonstrated professional experience in data engineering
  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or related technical field

Work Rights

Not specified

Tailored Resume

Cover Letter