Big Data Platform Engineer

INTELLECT MINDS PTE. LTD.

Singapore
Not specified (assumed to be hybrid or onsite based on role)
Hadoop
Spark
Kafka
INTELLECT MINDS PTE. LTD. is seeking a Big Data Platform Engineer to build and manage scalable data platforms, emphasizing automation, CI/CD, and collaboration in an Agile environment. The ideal candidate must possess strong skills in Hadoop, Spark, and Kafka, with a background in DevOps and experience in distributed systems

Job Summary

  • The role involves building and managing scalable big data platforms and ETL/ELT pipelines.
  • Candidates must implement automation and CI/CD processes for data and infrastructure using Agile practices.
  • Proficiency in distributed systems and streaming solutions with Kafka and Spark is essential for platform reliability.

Matching Summary

Match Score: 85

INTELLECT MINDS PTE. LTD. is seeking a Big Data Platform Engineer to build and manage scalable data platforms, emphasizing automation, CI/CD, and collaboration in an Agile environment. The ideal candidate must possess strong skills in Hadoop, Spark, and Kafka, with a background in DevOps and experience in distributed systems.

Skills & Requirements

Must-have

  • Hadoop
  • Spark
  • Kafka
  • DevOps & CI/CD
  • Distributed systems
  • Python Java Scala
  • Linux Unix environment

Nice-to-have

  • Kubernetes Docker
  • Cloud AWS Azure GCP
  • Parquet ORC Avro formats
  • Ansible Jenkins tools
  • Dataiku ML Ops exposure

Key Requirements

  • Bachelor's degree in Computer Science or related field

Work Rights

Not specified

Tailored Resume

Cover Letter