ITCAN PTE. LIMITED is seeking a Big Data Platform Engineer to operate and enhance their GlobalData Platform components and applications. The ideal candidate will have extensive experience in building large-scale distributed systems, data pipeline development, and automation, with a focus on collaboration and continuous improvement
Job Summary
The role involves operating global data platform components including VM servers, Kubernetes, and Kafka.
Candidates will implement infrastructure automation and continuous delivery pipelines to optimize data execution.
The position requires applying DevSecOps and Agile approaches to deliver integrated solutions in iterative increments.
Matching Summary
Match Score: 85
ITCAN PTE. LIMITED is seeking a Big Data Platform Engineer to operate and enhance their GlobalData Platform components and applications. The ideal candidate will have extensive experience in building large-scale distributed systems, data pipeline development, and automation, with a focus on collaboration and continuous improvement.
Skills & Requirements
Must-have
5+ years distributed systems experience
Kubernetes and Kafka expertise
DevOps and CI/CD automation
Python, Java, or Scala proficiency
Data pipeline resiliency design
Nice-to-have
Machine learning algorithm knowledge
German language skills beneficial
Financial sector domain knowledge
Cloud migration experience preferred
Agile project management methods
Key Requirements
5+ years building large-scale distributed systems
Higher education degree required
Experience with Hadoop ecosystem and Spark
Proficiency in Linux/Unix scripting and firewall config