Senior Data Engineer (Big Data, Hadoop, Python, Spark )

HCL SINGAPORE PTE. LTD.

Singapore, Singapore
**
8 years big data experience
Hadoop ecosystem expertise
Apache spark proficiency
** HCL Singapore Pte. Ltd. is seeking a Senior Data Engineer with extensive experience in Big Data technologies, specifically Hadoop, Python, and Spark. The role involves designing and maintaining scalable data processing systems to support advanced analytics across the organization. **

Job Summary

  • The role involves designing and optimizing large-scale data pipelines using Hadoop and Spark frameworks.
  • Candidates must possess at least 8 years of hands-on experience in Big Data technologies and Python.
  • The position requires collaboration with data scientists and stakeholders to deliver actionable business intelligence solutions.

Matching Summary

Match Score: 75

** HCL Singapore Pte. Ltd. is seeking a Senior Data Engineer with extensive experience in Big Data technologies, specifically Hadoop, Python, and Spark. The role involves designing and maintaining scalable data processing systems to support advanced analytics across the organization. **

Skills & Requirements

Must-have

  • 8 years Big Data experience
  • Hadoop ecosystem expertise
  • Apache Spark proficiency
  • Python programming skills
  • ETL process development

Nice-to-have

  • Cloud platform experience AWS Azure GCP
  • Docker containerization knowledge
  • Kubernetes orchestration familiarity
  • Real-time processing with Kafka Flink
  • NoSQL database experience

Key Requirements

  • Bachelor's or Master's degree in Computer Science or related field
  • Minimum 8 years professional experience in data engineering
  • Advanced proficiency in Python for data manipulation
  • Experience with SQL and NoSQL databases

Work Rights

Not specified

Tailored Resume

Cover Letter