Big Data Engineer

PERSOL SINGAPORE PTE. LTD.

Singapore, Singapore
Hadoop ecosystem experience
Apache spark development
Complex sql and hive query optimization
The role involves designing and developing data features specifically for Huawei's search and recommendation systems

Job Summary

  • The role involves designing and developing data features specifically for Huawei's search and recommendation systems.
  • Candidates will be responsible for maintaining daily ETL jobs and optimizing resource usage for cost, compute, and storage.
  • The position requires ensuring high data quality, privacy, and security while generating reports for business stakeholders.

Matching Summary

Match Score: 75

The role involves designing and developing data features specifically for Huawei's search and recommendation systems.

Skills & Requirements

Must-have

  • Hadoop ecosystem experience
  • Apache Spark development
  • Complex SQL and Hive query optimization
  • ETL pipeline management
  • Data modeling and architecture

Nice-to-have

  • Python, Java, or Scala programming
  • Recommendation system experience
  • Tableau, PowerBI, or FineBI visualization
  • Flink and Kafka framework knowledge
  • Cost and compute optimization skills

Key Requirements

  • Master or Bachelor degree in Computer Science
  • Strong coding background in algorithms and data structures
  • Experience with large-scale data processing frameworks

Work Rights

Not specified

Tailored Resume

Cover Letter