Big Data Engineer - (scala | Spark | Databricks | Cloud)

Citi Handlowy

Not specified
Apache spark expertise
Scala or python programming
Hadoop ecosystem experience
Citi Handlowy is seeking an experienced Big Data Engineer proficient in the Hadoop ecosystem and Apache Spark. The ideal candidate will have 4-6 years of relevant experience, focusing on developing and optimizing scalable data pipelines and collaborating with various stakeholders to derive insights from large datasets

Job Summary

  • The role involves designing and maintaining robust ETL processes and data pipelines for large-scale data processing.
  • Candidates will collaborate with data scientists and architects to translate business requirements into technical solutions.
  • The position requires optimizing existing Spark jobs and ensuring data quality, integrity, and security across platforms.

Matching Summary

Match Score: 85

Citi Handlowy is seeking an experienced Big Data Engineer proficient in the Hadoop ecosystem and Apache Spark. The ideal candidate will have 4-6 years of relevant experience, focusing on developing and optimizing scalable data pipelines and collaborating with various stakeholders to derive insights from large datasets.

Skills & Requirements

Must-have

  • Apache Spark expertise
  • Scala or Python programming
  • Hadoop ecosystem experience
  • Scalable data pipeline development
  • ETL process design

Nice-to-have

  • Cloud-based big data services
  • Databricks platform familiarity
  • CI/CD practices knowledge
  • Machine learning concepts understanding
  • Kafka or Flink experience

Key Requirements

  • 4-6 years of hands-on big data experience
  • Bachelor's or Master's degree in Computer Science
  • Strong SQL and shell scripting skills

Work Rights

Not specified

Tailored Resume

Cover Letter