Senior Data Engineer

Glanbia

Cairo, Egypt
Fully remote
Databricks pipeline development
Spark or scala proficiency
Medallion architecture implementation
Glanbia is seeking a Senior Data Engineer to join their remote team in Cairo, Egypt. The role involves designing and maintaining ETL/ELT pipelines, collaborating with AI/ML teams, and integrating serverless APIs, requiring experience with Databricks and data engineering best practices

Job Summary

  • The role involves designing and maintaining ETL/ELT pipelines in Databricks to ingest and transform data from diverse sources.
  • Candidates will collaborate with AI/ML teams to structure data for natural language prompts and semantic retrieval using vector search.
  • The position requires working with backend engineers to implement scalable, secure serverless APIs that expose gold tables to applications.

Matching Summary

Match Score: 85

Glanbia is seeking a Senior Data Engineer to join their remote team in Cairo, Egypt. The role involves designing and maintaining ETL/ELT pipelines, collaborating with AI/ML teams, and integrating serverless APIs, requiring experience with Databricks and data engineering best practices.

Skills & Requirements

Must-have

  • Databricks pipeline development
  • Spark or Scala proficiency
  • Medallion architecture implementation
  • CI/CD best practices
  • Agile distributed team experience

Nice-to-have

  • AWS Lambda and TypeScript
  • React-based frontend architecture
  • A/B testing and experiment logging
  • MLOps and AIOps lifecycles
  • Vector search and Unity Catalog

Key Requirements

  • 3+ years of Data Engineer experience
  • Proven expertise with Databricks workflows
  • Proficiency in Spark or Scala

Work Rights

Not specified

Tailored Resume

Cover Letter