Senior Data Engineer

Kargo

London, United Kingdom
On-site
Python and spark for data pipelines
Airflow for workflow orchestration
Apache iceberg for table format
Build and scale data infrastructure for Kargo's targeting, identity, and measurement capabilities

Job Summary

  • Build and scale data infrastructure for Kargo's targeting, identity, and measurement capabilities.
  • Optimize core ETL/ELT pipelines, onboard new datasets, and implement CI/CD practices.
  • Implement privacy-compliant data methodologies and create thorough technical documentation.

Matching Summary

Build and scale data infrastructure for Kargo's targeting, identity, and measurement capabilities.

Skills & Requirements

Must-have

  • Python and Spark for data pipelines
  • Airflow for workflow orchestration
  • Apache Iceberg for table format
  • AWS EKS, Docker, Kubernetes
  • CI/CD with ArgoCD, automated testing
  • Snowflake or ClickHouse warehousing
  • Ad tech identity and privacy

Nice-to-have

  • Real-time streaming technologies
  • Low-latency key-value stores

Key Requirements

  • Deep proficiency in Python and Spark
  • Hands-on experience with Airflow
  • Extensive AWS experience
  • CI/CD fluency
  • Familiarity with analytical warehousing
  • Working knowledge of ad tech methodologies

Work Rights

Not specified

Tailored Resume

Cover Letter