Senior Data Engineer - Python And Terraform Skills

Shifttechnology

Paris, France
On-site
Apache spark pipelines
Custom etl design
Data modeling
Drive end-to-end data architecture design for scalable and resilient systems

Job Summary

  • Drive end-to-end data architecture design for scalable and resilient systems.
  • Own and optimize Apache Spark-based pipelines (debugging, hardening, tuning, performance optimization).
  • Work closely with cross-functional teams (Analytics, ML, Product, Platform) and mentor junior engineers.

Matching Summary

Drive end-to-end data architecture design for scalable and resilient systems.

Skills & Requirements

Must-have

  • Apache Spark pipelines
  • custom ETL design
  • Data Modeling
  • Infrastructure as Code (Terraform)
  • Azure data services

Nice-to-have

  • Tech Lead experience
  • DBT
  • feature store
  • vector database
  • OLAP db
  • GraphDB
  • SQL mesh

Key Requirements

  • 8+ years experience
  • 3+ years SQL database, CosmosDB
  • 3+ years custom ETL design
  • 3+ years Data Modeling
  • Experience provisioning infrastructure

Work Rights

Not specified

Tailored Resume

Cover Letter