Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for our data consumers
Job Summary
Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for our data consumers.
S/he proactively identifies and drives the adoption of both new innovations and best practices for adopting these at an industrial scale to deliver optimized and high performing data pipelines.
As subject matter expert in the discipline, s/he conducts trainings and provides guidance to others on data engineering practises, technology and/or development methods demonstrating strong communication, mentoring and coaching skill.
Matching Summary
Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for our data consumers.
Skills & Requirements
Must-have
design and development of data pipelines
industrial grade data products
Databricks data engineering
AWS Glue, AWS EMR, AWS Athena
Spark, Apache Flink, Apache Kafka
Python, SQL, Scala
DevSecOps/DataOps practices
Nice-to-have
proactive approach and problem-solving
teamwork and knowledge sharing
agile development methodologies
Databricks and AWS certifications
Key Requirements
Master's or PhD degree in a quantitative field
18-20 years of professional hands-on experience
Expertise in cybersecurity guidelines, data privacy, compliancy regulations
Experience in coaching and/or mentoring, leading teams