Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for our data consumers
Job Summary
Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for our data consumers.
S/he proactively identifies and drives the adoption of both new innovations and best practices for adopting these at an industrial scale to deliver optimized and high performing data pipelines.
As subject matter expert in the discipline, s/he conducts trainings and provides guidance to others on data engineering practises, technology and/or development methods demonstrating strong communication, mentoring and coaching skill.
Matching Summary
Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for our data consumers.
Skills & Requirements
Must-have
design and development of data pipelines
industrial grade data products
Databricks data engineering
AWS Glue, AWS EMR, AWS Athena
Spark, Apache Flink, Apache Kafka
Python, SQL, Scala coding skills
DevSecOps/DataOps practices
Nice-to-have
driving adoption of new innovations
mentoring and coaching skills
teamwork and collaboration
self-driven and proactive approach
Databricks and AWS certifications
Key Requirements
Master's or PhD degree in a quantitative field
18-20 years of professional hands-on experience
Proven track record in developing reusable data products using cloud technology
Expertise in cybersecurity guidelines, data privacy, compliancy regulations
Experience in coaching and/or mentoring, leading teams