The Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for data consumers
Job Summary
The Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for data consumers.
This role requires a deep technical expert who acts as the go-to-person on technical aspects while driving the adoption of new innovations at an industrial scale.
Candidates must have 18-20 years of hands-on experience in data engineering and software engineering with proven track records in developing reusable data products.
Matching Summary
The Principal Data Engineer leads the design, development, and industrialization of data pipelines to provide industrial grade data products for data consumers.
Skills & Requirements
Must-have
18-20 years professional hands-on experience
Master's or PhD in quantitative field
Expertise in Databricks Unity Catalog Airflow DBT
Proficiency in Python SQL Scala languages
Experience with AWS Glue EMR Athena Spark Flink Kafka
Knowledge of Terraform Gitlab Github DevSecOps DataOps
Ability to lead teams and mentor engineers
Nice-to-have
Databricks and AWS certifications preferred
Passion for agile development methodologies
Experience with IoT and enterprise systems like SAP Salesforce
Strong communication and cross-cultural collaboration skills