Air Products is seeking a Data Engineer to enhance their analytics and AI initiatives by building and maintaining scalable data pipelines using Databricks and Apache Spark. The role emphasizes collaboration with data scientists and analysts, focusing on data governance and integration in a hybrid work environment
Job Summary
The company is a leading multinational industrial gas firm seeking to innovate solutions for global energy and environmental sustainability challenges.
This role involves designing, building, and maintaining highly scalable data pipelines primarily leveraging Databricks, Apache Spark, and Delta Lake.
Candidates must possess advanced English skills and collaborate closely with data scientists to productionize models within the enterprise data lake.
Matching Summary
Match Score: 85
Air Products is seeking a Data Engineer to enhance their analytics and AI initiatives by building and maintaining scalable data pipelines using Databricks and Apache Spark. The role emphasizes collaboration with data scientists and analysts, focusing on data governance and integration in a hybrid work environment.
Skills & Requirements
Must-have
Databricks Autoloader experience
Delta Live Tables (DLT) expertise
Unity Catalog governance knowledge
Apache Spark optimization skills
AWS S3 cloud architecture proficiency
Advanced English language capability
Nice-to-have
Infrastructure-as-code with Terraform
NoSQL database experience like MongoDB
Qlik Replicate integration skills
AWS Glue tool familiarity
Python programming for data processing
Key Requirements
Bachelor's degree in Information Technology or related field