Principal Data Engineering

3M UK

Sumaré, Brazil
Python, apache spark, pyspark
Data warehouse/lakehouse (databricks)
Sql and nosql data management
Collaborate with 60,000 other curious, creative 3Mers across diverse global locations, technologies, and products

Job Summary

  • Collaborate with 60,000 other curious, creative 3Mers across diverse global locations, technologies, and products.
  • Design and support an Enterprise Data Mesh to empower informatics and digital technologies for users across the globe.
  • 3M offers many programs to help you live your best life – physically and financially, with competitive compensation and benefits.

Matching Summary

Collaborate with 60,000 other curious, creative 3Mers across diverse global locations, technologies, and products.

Skills & Requirements

Must-have

  • Python, Apache Spark, PySpark
  • Data Warehouse/Lakehouse (Databricks)
  • SQL and NoSQL data management
  • Data pipelines for ingestion and transformation
  • Data governance and data management
  • Extract data from APIs

Nice-to-have

  • Cloud architecture (AWS, Databricks)
  • Data mesh style architecture
  • Stream-processing systems (Kafka, Kinesis)
  • Data quality and validation principles
  • Docker containers and Kubernetes
  • Agile development processes

Key Requirements

  • Bachelor's degree or higher in Computer Science, or equivalent education/experience
  • Solid professional experience in data management, data governance, and data warehouse/Lakehouse design
  • Extensive experience and proficiency with Python, Apache Spark, PySpark
  • Hands-on experience in Python to extract data from APIs
  • Comfort working with structured and unstructured data

Work Rights

Not specified

Tailored Resume

Cover Letter