Principal Data Engineering

3M

Sumaré, Brazil
Not specified; competitive remuneration + benefits...
4 days onsite
Python programming proficiency
Apache spark and pyspark experience
Databricks platform expertise
3M is seeking a Principal Data Engineering Specialist for their Corporate Research Digital Platforms team in Sumaré, Brazil. This role involves developing scalable data systems, collaborating with diverse teams, and leveraging advanced data engineering practices to support various markets

Job Summary

  • The role involves designing and supporting an Enterprise Data Mesh to empower informatics and digital technologies for users across the globe.
  • Candidates will collaborate with senior leadership, scientists, and engineers to implement new mesh domain nodes and drive technical architecture for accelerated solution designs.
  • 3M offers a culture of innovation where employees can apply their talent in bold ways while working with diverse global teams.

Matching Summary

Match Score: 85

3M is seeking a Principal Data Engineering Specialist for their Corporate Research Digital Platforms team in Sumaré, Brazil. This role involves developing scalable data systems, collaborating with diverse teams, and leveraging advanced data engineering practices to support various markets.

Salary

Not specified; Competitive remuneration and benefits based on regular benchmarks

Skills & Requirements

Must-have

  • Python programming proficiency
  • Apache Spark and PySpark experience
  • Databricks platform expertise
  • Data warehouse and lakehouse design
  • SQL and NoSQL database management
  • API data extraction and pipeline building

Nice-to-have

  • Materials science or chemistry domain knowledge
  • AWS cloud infrastructure experience
  • Data mesh architecture principles
  • Stream processing with Kafka or Kinesis
  • Docker and Kubernetes containerization
  • Airflow or Temporal.io orchestration
  • Feature engineering implementation

Key Requirements

  • Bachelor's degree in Computer Science or equivalent
  • Solid professional experience in data governance
  • Hands-on experience with Python for API extraction
  • Comfort working with structured and unstructured data

Work Rights

Not specified

Tailored Resume

Cover Letter