Data & AnalyticsEngenheiro(a) de DadosProfessionalNO City, BR

IBM

São Paulo, Brazil
**
Python programming
Pyspark development
Sql database management
** IBM is seeking a Data Engineer to develop and maintain data pipelines and solutions in a Big Data environment. The ideal candidate will possess strong technical skills in programming, data processing, and database management, with a focus on collaborating with multidisciplinary teams to deliver innovative solutions. **

Job Summary

  • The role involves developing, maintaining, and optimizing batch and streaming data pipelines within a Big Data environment.
  • Candidates will work in IBM Consulting Client Innovation Centers to deliver technical expertise to public and private sector clients globally.
  • The position requires designing scalable data architectures and ensuring data quality, integrity, and governance for decision-making processes.

Matching Summary

Match Score: 75

** IBM is seeking a Data Engineer to develop and maintain data pipelines and solutions in a Big Data environment. The ideal candidate will possess strong technical skills in programming, data processing, and database management, with a focus on collaborating with multidisciplinary teams to deliver innovative solutions. **

Skills & Requirements

Must-have

  • Python programming
  • PySpark development
  • SQL database management
  • Big Data processing with Hadoop/Hive/Spark
  • Apache NiFi experience
  • Database modeling with Erwin
  • Git version control

Nice-to-have

  • SparkML machine learning
  • Performance tuning expertise
  • Cross-functional collaboration
  • Innovative problem solving
  • Hybrid cloud knowledge

Key Requirements

  • Bachelor's Degree required
  • Experience with DB2, MySQL, Oracle databases
  • Proficiency in DBeaver or similar query tools

Work Rights

Not specified

Tailored Resume

Cover Letter