Data Engineer (databricks Focus)

Capgemini

Lisboa, PT
On-site
Databricks (spark/pyspark)
Delta lake
Unity catalog
Design, build and maintain robust batch and streaming pipelines using Databricks (Spark/PySpark, Databricks Workflows/Jobs)

Job Summary

  • Design, build and maintain robust batch and streaming pipelines using Databricks (Spark/PySpark, Databricks Workflows/Jobs).
  • Implement lakehouse best practices with Delta Lake (reliability, schema evolution, optimization) and data modeling for analytics readiness.
  • We promote an empowering environment with autonomy and peers' relationships among the top scores of our Monthly Employees' feedback.

Matching Summary

Design, build and maintain robust batch and streaming pipelines using Databricks (Spark/PySpark, Databricks Workflows/Jobs).

Skills & Requirements

Must-have

  • Databricks (Spark/PySpark)
  • Delta Lake
  • Unity Catalog
  • SQL and Python/PySpark
  • batch and streaming pipelines
  • CI/CD practices

Nice-to-have

  • proactive problem solving
  • ownership mindset
  • collaborative community
  • flexible and dynamic work environment

Key Requirements

  • 2+ years experience as a Data Engineer
  • Databricks experience strongly preferred
  • Fluency in Portuguese and English

Work Rights

Not specified

Tailored Resume

Cover Letter