Data Engineer

Kpler SaS

Germany, Germany
On-site
Rest apis
Kafka stream
Spark batch pipelines
Build and maintain Kpler's core datasets (vessels characteristics, companies, geospatial data)

Job Summary

  • Build and maintain Kpler's core datasets (vessels characteristics, companies, geospatial data).
  • You will be responsible for creating and maintaining REST APIs, streaming pipelines (Kafka Stream), and Spark batch pipelines.
  • After release, the role includes monitoring system performance, alerts, and SLOs to ensure optimal functionality and reliability.

Matching Summary

Build and maintain Kpler's core datasets (vessels characteristics, companies, geospatial data).

Skills & Requirements

Must-have

  • REST APIs
  • Kafka Stream
  • Spark batch pipelines
  • end-to-end ownership
  • system performance monitoring

Nice-to-have

  • transforming intricate data
  • actionable strategies
  • cutting-edge innovation
  • impactful results
  • unparalleled support

Key Requirements

  • Understanding of assigned tickets and requirements
  • Code deployment to development environments
  • Peer and product testing
  • Writing and executing unit, integration, and functional tests
  • Detailed validation

Work Rights

Not specified

Tailored Resume

Cover Letter