Senior Data Engineer – Big Data & Streaming Platforms - Java/scala Or Python | Spark, Kafka | Flink, Iceberg / Lakehouse, Trino | 8 To 12 Years

Cisco UK

Bangalore, India
Apache spark and apache flink
Kafka-based streaming applications
Apache iceberg data lake
Work and enhance big data related opensource technologies

Job Summary

  • Work and enhance big data related opensource technologies.
  • Build and operate Kafka-based streaming applications, including ingestion, filtering, enrichment, and replication use cases.
  • Develop data processing jobs using Apache Spark and/or Apache Flink, following established patterns and platform guidelines.

Matching Summary

Work and enhance big data related opensource technologies.

Skills & Requirements

Must-have

  • Apache Spark and Apache Flink
  • Kafka-based streaming applications
  • Apache Iceberg data lake
  • Trino/Presto query engines
  • Java/Scala or Python development
  • High volume Kafka workloads

Nice-to-have

  • Real-time analytics stores
  • AI Tools for development
  • Data governance tools
  • Lakehouse management systems
  • Orchestration tools like Airflow

Key Requirements

  • 8+ years experience
  • High-quality code in Java/Scala, Python
  • Practical experience with Spark and Flink
  • Practical experience with Trino/Presto
  • Experience with Kafka
  • Strong SQL skills
  • Data modeling for analytical workloads

Work Rights

Not specified

Tailored Resume

Cover Letter