Technical Leader, Data Engineering – Big Data & Streaming Platforms - Java/scala Or Python | Spark, Kafka | Flink, Iceberg / Lakehouse, Trino | Pinot/clickhouse/starrocks | 12 To 15 Years

Cisco UK

Bangalore, India
Big data platform development
Kafka-based streaming applications
Apache spark and apache flink
Work and enhance big data related opensource technologies

Job Summary

  • Work and enhance big data related opensource technologies.
  • Build and operate Kafka-based streaming applications, including ingestion, filtering, enrichment, and replication use cases.
  • Develop data processing jobs using Apache Spark and/or Apache Flink, following established patterns and platform guidelines.

Matching Summary

Work and enhance big data related opensource technologies.

Skills & Requirements

Must-have

  • Big data platform development
  • Kafka-based streaming applications
  • Apache Spark and Apache Flink
  • Apache Iceberg data lake
  • Trino/Presto query engines
  • High volume Kafka scaling
  • Strong SQL and data modeling

Nice-to-have

  • Real-time analytics stores
  • AI tools for development
  • Data lake table formats
  • Data governance tools
  • Workflow orchestration tools
  • Lakehouse management systems

Key Requirements

  • 10+ years in data engineering
  • Java/Scala, Python coding skills
  • Experience with Spark and Flink
  • Experience with Trino/Presto
  • Experience with Kafka
  • Strong SQL skills

Work Rights

Not specified

Tailored Resume

Cover Letter