Staff Software Engineer - Data Platform

Harnessinc

Bengaluru, India
On-site
Jvm-based languages (java, scala, kotlin)
Kafka & kafka connect
Apache spark
Participate in the design, architecture & development of a comprehensive data infrastructure solution for the Harness ecosystem

Job Summary

  • Participate in the design, architecture & development of a comprehensive data infrastructure solution for the Harness ecosystem.
  • Mentor senior/junior engineers through peer reviews and complex debugging, and author high-level and low-level design documents.
  • Design and implement infrastructure automation using Helm and Terraform, and troubleshoot production performance issues with Site Reliability Engineers.

Matching Summary

Participate in the design, architecture & development of a comprehensive data infrastructure solution for the Harness ecosystem.

Skills & Requirements

Must-have

  • JVM-based languages (Java, Scala, Kotlin)
  • Kafka & Kafka connect
  • Apache Spark
  • Object Storage
  • Iceberg
  • Query engines (Trino, StarRocks)
  • OLAP stores (Pinot, Druid)

Nice-to-have

  • Declarative ingestion frameworks
  • DSL based query expressions
  • Sub-second read latency
  • Sub-minute freshness SLA
  • Automation of infrastructure setup

Key Requirements

  • 6-12 years backend engineering experience
  • Strong focus on data platforms and analytics systems
  • Proven expertise in building low-latency, highly concurrent microservices
  • Bachelor’s or Master’s degree in Computer Science or related field
  • Good understanding of OLAP modelling

Work Rights

Not specified

Tailored Resume

Cover Letter