Software Architect - Data Platform

Harnessinc

Bengaluru, India
On-site
Unified data platform design and architecture
Distributed systems and microservices
Low-latency, highly concurrent microservices
Lead the design, architecture, and development of a Unified Data platform serving over 20 product modules

Job Summary

  • Lead the design, architecture, and development of a Unified Data platform serving over 20 product modules.
  • Work closely with senior engineering leaders, mentor engineers, and collaborate with product and customer success teams.
  • Design and implement automation for infrastructure setup using technologies like Helm and Terraform, and troubleshoot production performance issues.

Matching Summary

Lead the design, architecture, and development of a Unified Data platform serving over 20 product modules.

Skills & Requirements

Must-have

  • Unified Data Platform design and architecture
  • Distributed systems and microservices
  • Low-latency, highly concurrent microservices
  • Batch and stream processing (Spark, Flink, Kafka)
  • Data lake storage (S3, GCS, NFS)
  • OLAP data stores (Pinot, Druid, Clickhouse)
  • JVM-based languages (Java, Scala, Kotlin)
  • Kubernetes infrastructure and deployment
  • Infrastructure automation (Helm, Terraform)

Nice-to-have

  • Open-source contributions to data projects
  • Building custom DSL based abstractions
  • Customer success team collaboration
  • Mentoring senior and junior engineers

Key Requirements

  • 15+ years of hands-on backend development experience
  • Experience in the data platform space
  • Experience with distributed systems and microservices
  • Experience with batch (Spark) and stream processing (Flink, Spark Streaming, Kafka Streams)
  • Experience with Data Lake storage (S3, GCS, NFS)
  • Experience with OLAP data stores (Pinot, Druid, Clickhouse)
  • Experience scaling and operating production data systems at 10K+ qps
  • Experience with Kubernetes infra & deployment, observability & alerting
  • Bachelor’s or Master’s degree in Computer Science or related field

Work Rights

Not specified

Tailored Resume

Cover Letter