Staff Data Engineer-data Pipelines, Hadoop, Scala,spark,kafka (6+yrs- 8 Yrs)

Visa

Bengaluru, India
On-site
Hadoop, spark, kafka
Java 8+
Distributed systems
Architect, design, and build scalable big data and enterprise platform solutions that power critical data, analytics, and AI capabilities across the organization

Job Summary

  • Architect, design, and build scalable big data and enterprise platform solutions that power critical data, analytics, and AI capabilities across the organization.
  • Build and optimize batch and real-time data pipelines using Hadoop, Spark, and Kafka, and develop applications and platform services using Java 8+, REST APIs, JSON, and container-based technologies.
  • Leverage agentic coding tools and AI-assisted engineering practices to enhance developer productivity, code quality, and delivery speed.

Matching Summary

Architect, design, and build scalable big data and enterprise platform solutions that power critical data, analytics, and AI capabilities across the organization.

Skills & Requirements

Must-have

  • Hadoop, Spark, Kafka
  • Java 8+
  • distributed systems
  • API-driven application development
  • solution architecture
  • technical leadership
  • batch and real-time data pipelines

Nice-to-have

  • agentic coding tools
  • AI-assisted engineering practices
  • observability, resiliency engineering
  • performance optimization
  • stakeholder management

Key Requirements

  • 5+ years of relevant work experience or Advanced degree
  • 8+ years of relevant work experience
  • Experience supporting Data, Analytics, and AI/ML platforms
  • Familiarity with cloud platforms and container ecosystems

Work Rights

Not specified

Tailored Resume

Cover Letter