Technical Lead, Spark (java)

Cloudera

Multiple Locations
On-site
Apache spark and livy development
Enterprise-grade distributed systems
Large-scale data processing
Cloudera is seeking a Technical Lead specializing in Spark (Java) to enhance their data engineering platform, collaborating with a distributed team. The ideal candidate will have extensive experience in software development and distributed systems, with a focus on building enterprise-grade solutions for large-scale data processing

Job Summary

  • Design new features for Cloudera’s data engineering experience and lead their delivery from prototype to production at scale.
  • Contribute to Apache Spark and Livy, developing new features in Scala/Java/Python on modern platforms.
  • Work on large-scale distributed systems, from 100s to 1000s of nodes, in production clusters, debugging system-level issues and performing root cause analysis.

Matching Summary

Match Score: 85

Cloudera is seeking a Technical Lead specializing in Spark (Java) to enhance their data engineering platform, collaborating with a distributed team. The ideal candidate will have extensive experience in software development and distributed systems, with a focus on building enterprise-grade solutions for large-scale data processing.

Skills & Requirements

Must-have

  • Apache Spark and Livy development
  • Enterprise-grade distributed systems
  • Large-scale data processing
  • Java/Scala/Python development
  • Distributed systems expertise

Nice-to-have

  • Open-source project contribution
  • Cloud platform experience
  • SQL planners and optimizers

Key Requirements

  • 8-10+ years of professional software development
  • Experience leading complex product enhancements
  • Strong understanding of Java, Scala, or Python
  • Experience with systems design and development
  • Experience with distributed systems

Work Rights

Not specified

Tailored Resume

Cover Letter