Distinguished Engineer, Apache Spark

NVIDIA

Base: 320,000 usd - 488,750 usd; bonus/equity: equ...
Apache spark acceleration
Gpu accelerated data processing
Distributed systems architecture
Lead the architecture, design and implementation of accelerated Apache Spark and related big-data frameworks

Job Summary

  • Lead the architecture, design and implementation of accelerated Apache Spark and related big-data frameworks.
  • Engage open source communities for technical discussion and contribution, and engage new communities where we may not have a strong presence yet.
  • Build, test and optimize CUDA/C++ libraries across different platforms and build automation and tools that will increase the productivity of teams developing distributed systems.

Matching Summary

Lead the architecture, design and implementation of accelerated Apache Spark and related big-data frameworks.

Salary

Base: 320,000 USD - 488,750 USD; Bonus/Equity: Equity; Benefits: Benefits

Skills & Requirements

Must-have

  • Apache Spark acceleration
  • GPU accelerated data processing
  • distributed systems architecture
  • open source contribution
  • CUDA/C++ library development

Nice-to-have

  • columnar query engine design
  • major open source committership
  • collaboration across geographies

Key Requirements

  • 17+ years software development experience
  • Lead architect experience
  • BS/MS/PhD in CS or related
  • 5+ years big-data project experience
  • Kubernetes/YARN/Spark scheduler knowledge

Work Rights

Not specified

Tailored Resume

Cover Letter