Job Summary

• Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features; profile and optimize the inference framework (vLLM) with methods like speculative decoding, data/tensor/expert/pipeline-parallelism, prefill-decode disaggregation.
• Develop, optimize, and benchmark GPU kernels (hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization; build and extend high-level DSLs and compiler infrastructure to boost kernel developer productivity while approaching peak hardware utilization.
• Architect the scheduling and orchestration of containerized large-scale inference deployments on GPU clusters across clouds.

Matching Summary

Salary

Base: 108,000 USD - 195,500 USD; Bonus/Equity: equity; Benefits: benefits

Skills & Requirements

Key Requirements

• Bachelor's, Master's, or PhD degree in CS, CE, or SE
• Strong CS fundamentals
• Experience with containers and orchestration
• Excellent debugging, problem-solving, and communication skills

Work Rights