Principal Machine Learning Engineer, Distributed Vllm Inference

Red Hat

Base: $189,600.00 - $312,730.00; bonus/equity: not...
Fully remote
Strong proficiency in python and golang
Experience with kubernetes service mesh technologies
Understanding of layer 7 networking and api gateways
Red Hat is on a mission to bring the power of open-source LLMs and vLLM to every enterprise

Job Summary

  • Red Hat is on a mission to bring the power of open-source LLMs and vLLM to every enterprise.
  • As a Principal Machine Learning Engineer, you will tackle challenges in scalable inference systems.
  • Join a culture of continuous learning and innovation at Red Hat.

Matching Summary

Red Hat is on a mission to bring the power of open-source LLMs and vLLM to every enterprise.

Salary

Base: $189,600.00 - $312,730.00; Bonus/Equity: Not specified; Benefits: Comprehensive medical, dental, and vision coverage

Skills & Requirements

Must-have

  • Strong proficiency in Python and GoLang
  • Experience with Kubernetes service mesh technologies
  • Understanding of Layer 7 networking and API gateways

Nice-to-have

  • Experience with GPU performance benchmarking
  • Excellent communication skills
  • Mentoring and guiding fellow engineers

Key Requirements

  • Bachelor's or Master's degree in computer science
  • Experience with distributed systems and cloud infrastructure
  • Ph.D. in an ML-related domain is a significant advantage

Work Rights

Not specified

Tailored Resume

Cover Letter