Senior Machine Learning Engineer, Distributed Vllm (llm-d)

Red Hat

Boston, MA, United States
Base: $170,770.00 - $281,770.00; bonus/equity: not...
Fully remote
Proficiency in python and golang
Experience with kubernetes technologies
Knowledge of llm hosting technologies
Red Hat is on a mission to bring the power of open-source LLMs and vLLM to every enterprise

Job Summary

  • Red Hat is on a mission to bring the power of open-source LLMs and vLLM to every enterprise.
  • As a Senior Machine Learning Engineer, you will tackle challenges in scalable inference systems.
  • Join a culture of continuous improvement and innovation at Red Hat.

Matching Summary

Red Hat is on a mission to bring the power of open-source LLMs and vLLM to every enterprise.

Salary

Base: $170,770.00 - $281,770.00; Bonus/Equity: Not specified; Benefits: Comprehensive medical, dental, and vision coverage

Skills & Requirements

Must-have

  • Proficiency in Python and GoLang
  • Experience with Kubernetes technologies
  • Knowledge of LLM hosting technologies

Nice-to-have

  • Experience with GPU performance tools
  • Strong understanding of computer architecture
  • Active engagement in ML research community

Key Requirements

  • Experience in distributed systems
  • Bachelor's degree in computer science preferred
  • Technical leadership in a global team

Work Rights

Not specified

Tailored Resume

Cover Letter