Software Engineer, Model Serving Infrastructure

Anyscale

Bengaluru, Karnataka, India
Not specified
Strong systems fundamentals in os and networking
Production experience with scalable systems
Deep knowledge of distributed systems trade-offs
Anyscale is seeking a Software Engineer for their Model Serving Infrastructure team in Bengaluru, India. The role involves developing high-performance machine learning serving systems and requires a strong background in distributed systems and systems programming

Job Summary

  • The role focuses on building next-generation, high-performance machine learning serving systems that power AI applications for millions of users.
  • Engineers will solve fundamental computer science problems at the intersection of distributed systems, machine learning, and high-performance computing.
  • The team leverages AI coding agents to scale development while maintaining a lean and highly utilized engineering group.

Matching Summary

Match Score: 85

Anyscale is seeking a Software Engineer for their Model Serving Infrastructure team in Bengaluru, India. The role involves developing high-performance machine learning serving systems and requires a strong background in distributed systems and systems programming.

Skills & Requirements

Must-have

  • Strong systems fundamentals in OS and networking
  • Production experience with scalable systems
  • Deep knowledge of distributed systems trade-offs
  • High code quality and testing coverage standards
  • Ownership mindset for design to incident response

Nice-to-have

  • Experience with gRPC and Ray frameworks
  • Background in ML/AI systems or serving infrastructure
  • Contributions to major open source projects
  • Knowledge of cloud-native technologies like Kubernetes
  • Experience with performance optimization and profiling

Key Requirements

  • Deep understanding of operating systems, networking, and concurrency
  • Proven track record of building systems serving real users at scale
  • Ability to instruct AI agents to output golden standard code

Work Rights

Not specified

Tailored Resume

Cover Letter