Staff Software Engineer - Ai/ml Infra

GEICO

Multiple Locations, US
$115,000.00 - $300,000.00 py
Hybrid
Ml platform design and implementation
Kubernetes for ml workloads
Llm training and serving infrastructure
GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications

Job Summary

  • GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications.
  • You will be responsible for designing, implementing, and maintaining scalable, reliable systems that enable our data science and engineering teams to deploy and operate LLMs efficiently at scale.
  • GEICO offers a rewarding career where your ambitions are met with endless possibilities, with a comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being.

Matching Summary

GEICO AI platform and Infrastructure team is seeking an exceptional Senior ML Platform Engineer to build and scale our machine learning infrastructure with a focus on Large Language Models (LLMs) and AI applications.

Salary

$115,000.00 - $300,000.00

Skills & Requirements

Must-have

  • ML platform design and implementation
  • Kubernetes for ML workloads
  • LLM training and serving infrastructure
  • CI/CD for ML deployment
  • Python proficiency
  • Azure ML and AKS expertise

Nice-to-have

  • Mentoring junior engineers
  • Cross-functional collaboration
  • Technical leadership
  • Cost-effective solutions
  • Hybrid cloud solutions

Key Requirements

  • 8+ years software engineering experience
  • 3+ years ML infrastructure experience
  • 2+ years LLM experience
  • Bachelor's degree in CS or related field
  • Experience with open source LLMs
  • Kubernetes expertise
  • Azure services expertise
  • Feature store implementation
  • Inference optimization experience
  • DevOps and CI/CD platform experience
  • Terraform/ARM template proficiency
  • Docker and container optimization
  • Monitoring and alerting tools
  • SQL and NoSQL databases
  • Mentoring and technical leadership experience

Work Rights

Not specified

Tailored Resume

Cover Letter