Senior Lead Ai Engineer (fm Hosting, Llm Inference)

Capital One

McLean, VA, USA
Mclean, va: $229,900 - $262,400; new york, ny: $25...
Llm inference optimization
Foundation model training
Large scale production ai systems
At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build

Job Summary

  • At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build.
  • Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
  • Invent and introduce state-of-the-art LLM optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.

Matching Summary

At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build.

Salary

McLean, VA: $229,900 - $262,400; New York, NY: $250,800 - $286,200; San Jose, CA: $250,800 - $286,200; Bonus/Equity: Performance based incentive compensation; Benefits: Comprehensive, competitive, and inclusive set of health, financial and other benefits

Skills & Requirements

Must-have

  • LLM inference optimization
  • foundation model training
  • large scale production AI systems
  • AI software components
  • Open Source and SaaS AI technologies

Nice-to-have

  • staying abreast of latest research
  • bringing clarity to undefined problems
  • courage to share new ideas
  • resilient trail blazer

Key Requirements

  • 6 years of experience developing AI/ML algorithms
  • 4 years of experience developing AI/ML algorithms (Master's)
  • 6 years of programming with Python, Go, Scala, or Java
  • 7 years of experience deploying AI on cloud platforms
  • Experience leading and mentoring engineering teams

Work Rights

Not specified

Sponsorship: available

Tailored Resume

Cover Letter