AssemblyAI builds best-in-class Voice AI models powering the next generation of voice applications
Job Summary
AssemblyAI builds best-in-class Voice AI models powering the next generation of voice applications.
This role is focused on building and maintaining our LLM gateway service—a unified API platform that connects customers to multiple LLM providers.
As a Senior Engineer, you'll drive technical execution within the team, taking ownership of significant features and integrations while mentoring more junior engineers.
Matching Summary
AssemblyAI builds best-in-class Voice AI models powering the next generation of voice applications.
Skills & Requirements
Must-have
Go programming language
LLM APIs and prompt engineering
API gateways and rate limiting
Scalable and fault-tolerant solutions
RESTful APIs and distributed systems
Nice-to-have
AWS services experience
Monitoring and observability tools
Fault tolerance patterns
Customer success collaboration
Key Requirements
5+ years of professional software engineering experience
Proficiency in Go
Hands-on experience with LLM APIs
Experience building API gateways
Experience with prompt engineering techniques
Experience building applications with LLMs or AI agents
Solid understanding of software engineering fundamentals
Experience with SQL and database design
Experience with version control (Git) and CI/CD pipelines
Experience with containerization (Docker) and cloud infrastructure