Backend Engineer, AI (Agent Systems)

EPS CONSULTANTS PTE LTD

D01 Marina, Raffles Place, People's Park, Cecil, 160 ROBINSON ROAD SINGAPORE BUSINESS FEDERATION CENTER 068914
Sgd 5,500 - 9,000 / monthly pm
On-site
Model serving
Kubernetes
Caché
As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience. You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients. Job Duties: Build and operate backend systems that serve AI-powered features in production. Design inference pipelines, orchestration layers, and service boundaries around models. Own production concerns: monitoring, logging, alerting, and incident response. Optimize latency and throughput across inference, caching, batching, and streaming. Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput. Ensure APIs are stable, clear, and support seamless integration with frontend and ML systems. Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact. Iterative improvements based on real usage continuously increase system performance and reliability. Technical Experience/Requirements: Python NodeJs Pytorch OpenAI / Anthropic / open-source LLMs Kubernetes Docker Strong backend engineering fundamentals in production environments. Experience running high-throughput, low-latency services. Familiarity with AI inference patterns (LLMs, embeddings, multimodal). Comfortable debugging distributed systems under load. Bias toward shipping and learning from production behavior. Interested candidates may apply directly to Patrina@eps.com.sg (Reg ID: R1103695) for immediate processing EPS Consultants Pte Ltd|95C5630

Job Summary

  • As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product
  • Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience
  • You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients

Matching Summary

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience. You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients. Job Duties: Build and operate backend systems that serve AI-powered features in production. Design inference pipelines, orchestration layers, and service boundaries around models. Own production concerns: monitoring, logging, alerting, and incident response. Optimize latency and throughput across inference, caching, batching, and streaming. Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput. Ensure APIs are stable, clear, and support seamless integration with frontend and ML systems. Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact. Iterative improvements based on real usage continuously increase system performance and reliability. Technical Experience/Requirements: Python NodeJs Pytorch OpenAI / Anthropic / open-source LLMs Kubernetes Docker Strong backend engineering fundamentals in production environments. Experience running high-throughput, low-latency services. Familiarity with AI inference patterns (LLMs, embeddings, multimodal). Comfortable debugging distributed systems under load. Bias toward shipping and learning from production behavior. Interested candidates may apply directly to Patrina@eps.com.sg (Reg ID: R1103695) for immediate processing EPS Consultants Pte Ltd|95C5630

Salary

SGD 5,500 - 9,000 / Monthly

Skills & Requirements

Must-have

  • Model Serving
  • Kubernetes
  • Caché
  • Node.js
  • Open Source

Nice-to-have

  • Production Processes
  • Logging
  • PyTorch
  • Low Latency
  • LLMs
  • Python
  • Continuous Improvement Systems
  • Docker
  • Back End Infrastructure
  • Production Environment
  • Backend Development

Key Requirements

  • Minimum 3 years experience

Work Rights

Tailored Resume

Cover Letter