Llm Quality Engineer

AECOM Australia PTY LTD

Oslo, Norway
On-site
Python programming skills
Llm prompt evaluation experience
Pytest or similar test frameworks
AECOM is seeking an LLM Quality Engineer to join their AI Engineering team in Oslo, Norway. This role focuses on ensuring the quality and reliability of AI-driven systems, making it ideal for detail-oriented individuals who are passionate about AI and software quality

Job Summary

  • This role sits at the intersection of testing, AI evaluation, and operational quality within AECOM's AI Engineering team.
  • You will take ownership of quality across AI systems to reduce regressions and improve reliability in real-world scenarios.
  • The position is ideal for a recent graduate or detail-oriented professional seeking end-to-end ownership early in their career.

Matching Summary

Match Score: 85

AECOM is seeking an LLM Quality Engineer to join their AI Engineering team in Oslo, Norway. This role focuses on ensuring the quality and reliability of AI-driven systems, making it ideal for detail-oriented individuals who are passionate about AI and software quality.

Skills & Requirements

Must-have

  • Python programming skills
  • LLM prompt evaluation experience
  • pytest or similar test frameworks
  • CI/CD pipeline understanding
  • API interaction capabilities

Nice-to-have

  • Interest in data quality monitoring
  • Experience with academic projects
  • Team-based project environment
  • Curiosity about AI system behavior

Key Requirements

  • Degree in computer science or related field
  • Exposure to LLMs or AI systems
  • Strong attention to detail

Work Rights

Not specified

Tailored Resume

Cover Letter