The role focuses on designing and building AI agents that combine LLMs with deterministic tooling for specific departmental needs like ADaM code generation
Job Summary
The role focuses on designing and building AI agents that combine LLMs with deterministic tooling for specific departmental needs like ADaM code generation.
Candidates must establish robust evaluation frameworks including automated tests and human-in-the-loop reviews to ensure compliance and reliability.
Close collaboration with statisticians and platform engineers is required to align agent behavior with regulatory expectations and real user needs.
Matching Summary
The role focuses on designing and building AI agents that combine LLMs with deterministic tooling for specific departmental needs like ADaM code generation.
Skills & Requirements
Must-have
Python programming skills
LLM and NLP application development
Prompt engineering and RAG techniques
Evaluation framework design
Vector databases and embeddings
MLOps for generative AI
Nice-to-have
Experience with GxP and CSV regulations
Knowledge of statistical programming
Familiarity with SAP generation workflows
Model optimization and quantization
Collaboration in regulated environments
Key Requirements
Master's degree in Computer Science or related field
3-5 years experience in AI/ML or NLP applications
Production-grade system experience with large language models
Experience integrating LLMs with code generation workflows