Associate Director, Generative Ai Evaluation & Standards
Johnson & Johnson
Cornellà de Llobregat, Spain
On-site
Generative ai evaluation frameworks
Llm quality and rag performance
Scientific accuracy and regulatory compliance
Johnson & Johnson is seeking an Associate Director for Generative AI Evaluation & Standards to lead the evaluation and governance of AI systems in a regulated pharmaceutical R&D environment. The ideal candidate should possess extensive experience in AI evaluation, strong leadership skills, and a background in related fields such as data science or computational biology
Job Summary
Design and maintain evaluation frameworks for GenAI solutions spanning LLM quality, RAG performance, agent reliability, safety, and scientific accuracy.
Serve as technical lead for the Evaluation & Standards Board, a cross-functional governance body for GenAI quality.
Build and lead the GenAI Evaluation & Standards team, attracting, developing, and retaining top talent.
Matching Summary
Match Score: 85
Johnson & Johnson is seeking an Associate Director for Generative AI Evaluation & Standards to lead the evaluation and governance of AI systems in a regulated pharmaceutical R&D environment. The ideal candidate should possess extensive experience in AI evaluation, strong leadership skills, and a background in related fields such as data science or computational biology.
Skills & Requirements
Must-have
Generative AI evaluation frameworks
LLM quality and RAG performance
Scientific accuracy and regulatory compliance
AI/ML evaluation in regulated environments
Leading technical teams in matrixed organizations
Nice-to-have
Domain expertise in oncology, immunology, or neuroscience
Influencing build-versus-buy decisions
Evaluating multi-modal AI systems
Familiarity with enterprise data standards
Key Requirements
Advanced degree (PhD strongly preferred)
Minimum 8 years of post-academic industry experience
Hands-on expertise with generative AI systems
Demonstrated track record designing evaluation frameworks