In_senior Associate_ Llm Observability Engineer_application Technology_advisory_pan India
Pwpoland
Llm observability platforms and tools
Performance testing methodologies and tools
Programming in python or java
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities
Job Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
This role involves designing and executing performance tests, implementing LLM observability, monitoring metrics, troubleshooting production issues, and collaborating with cross-functional teams.
PwC offers inclusive benefits, flexibility programmes, mentorship, and a zero-tolerance policy for discrimination to support your growth and wellbeing.
Matching Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
Skills & Requirements
Must-have
LLM observability platforms and tools
Performance testing methodologies and tools
Programming in Python or Java
Troubleshooting LLM production issues
Monitoring and analyzing LLM metrics
Design and execution of performance tests
Nice-to-have
Relevant certifications in LLM observability
Experience with AppDynamics and DataDog
Strong analytical and communication skills
Collaboration with data scientists and ML engineers
Cost optimization of LLM applications
Automated quality checks for model output
Key Requirements
3+ to 7 years experience
B.E. / B.Tech / MCA / M.E / M.TECH / MBA / PGDM full-time degrees
Relevant LLM observability & performance test certifications preferred