In_senior Associate_ llm Observability engineer_application Technology_advisory_pan India
Pwpoland
Llm observability platforms and tools
Performance testing methodologies
Load testing tools such as jmeter
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities
Job Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
This role is crucial for ensuring our large language model systems are performant, reliable, and cost-effective in real-world scenarios by combining robust performance engineering practices with specialized LLM observability techniques.
We help build software and design data platforms, manage large volumes of client data, develop compliance procedures for data management, and continually research new technologies to drive innovation and sustainable change.
Matching Summary
At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities.
Skills & Requirements
Must-have
LLM observability platforms and tools
Performance testing methodologies
Load testing tools such as JMeter
Programming in Python and Java
Troubleshooting production issues
Monitoring and analyzing KPIs
Nice-to-have
Relevant LLM observability certifications
Experience with AppDynamics and DataDog
Strong analytical and communication skills
Collaboration with data scientists and ML engineers
Embracing change and learning agility
Performance assessment and management
Key Requirements
3+ to 7 years experience
B.E. / B.Tech / MCA / M.E / M.TECH / MBA / PGDM full-time degrees
Relevant certifications in LLM observability and performance testing
Familiarity with LLM challenges like hallucinations and prompt sensitivity