Join the YouTube Global Vendor Operations team and play a pivotal role in shaping the future of vendor quality. This role is instrumental in developing and implementing robust QA frameworks that align with key business objectives, ensuring an exceptional experience for YouTube's consumers, creators, and partners.

The team is dedicated to tackling complex business challenges and driving continuous improvement in vendor performance. You'll be at the forefront of managing a global quality program, leveraging data and innovative methodologies to enhance operational excellence.

Design and implement comprehensive Quality Assurance (QA) frameworks, ensuring seamless integration with critical business outcomes. Continuously monitor the performance and accuracy of AI QA models, utilizing key metrics like Precision, Recall, and Human Inter-rater Agreement.

Manage the effective ingestion of human-validated Golden Labeling from manual overrides, directly contributing to high-fidelity model retraining. Implement sophisticated blind review protocols and multi-tiered human + AI arbitration to mitigate Automation Bias.

Develop and deploy stratified sampling methodologies, strategically prioritizing high-risk or ambiguous interactions for human review, optimizing resource allocation.

A Bachelor's degree or equivalent practical experience is required. You should possess at least 5 years of experience in identifying process issues or collaborating with cross-functional teams. Additionally, a minimum of 5 years of experience with contact center metrics and QA methodologies is essential.

Preferred qualifications include hands-on experience with LLM-based evaluation frameworks and prompt engineering. Familiarity with stratified sampling techniques for identifying specific interactions for human validation is highly valued, alongside experience with QA automation and sampling tools.