Join YouTube Global Vendor Operations as a Quality Lead, driving exceptional vendor performance. This role is pivotal in shaping the quality of experiences for YouTube's global users, creators, and partners.

As a Quality Lead, you will be instrumental in developing and implementing robust quality assurance frameworks. Your work will directly contribute to the continuous improvement of our AI models and the overall operational excellence of our vendor network.

This is an opportunity to work on complex, impactful projects within a dynamic and innovative environment, ensuring that YouTube continues to deliver outstanding content and services worldwide.

Develop and implement comprehensive Quality Lead (QA) Frameworks aligned with key business objectives. Continuously monitor AI QA model performance and accuracy, utilizing metrics such as Precision, Recall, and Human Inter-rater Agreement.

Manage the seamless ingestion of human-validated Golden Labeling from manual overrides, crucial for high-fidelity model retraining. Implement rigorous blind review protocols and advanced multi-tiered human + AI arbitration to effectively prevent Automation Bias.

Design and deploy sophisticated stratified sampling methodologies. This ensures that high-risk or ambiguous interactions, particularly those with low AI confidence, are prioritized for thorough human review.

A Bachelor's degree or equivalent practical experience is required. Possess at least 5 years of experience in identifying process issues or collaborating effectively with cross-functional teams. Also, bring a minimum of 5 years of hands-on experience with contact center metrics and established QA methodologies.

Preferred qualifications include experience with LLM-based evaluation frameworks and prompt engineering. Familiarity with stratified sampling techniques for focused human validation is advantageous. Experience with QA automation and sampling tools is also beneficial.