EY is seeking a dedicated QE AI Test Lead to join our Global Delivery Services team. In this role, you will be instrumental in validating advanced AI systems, including Narrow AI, Generative AI, and Agentic AI. Your expertise will ensure the integrity and performance of these critical technologies.

This position offers a unique opportunity to contribute to EY's growth agenda by providing high-skilled and innovative services. You will collaborate with data scientists and cross-functional teams, playing a vital part in delivering exceptional client service through cutting-edge AI solutions.

As the QE AI Test Lead, you will define and execute comprehensive test strategies for AI-based systems, ensuring thorough functional, performance, and statistical validation.

You will conduct in-depth data validation, including collection, augmentation, exploratory analysis, and bias detection, while rigorously assessing privacy and compliance. A key part of your role will involve identifying and resolving discrepancies and risks in model outputs, alongside leading defect management and reporting activities.

Furthermore, you will engage with stakeholders to provide status updates, resolve issues, and drive delivery excellence across globally distributed teams.

We are looking for professionals with a strong grasp of AI/ML principles, LLMs, and Agentic AI systems, complemented by hands-on experience in AI testing techniques such as bias, drift, metamorphic, and back-to-back testing.

Proficiency in test automation tools like Selenium, Playwright, and PyTest, along with expertise in Python programming and AI evaluation frameworks, is essential. Familiarity with AI-assisted development tools like GitHub Copilot and cloud platforms (Azure, AWS, GCP) is highly desirable.

Exceptional analytical, problem-solving, and communication skills are crucial. Experience working within Agile environments will be a significant asset in this dynamic role.