Test Lead - AI Assurance
Hexaware
Hexaware
Seeking an experienced Test Lead specializing in AI Assurance to drive quality for cutting-edge AI initiatives. This role demands a strong background in test automation and a deep understanding of AI-specific testing challenges.
Ideal candidates will contribute to building robust testing frameworks and ensure the reliability and accuracy of AI models and systems. A passion for innovation and a customer-centric approach are key to success in this dynamic environment.
Develop and execute comprehensive test strategies for AI-driven applications, focusing on robustness and output validation. Design and implement scalable automation frameworks for UI, API, functional, and backend testing. Conduct specialized testing for RAG frameworks, evaluating retrieval and generation accuracy. Validate Agentic AI workflows, including multi-agent reasoning and orchestration. Explore and leverage AI capabilities for automated test case generation and defect prediction. Collaborate with cross-functional teams in an Agile, CI/CD environment using Azure DevOps. Monitor and report on key quality KPIs and metrics to ensure project success.
A minimum of 8 years in QA/testing is required, with substantial hands-on experience in Selenium or Playwright and programming languages like Python, Java, or TypeScript. Proven experience in creating scalable automation frameworks for UI, API, functional, and backend testing. Demonstrated expertise in AI testing, including model evaluation, robustness checks, and output validation using tools like DeepEval. Familiarity with testing RAG frameworks and Agentic AI validation, encompassing multi-agent reasoning and orchestration. Ability to apply AI for test case generation, predictive analysis, and defect identification is highly valued. Solid understanding of testing principles, Agile methodologies, CI/CD pipelines, Azure DevOps, and defect management processes. Exceptional analytical, problem-solving, and communication skills are essential for effective collaboration within global, cross-cultural teams. Adaptability and a self-driven attitude are crucial.
Hexaware Technologies
IT Consulting