Test Lead  - AI Assurance

Hexaware

8+ yrs India Full Time Hybrid (office + remote)
Hexaware logo
Posted : today
Actively hiring

Job description

Seeking an experienced Test Lead specializing in AI Assurance to drive quality for cutting-edge AI initiatives. This role demands a strong background in test automation and a deep understanding of AI-specific testing challenges.

Ideal candidates will contribute to building robust testing frameworks and ensure the reliability and accuracy of AI models and systems. A passion for innovation and a customer-centric approach are key to success in this dynamic environment.

Responsibilities

Develop and execute comprehensive test strategies for AI-driven applications, focusing on robustness and output validation. Design and implement scalable automation frameworks for UI, API, functional, and backend testing. Conduct specialized testing for RAG frameworks, evaluating retrieval and generation accuracy. Validate Agentic AI workflows, including multi-agent reasoning and orchestration. Explore and leverage AI capabilities for automated test case generation and defect prediction. Collaborate with cross-functional teams in an Agile, CI/CD environment using Azure DevOps. Monitor and report on key quality KPIs and metrics to ensure project success.

Qualifications

A minimum of 8 years in QA/testing is required, with substantial hands-on experience in Selenium or Playwright and programming languages like Python, Java, or TypeScript. Proven experience in creating scalable automation frameworks for UI, API, functional, and backend testing. Demonstrated expertise in AI testing, including model evaluation, robustness checks, and output validation using tools like DeepEval. Familiarity with testing RAG frameworks and Agentic AI validation, encompassing multi-agent reasoning and orchestration. Ability to apply AI for test case generation, predictive analysis, and defect identification is highly valued. Solid understanding of testing principles, Agile methodologies, CI/CD pipelines, Azure DevOps, and defect management processes. Exceptional analytical, problem-solving, and communication skills are essential for effective collaboration within global, cross-cultural teams. Adaptability and a self-driven attitude are crucial.

Essential Skills

SeleniumPlaywrightPythonJavaTypeScriptUI AutomationAPI AutomationBackend AutomationAI TestingDeepEvalModel EvaluationRAG FrameworksAgentic AICI/CDAzure DevOpsAgile

Good to Have

Test Case GenerationPredictive InsightsDefect Detection

Highlights

  • Actively hiring

More Details

RoleTest Lead  - AI Assurance
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Hexaware Technologies logo

Hexaware Technologies

IT Consulting