Test Manager (IN)
HCLTech
HCLTech
We are seeking a skilled Vision AI QA Engineer to ensure the quality of AI-powered platforms. This role involves designing, validating, and automating tests for computer vision, machine learning, and GenAI/RAG applications. You will leverage your expertise in AI system behavior and quality engineering to guarantee accuracy, reliability, performance, security, and production readiness throughout the AI solution lifecycle. The position demands the development of comprehensive test strategies, validation of AI outcomes, and automation of testing frameworks for seamless, high-quality releases of Vision AI products.
Take ownership of end-to-end quality assurance for Vision AI platforms, covering UI, APIs, workflows, integrations, AI models, and production releases. Develop and implement robust test strategies, plans, regression suites, quality metrics, and release gates. Execute diverse testing types including functional, integration, regression, exploratory, system, and user acceptance testing. Build and maintain automated test frameworks for UI, API, and backend services using Python, Selenium, and specialized AI testing tools. Integrate automated testing into CI/CD pipelines for efficient validation. Validate computer vision models and pipelines, including image/video ingestion, object detection, classification, tracking, and event/alert generation. Design, curate, and maintain test datasets and benchmark scenarios for evaluating model accuracy, performance, and robustness. Conduct AI model validation and regression testing using performance metrics and real-world datasets. Verify the reliability and consistency of GenAI capabilities, including prompt workflows and reasoning. Perform performance, scalability, and reliability testing for real-time Vision AI services. Lead security testing activities, including vulnerability assessment and adversarial testing for AI applications. Drive defect triage, root-cause analysis, and continuous improvement initiatives. Ensure Vision AI solutions meet all quality, security, compliance, and production-readiness standards prior to release.
Possess a strong foundation in Quality Assurance principles, encompassing test strategy, planning, design, defect management, and root-cause analysis. Demonstrate hands-on experience in test automation using Python and frameworks like Selenium or Cypress. Proven experience testing web applications, APIs, and microservices, including REST API validation and authentication workflows using tools such as Postman. Solid understanding of databases and SQL for data validation across application and AI workflows. Experience integrating automated test suites into CI/CD pipelines is essential. Exhibit a strong understanding of AI/ML systems and methodologies for validating model accuracy, reliability, and performance. Expertise in testing GenAI and LLM-based applications, including prompt engineering, multi-turn conversations, tool/function calling, and response evaluation. Familiarity with hallucination detection, grounding validation, response quality assessment, and safety testing for AI applications is crucial. Knowledge of computer vision solutions and video analytics, including validation of object detection, classification, tracking, and key AI performance metrics. Experience designing and executing security testing using tools and methodologies like OWASP ZAP. Hands-on experience with performance, scalability, and load testing using tools such as JMeter. Familiarity with cloud-native applications, containerized environments, and modern DevOps practices is preferred. Strong analytical, troubleshooting, communication, and stakeholder collaboration skills are required.
HCLTech
IT Consulting