Seeking a Senior AI Test Engineer to spearhead testing for cutting-edge AI-enabled applications. This role involves developing and executing comprehensive test strategies for Generative AI, LLM, RAG, and AI Agent technologies.

Join a dynamic team focused on ensuring the quality, accuracy, and responsible deployment of AI solutions. You will play a crucial part in validating AI model performance and compliance.

- Design and implement end-to-end test strategies for AI applications. - Create and execute test plans for Generative AI, LLM, RAG, and AI Agent workflows. - Conduct various testing types including functional, integration, regression, system, and UAT. - Validate AI model responses for accuracy, relevance, consistency, bias, and toxicity. - Test prompt engineering scenarios and optimize prompt quality. - Verify RAG pipelines and vector search accuracy. - Ensure compliance with AI guardrails and responsible AI principles.

- Define and execute comprehensive test strategies for AI-driven systems. - Execute functional, integration, regression, and system tests. - Validate API functionality using tools like Postman, Swagger, or REST Assured. - Develop and maintain robust API automation frameworks. - Assess AI model outputs for accuracy, relevance, consistency, hallucinations, bias, and toxicity. - Test prompt engineering and RAG pipeline effectiveness. - Perform database validation using SQL and conduct performance/load testing. - Collaborate effectively with cross-functional teams including Product Owners, Architects, Data Scientists, ML Engineers, and Developers.