Gen AI QA

Persistent

6+ yrs Bengaluru Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join Persistent as a Gen AI QA professional, instrumental in ensuring the quality, reliability, and correctness of advanced AI-enabled applications. This role is pivotal in validating Large Language Model (LLM) outputs, rigorous testing of AI workflows, and the automation of quality assurance processes. You will be key in ensuring AI systems perform accurately throughout the entire software development lifecycle, contributing to cutting-edge AI solutions.

Responsibilities

Design and validate AI-enabled applications, focusing on robust data validation for AI systems. You will be responsible for testing LLM outputs and assessing AI behavior changes across different prompt versions. Automate both functional and non-functional tests, ensuring seamless AI integrations, APIs, and workflows. Perform comprehensive regression testing for AI model and version updates, collaborating closely with developers on defining and meeting quality gates.

Qualifications

Possess expertise in application testing, encompassing both manual and automated approaches, with proficiency in Python. Experience with CI/CD pipelines and quality gates is essential. Deep knowledge of AI-specific testing is required, including validating LLM outputs and understanding prompt behavior. Familiarity with model variability, non-determinism, and effective test data management for AI is crucial. A solid understanding of responsible AI testing concepts and 5-6 years of hands-on software testing experience, including direct AI testing experience, is expected.

Essential Skills

GenAI AgentsTesting throughout the software life cycleApplication testingPythonCI/CDTesting LLM outputsPrompt behavior testingModel variability understandingNon-determinism testingTest data management for AIResponsible AI testing conceptsAI testing

Highlights

  • Actively hiring

More Details

RoleGen AI QA
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Gen AI QA at Persistent | SkillMX | SkillMX