Gen AI QA
Persistent
Persistent
Join Persistent as a Gen AI QA professional, ensuring the quality, reliability, and correctness of cutting-edge AI-enabled applications. This role is pivotal in validating Large Language Model (LLM) outputs, meticulously testing AI workflows, and automating crucial quality processes.
You will be instrumental in guaranteeing that AI systems perform with accuracy throughout the entire software development lifecycle, contributing to the creation of robust and trustworthy AI solutions. This position offers the chance to work with advanced technologies and contribute to a company recognized for innovation and growth.
Design and meticulously validate AI-enabled applications, with a strong focus on data validation for these systems.
Key responsibilities include validating LLM outputs, thoroughly testing prompt versions, and assessing AI behavior changes.
You will automate functional and non-functional tests, rigorously test AI integrations, APIs, and workflows, and perform essential regression testing for AI model or version updates.
Collaboration with development teams on defining and enforcing quality gates is also a core aspect of this role, ensuring seamless integration and high standards.
Bring your expertise in application testing, encompassing both manual and automated approaches, alongside proficiency in Python.
A solid understanding of CI/CD pipelines and the implementation of quality gates is essential for this position.
Demonstrate expertise in testing LLM outputs and understanding prompt behavior, along with knowledge of model variability and non-determinism.
Experience with test data management for AI and familiarity with responsible AI testing concepts are highly valued. A minimum of 5-6 years in software testing, with hands-on AI testing experience, is required.
Persistent Systems
IT Consulting