Join Deloitte's Technology & Transformation practice as a Manager in Automation Testing, based in Mumbai. This role is integral to our Quality Engineering efforts, focusing on innovative data solutions and cutting-edge technologies. We leverage strategic guidance and implementation services to help companies manage data, convert it into actionable insights, and gain a competitive edge through business intelligence, data management, and advanced analytics.

This position offers a unique opportunity to be at the forefront of developing and implementing sophisticated data strategies for our clients.

Take ownership of the end-to-end test strategy, including the automation roadmap, quality gates, and release readiness criteria. Design, develop, and maintain robust automation frameworks utilizing Playwright with Python and Behavior-Driven Development (BDD) with Behave. Automate various testing types, including UI, API, integration, regression, and end-to-end scenarios. Support User Acceptance Testing (UAT) automation and maintain existing regression suites. Crucially, validate AI/LLM systems for accuracy, relevance, bias, safety, and context retention, while also testing for prompt injection and edge cases. Build LLM evaluation frameworks, benchmark datasets, and integrate automated tests into CI/CD pipelines for continuous quality assurance. Conduct basic performance testing and debug issues efficiently using logs and backend monitoring. Define quality dashboards and ensure traceability and auditability. Mentor QA engineers and foster strong collaboration across Product, Engineering, Data Science, Security, DevOps, and business teams.

A seasoned Quality Engineering professional with over 9 years of experience in test automation is sought. Essential expertise includes strong hands-on proficiency with Playwright and Python, alongside experience in building scalable automation frameworks using Python, Pytest, and Behave. Prior experience testing AI, Generative AI, or LLM-powered applications is a must. Robust API testing capabilities are required, leveraging tools like Playwright, Postman, Requests, or equivalents. Familiarity with BDD, Git, CI/CD, and Agile methodologies is expected. A solid understanding of AI evaluation, prompt testing, RAG validation, hallucination testing, and Responsible AI principles is vital. Excellent problem-solving, mentoring, communication, and stakeholder management skills are prerequisites for this role. A Bachelor’s degree in Computer Science, Information Technology, or a related field is required.