Join our team as a skilled QA Engineer focusing on functional and automation testing for innovative solutions built on Microsoft Power Platform and Copilot Studio. This role is crucial for ensuring the quality, performance, and reliability of our low-code applications, integrated data, and AI/ML features. You will drive test planning and execution, collaborating closely with developers, data engineers, and business stakeholders to deliver exceptional results.

We are seeking a meticulous professional to validate solutions involving complex data integrations and cutting-edge AI/ML capabilities. Your expertise will be key in testing a wide range of components, including automated workflows, custom APIs, and conversational AI interfaces, ensuring seamless integration and user experience.

Develop and maintain comprehensive QA strategies, test approaches, and coverage plans for Power Platform and Copilot Studio solutions. Create, review, and execute detailed test plans, test cases, and scripts throughout the software development lifecycle. Conduct thorough functional, smoke, regression, integration, and end-to-end testing. Ensure robust traceability between requirements, test cases, identified defects, and final releases.

Validate critical components such as Dataverse tables/entities, Power Automate flows, security roles, and data integrity. Design and execute intricate conversation test scenarios to evaluate multi-turn context handling, ambiguity resolution, and error recovery. Perform regression testing to assess the impact of configuration updates, connector changes, or model versioning on AI bot behavior.

Execute API testing for REST services and Azure ML endpoints using tools like Postman/JMeter. Test complex data integrations and pipelines involving Azure Databricks, Azure Storage, and Dataverse. Plan and conduct performance and load tests for workflows and APIs, utilizing JMeter for traffic simulation and performance reporting. Identify, document, and track defects using Azure DevOps or Jira, and communicate test status, risks, and release readiness to stakeholders. Collaborate with cross-functional teams to clarify acceptance criteria and non-functional requirements, contributing to QA best practices and reusable automation frameworks.

A minimum of 9 years of overall QA experience is required, with at least 1-2 years specifically focused on testing Microsoft Power Platform solutions. You should possess hands-on experience testing Power Automate workflows and data-intensive applications. A solid working knowledge of Dataverse, connectors, Azure Databricks, and Azure Storage is essential.

Familiarity with Copilot Studio or advanced chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling, is expected. You will need a strong understanding of software testing principles, including test design, execution, defect lifecycle management, and reporting. Experience with API testing (REST) using Postman or scripted validation (Python preferred) is required.

Demonstrated hands-on performance testing experience with JMeter or LoadRunner, including analysis and reporting, is crucial. The ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior is also necessary. A basic understanding of prompt design and edge case evaluation for AI agent behavior is beneficial. Development and maintenance of automation scripts for API testing, regression suites, and chat flow validation are key responsibilities. Building automated validation for chatbot responses using pattern matching, similarity scoring, and semantic validation is also expected.