We are seeking a detail-oriented QA Engineer to ensure the quality, performance, and reliability of solutions built on Microsoft Power Platform and Copilot Studio. This role focuses on testing low-code applications, automated workflows, APIs, and conversational AI experiences. You will collaborate closely with development teams, data engineers, and business stakeholders to deliver robust and compliant solutions.

This position involves leading test planning and execution across the software development lifecycle. You will be responsible for validating data integrations, AI/ML features, and ensuring seamless operation of complex systems. The ideal candidate will have a strong understanding of testing methodologies and a passion for delivering high-quality software.

Define and maintain the QA strategy, test approach, and coverage for Power Platform and Copilot Studio solutions. Create, review, and execute comprehensive test plans, test cases, and test scripts throughout the SDLC. Perform various types of testing, including functional, smoke, regression, integration, and end-to-end testing. Ensure robust traceability between requirements, test cases, identified defects, and released software versions. Validate Dataverse/Databricks entities, Power Automate flows, relationships, security roles, and data integrity rules meticulously. Design and execute detailed conversation test scenarios to assess multi-turn context, ambiguity handling, and error recovery mechanisms. Conduct regression testing to evaluate AI bot behavior changes resulting from configuration updates, connector modifications, or model/version upgrades. Perform API testing for REST services and Azure ML endpoints using tools like Postman and JMeter. Test data integrations and pipelines involving Azure Databricks, Azure Storage, and Dataverse. Plan and execute performance and load tests for workflows and APIs, utilizing JMeter for traffic simulation and reporting. Identify, document, and track defects using Azure DevOps, Jira, or similar platforms. Communicate test status, identified risks, and release readiness to all relevant stakeholders. Collaborate with developers, data scientists, and product owners to clarify acceptance criteria and non-functional requirements. Contribute to the enhancement of QA best practices, development of reusable test assets, and automation frameworks.

Possess at least 3 years of QA and testing experience, with a minimum of 1-2 years specifically focused on testing Microsoft Power Platform solutions. Demonstrate hands-on experience testing Power Automate workflows and data-centric applications. Possess working knowledge of Dataverse, connectors/custom connectors, Azure Databricks, and Azure Storage. Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling, is essential. Exhibit a strong understanding of fundamental software testing principles, covering test design, execution, defect lifecycle management, and reporting. Have experience with API testing (REST) using Postman and/or scripted validation, with Python proficiency being preferred. Provide hands-on experience in performance testing using JMeter or LoadRunner, including analysis and reporting capabilities. Demonstrate the ability to validate AI/ML outputs and collaborate effectively with data teams on statistical checks and model behavior analysis. Possess a basic understanding of designing prompts and identifying edge cases to evaluate AI agent behavior. Develop and maintain automation scripts for API testing, regression test suites, and chat flow validation. Build automated validation for chatbot responses using pattern matching, similarity scoring, and semantic validation techniques where applicable.