Senior Associate | Testing Automation | Pune | Engineering as a Service/ Operate

Deloitte

3+ yrs Pune Full Time Hybrid (office + remote)
Deloitte logo
Posted : yesterday
Actively hiring

Job description

Seeking a meticulous QA Engineer to ensure the quality, performance, reliability, and compliance of solutions built on Microsoft Power Platform and Copilot Studio. This role involves leading test planning and execution for low-code applications, automated workflows, APIs, and conversational AI. You will collaborate with developers, data engineers, data scientists, and business stakeholders to deliver robust solutions.

Key responsibilities include defining QA strategies, creating and executing comprehensive test plans and scripts across the SDLC. You will perform various types of testing, including functional, integration, and end-to-end, ensuring traceability from requirements to defects. Specific focus will be on validating Dataverse, Power Automate flows, security roles, and data integrity. Designing and executing conversation test scenarios for AI bots, including performance and load testing for workflows and APIs, is also crucial. Defect management using tools like Azure DevOps or Jira, and clear communication of test status to stakeholders are essential components of this role.

You will also contribute to establishing QA best practices and developing reusable test assets and automation frameworks. This position requires experience with API testing using tools like Postman, and performance testing with JMeter. The ability to validate AI/ML outputs and work closely with data teams on statistical checks is highly valued. Developing and maintaining automation scripts for API testing, regression suites, and chatbot validation is a key expectation.

Responsibilities

Define and maintain QA strategy, test approach, and coverage for Power Platform and Copilot Studio solutions. Create, review, and execute test plans, test cases, and test scripts across SDLC phases. Perform functional, smoke, regression, integration, and end-to-end testing. Ensure traceability between requirements, test cases, defects, and releases. Validate Dataverse/Databricks tables/entities, Power Automate flows, relationships, security roles, and data integrity rules. Design and execute conversation test scenarios for multi-turn context, ambiguity handling, and error recovery. Perform regression testing for AI bot behavior changes due to configuration updates, connector changes, or model/version updates. Perform API testing for REST services, Azure ML endpoints, and custom integrations using tools such as Postman/JMeter. Test data integrations and pipelines involving Azure Databricks, Azure Storage, and Dataverse. Plan and execute performance and load tests for workflows and APIs. Use JMeter to simulate real-world traffic patterns and produce performance reports. Identify, document, and track defects using Azure DevOps, Jira, or equivalent tools. Communicate test status, risks, and release readiness to stakeholders. Collaborate with developers, data scientists, and product owners to clarify acceptance criteria and non-functional requirements. Contribute to QA best practices, reusable test assets, and automation frameworks.

Qualifications

Requires 3+ years of QA/testing experience, with at least 1-2 years focused on Microsoft Power Platform solutions. Possess hands-on experience testing Power Automate workflows and data-centric applications. Demonstrate working knowledge of Dataverse, connectors/custom connectors, Azure Databricks, and Azure Storage. Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling. Strong understanding of core software testing principles such as test design, execution, defect lifecycle, and reporting. Experience with API testing (REST) using Postman and/or scripted validation (Python preferred). Hands-on performance testing experience using JMeter or LoadRunner, including analysis and reporting. Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior. Possess a basic understanding of designing prompts and edge cases to evaluate AI agent behavior. Experience developing and maintaining automation scripts for API testing, regression test suites, and chat flow validation. Skilled in building automated validation for chatbot responses using pattern matching, similarity scoring, and semantic validation where applicable.

Essential Skills

Microsoft Power PlatformCopilot StudioData Science SolutionsPower AutomateDataverseAzure DatabricksAzure StorageAPI TestingPostmanJMeterAzure DevOpsSeleniumPythonFunctional TestingRegression TestingIntegration TestingEnd-to-End TestingConversational AI TestingPerformance TestingLoad TestingDefect TrackingTest PlanningTest Execution

Good to Have

Microsoft Certifications (Power PlatformData Analytics/AI)Cloud-based testing environments (Azure)Accessibility TestingUsability TestingSecurity TestingCI/CD pipelinesAgile/ScrumRAI principlesLLM-based systemsPrompt engineeringRAG architectureMulti-agent workflows

Highlights

  • Actively hiring

More Details

RoleSenior Associate | Testing Automation | Pune | Engineering as a Service/ Operate
IndustryEngineering as a Service, Operate
DepartmentQA Engineer, Testing Automation
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Engineering as a Service

Senior Associate | Testing Automation | Pune | Engineering as a Service/ Operate at Deloitte | SkillMX | SkillMX