Lead Senior Associate | Testing Automation | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)

Deloitte

6–9 yrs Bengaluru Full Time Hybrid (office + remote)
Deloitte logo
Posted : today
Actively hiring

Job description

Join our engineering team as a QA Engineer specializing in Functional and Automation testing for cutting-edge solutions built on Microsoft Power Platform and Copilot Studio. This hybrid role in Bengaluru focuses on ensuring the quality, performance, reliability, and compliance of low-code applications, intricate data integrations, and AI/ML-driven features. You will be instrumental in leading test planning and execution across various components, including automated workflows, APIs, custom connectors, and conversational AI, fostering close collaboration with developers, data scientists, and business stakeholders.

Responsibilities

Define and uphold the QA strategy, test approach, and coverage for Power Platform and Copilot Studio solutions. Create, review, and execute comprehensive test plans, test cases, and test scripts throughout the Software Development Life Cycle. Conduct thorough functional, smoke, regression, integration, and end-to-end testing to identify and address defects. Ensure robust traceability between requirements, test cases, identified defects, and release milestones. Validate data integrity within Dataverse/Databricks tables/entities, Power Automate flows, relationships, and security roles. Design and execute sophisticated conversation test scenarios to evaluate multi-turn context, ambiguity handling, and error recovery mechanisms. Perform regression testing to assess AI bot behavior changes resulting from configuration updates, connector modifications, or model/version upgrades. Conduct API testing for REST services, Azure ML endpoints, and custom integrations using tools like Postman or JMeter. Test complex data integrations and pipelines involving Azure Databricks, Azure Storage, and Dataverse. Plan and execute performance and load tests for workflows and APIs, utilizing JMeter to simulate real-world traffic and generate detailed performance reports. Identify, document, and meticulously track defects using tools such as Azure DevOps or Jira. Communicate test status, potential risks, and release readiness effectively to all stakeholders. Collaborate closely with developers, data scientists, and product owners to clarify acceptance criteria and non-functional requirements. Contribute to the continuous improvement of QA best practices, reusable test assets, and automation frameworks.

Qualifications

A Bachelor's degree in a relevant field (BE, B.Tech, BCA, BSC) or a Master's degree (MCA, MSC) is required, alongside a minimum of 6 to 9 years of professional QA and testing experience. A significant portion of this experience, specifically 1-2 years, must involve testing Microsoft Power Platform solutions. Candidates should possess hands-on experience testing Power Automate workflows and data-centric applications, coupled with a solid working knowledge of Dataverse, connectors/custom connectors, Azure Databricks, and Azure Storage. Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling, is essential.

A strong understanding of core software testing principles, encompassing test design, execution, defect lifecycle management, and reporting, is crucial. Experience with API testing (REST) using tools like Postman, or scripted validation (Python preferred), is also required. Proven hands-on experience in performance testing using JMeter or LoadRunner, including analysis and reporting, is a key requirement. The ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior is expected, along with a basic understanding of designing prompts and edge cases to evaluate AI agent behavior.

Develop and maintain automation scripts for API testing, regression test suites, and chat flow validation. Build automated validation for chatbot responses using pattern matching, similarity scoring, and semantic validation where applicable. Preferred qualifications include Microsoft Certifications in Power Platform or Data Analytics/AI, experience in cloud-based testing environments (Azure preferred), knowledge of accessibility, usability, and security testing, exposure to CI/CD pipelines, and Agile/Scrum project experience with Azure DevOps pipelines.

Essential Skills

Power PlatformCopilot StudioData ScienceData IntegrationsAI/MLLow-code ApplicationsAutomated WorkflowsAPIsCustom ConnectorsConversational AIQA StrategyTest PlanningTest ExecutionTest CasesTest ScriptsSDLCFunctional TestingSmoke TestingRegression TestingIntegration TestingEnd-to-End TestingRequirements TraceabilityDefect TrackingRelease ManagementDataverseDatabricksPower AutomateSecurity RolesData IntegrityConversation TestingAmbiguity HandlingError RecoveryAPI TestingREST ServicesAzure ML EndpointsPostmanJMeterAzure DatabricksAzure StoragePerformance TestingLoad TestingAzure DevOpsJiraCI/CDAgile/ScrumPythonSeleniumNLUMulti-turn FlowsFallback HandlingSoftware Testing PrinciplesTest DesignDefect LifecycleReportingPrompt EngineeringRAG ArchitectureMulti-agent Workflows

Good to Have

Microsoft CertificationsPower Platform CertificationsData Analytics CertificationsAI CertificationsCloud-based TestingAzureAccessibility TestingUsability TestingSecurity TestingRAI PrinciplesLLM-based Systems

Highlights

  • Actively hiring

More Details

RoleLead Senior Associate | Testing Automation | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)
DepartmentQuality Assurance
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

IT Consulting

Lead Senior Associate | Testing Automation | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN) at Deloitte | SkillMX | SkillMX