Manager | Microsoft Azure | Kolkata | Engineering | Data Modernization & Migration (Bengaluru, IN)

Deloitte

3+ yrs Kolkata, Bengaluru, Pune, Mumbai, New Delhi, Coimbatore, Hyderabad Full Time Hybrid (office + remote)
Deloitte logo
Posted : today
Actively hiring

Job description

Join Deloitte's Technology & Transformation practice and become a key player in our data modernization initiatives. We're looking for skilled Azure Databricks Data Engineers to design, develop, and maintain sophisticated data solutions on the Databricks platform. This role is crucial for empowering clients with actionable insights derived from their data, driving informed decision-making across various industries.

Our practice excels in leveraging vast datasets to generate strategic advantages. We offer expertise in business intelligence, data management, performance management, and cutting-edge analytics technologies like big data, cloud, and machine learning. As part of our team, you'll contribute to transforming how organizations utilize their data.

Responsibilities

Design and implement scalable, secure, and high-performance data architectures within the Azure ecosystem. Develop and optimize robust ETL/ELT data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Build efficient data ingestion, transformation, and storage solutions leveraging Azure Data Lake, Azure SQL, and Azure Synapse. Create batch and real-time data processing solutions utilizing Azure services like Delta Live Tables, Event Hubs, Stream Analytics, and Azure Functions. Implement data models, schemas, and performance-optimized queries. Manage structured, semi-structured, and unstructured data sources effectively. Ensure adherence to data quality, governance, and security standards in all implemented solutions. Deploy data solutions seamlessly using Azure DevOps CI/CD pipelines. Collaborate closely with data scientists, analysts, and business users to support data-driven strategies. Troubleshoot and enhance data workflows for optimal scalability and performance. Ensure all data solutions are cost-efficient, scalable, and secure on Azure. Integrate logging, monitoring, and alerting mechanisms using Azure Monitor and Log Analytics.

Qualifications

We are seeking experienced Azure Databricks Data Engineers with a minimum of 3 years of experience. Proficiency in core technologies including Databricks, PySpark, SQL, Azure Functions, Azure Data Factory (ADF), and Logic Apps is essential. Strong command over ELT/ETL processes, Data Integration & Ingestion, Data Manipulation and Processing, GitHub, and Azure DevOps is required. Familiarity with Synapse and Data Modeling is considered a plus. Experience in project management and running a scrum team is beneficial. Demonstrated experience working with external technical ecosystems is advantageous. A Bachelor's degree or higher in a relevant field such as B.Tech, BE, MBA, BSc, or MSc is required. Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect) and Databricks certification are highly preferred. Experience developing and deploying solutions on cloud infrastructure is a must.

Essential Skills

DatabricksPySparkSQLAzure FunctionsAzure Data FactoryLogic AppsELTETLData IntegrationData IngestionData ManipulationData ProcessingGitHubAzure DevOpsPythonAzure Data LakeAzure SQLAzure Synapse AnalyticsDelta Live TablesEvent HubsStream AnalyticsAzure Key VaultSQL ServerRDBMSMicrosoft FabricAzure MonitorLog Analytics

Good to Have

SynapseData ModelingScrum MasterAgile MethodologyStakeholder ManagementMentoringTechnical DirectionDesign ReviewsAzure CertificationsDatabricks Certification

Highlights

  • Actively hiring

More Details

RoleManager | Microsoft Azure | Kolkata | Engineering | Data Modernization & Migration (Bengaluru, IN)
IndustryManagement Consulting
DepartmentData Engineering, Project Management
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Management Consulting

Manager | Microsoft Azure | Kolkata | Engineering | Data Modernization & Migration (Bengaluru, IN) at Deloitte | SkillMX | SkillMX