Enabling Areas - IT - Assistant Manager - Data Engineer (Mumbai, IN)

Deloitte

3+ yrs Mumbai Full Time Work from office
Deloitte logo
Posted : today
Actively hiring

Job description

Join our IT team as an Assistant Manager, Data Engineer, based in Mumbai. This role is pivotal in enhancing employee experience across Deloitte South Asia by managing and developing robust data solutions. You'll leverage your expertise in Azure, SQL Server, and Databricks to support critical analytics, reporting, and data science initiatives, ensuring the delivery of high-quality, performant data systems.

This position is essential for building and maintaining our application infrastructure, focusing on delivering reliable data services that empower our business units.

Responsibilities

Design, develop, and manage scalable ETL/ELT pipelines using Azure Data Factory and Databricks for both batch and real-time data processing. Integrate diverse data sources, including SQL Server, Azure SQL Database, ADLS, and external APIs. Construct and maintain data models, data marts, and data warehouses utilizing SQL Server and Azure Synapse Analytics. Write efficient SQL queries, stored procedures, views, and triggers, optimizing for performance within SQL Server. Process large datasets for transformation and analytics using Databricks with Spark (Python/Scala). Implement data quality, integrity, security, and compliance measures through validation, monitoring, and auditing. Collaborate closely with data analysts, data scientists, and business stakeholders to define and deliver data solutions. Set up and manage CI/CD pipelines via Azure DevOps for streamlined deployments. Monitor and optimize the performance of data pipelines and queries across Azure and SQL Server environments.

Qualifications

A Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field is required. Minimum of 3 years of experience in data engineering or a comparable role. Proficiency in Azure Data Services including Data Factory, ADLS, Azure SQL, and Azure Synapse. Hands-on experience with Databricks (Azure implementation) and Spark using Python or Scala. Expertise in Microsoft SQL Server, encompassing advanced SQL writing, stored procedures, and performance tuning. Solid understanding of data warehousing principles, ETL/ELT best practices, and data modeling techniques (star/snowflake schema). Familiarity with data governance, RBAC, and data security practices within the Azure ecosystem. Experience with CI/CD tools like Azure DevOps and version control systems such as Git. Exceptional problem-solving abilities and a strong aptitude for collaborative work in a dynamic environment.

Essential Skills

Azure Data FactoryDatabricksSQL ServerSparkPythonScalaAzure Data Lake StorageAzure SQLAzure Synapse AnalyticsETLELTData ModelingStar SchemaSnowflake SchemaCI/CDAzure DevOpsGit

Highlights

  • Actively hiring

More Details

RoleEnabling Areas - IT - Assistant Manager - Data Engineer (Mumbai, IN)
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

IT Consulting

Enabling Areas - IT - Assistant Manager - Data Engineer (Mumbai, IN) at Deloitte | SkillMX | SkillMX