Enabling Areas - IT - Assistant Manager - Data Engineer (Mumbai, IN)
Deloitte
Deloitte
Join our IT team as an Assistant Manager, Data Engineer, based in Mumbai. This role is pivotal in enhancing employee experience across Deloitte South Asia by managing and developing robust data solutions. You'll leverage your expertise in Azure, SQL Server, and Databricks to support critical analytics, reporting, and data science initiatives, ensuring the delivery of high-quality, performant data systems.
This position is essential for building and maintaining our application infrastructure, focusing on delivering reliable data services that empower our business units.
Design, develop, and manage scalable ETL/ELT pipelines using Azure Data Factory and Databricks for both batch and real-time data processing. Integrate diverse data sources, including SQL Server, Azure SQL Database, ADLS, and external APIs. Construct and maintain data models, data marts, and data warehouses utilizing SQL Server and Azure Synapse Analytics. Write efficient SQL queries, stored procedures, views, and triggers, optimizing for performance within SQL Server. Process large datasets for transformation and analytics using Databricks with Spark (Python/Scala). Implement data quality, integrity, security, and compliance measures through validation, monitoring, and auditing. Collaborate closely with data analysts, data scientists, and business stakeholders to define and deliver data solutions. Set up and manage CI/CD pipelines via Azure DevOps for streamlined deployments. Monitor and optimize the performance of data pipelines and queries across Azure and SQL Server environments.
A Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field is required. Minimum of 3 years of experience in data engineering or a comparable role. Proficiency in Azure Data Services including Data Factory, ADLS, Azure SQL, and Azure Synapse. Hands-on experience with Databricks (Azure implementation) and Spark using Python or Scala. Expertise in Microsoft SQL Server, encompassing advanced SQL writing, stored procedures, and performance tuning. Solid understanding of data warehousing principles, ETL/ELT best practices, and data modeling techniques (star/snowflake schema). Familiarity with data governance, RBAC, and data security practices within the Azure ecosystem. Experience with CI/CD tools like Azure DevOps and version control systems such as Git. Exceptional problem-solving abilities and a strong aptitude for collaborative work in a dynamic environment.
Deloitte
IT Consulting