Lead Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate
Deloitte
Deloitte
Join Deloitte Touche Tohmatsu India LLP as a Lead Senior Associate in Data Engineering. This role offers a hybrid work model, with 3 days onsite and 2 days remote in Bangalore. You'll be instrumental in shaping our data infrastructure, supporting critical analytics, BI, AI/ML, and reporting initiatives.
This position is ideal for an experienced Data Engineer with 4-6 years of hands-on expertise. You should possess a strong command of Snowflake, Azure Data Factory, Databricks, PySpark, and SQL, coupled with a solid understanding of data modeling and end-to-end ETL development. Prior exposure to modern cloud data platforms and Azure ecosystem services is highly valued.
As a Lead Senior Associate, you will be responsible for designing, building, and maintaining robust ETL/ELT pipelines. You will develop scalable data architectures leveraging Azure and Snowflake capabilities. Key duties include integrating data from diverse sources like APIs, databases, and streaming platforms, ensuring high data quality and governance standards, and optimizing system performance.
This role also involves implementing effective monitoring, logging, and workflow automation. You will support the Analytics, BI, AI/ML, and reporting teams by providing reliable data solutions. Additionally, you'll be tasked with creating and maintaining comprehensive data models and essential technical documentation.
We are seeking candidates proficient in Snowflake, including Snowpipe, Streams & Tasks, Time Travel, and Snowpark. Expertise in the Azure Data Engineering Stack is essential, covering Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, and Azure Data Lake. Strong programming skills in Python, SQL/T-SQL, PySpark, and Spark SQL are mandatory, with basic knowledge of KQL being beneficial.
Essential data and ETL skills include Data Modeling (ERD, Dimensional Modeling) and ETL/ELT Development experience, particularly with ADF. Exposure to tools like dbt, Fivetran, Matillion, or Airflow is advantageous. Working knowledge of Hadoop & Spark, performance tuning, troubleshooting, Git, and Azure DevOps are also required. Preferred skills encompass chat applications, Micro Frontends, and Python-based web development.
Deloitte
Engineering as a Service