Lead Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate

Deloitte

4–6 yrs Bengaluru Full Time Hybrid (office + remote)
Deloitte logo
Posted : 1 week ago
Actively hiring

Job description

Join Deloitte Touche Tohmatsu India LLP as a Lead Senior Associate in Data Engineering. This role offers a hybrid work model, with 3 days onsite and 2 days remote in Bangalore. You'll be instrumental in shaping our data infrastructure, supporting critical analytics, BI, AI/ML, and reporting initiatives.

This position is ideal for an experienced Data Engineer with 4-6 years of hands-on expertise. You should possess a strong command of Snowflake, Azure Data Factory, Databricks, PySpark, and SQL, coupled with a solid understanding of data modeling and end-to-end ETL development. Prior exposure to modern cloud data platforms and Azure ecosystem services is highly valued.

Responsibilities

As a Lead Senior Associate, you will be responsible for designing, building, and maintaining robust ETL/ELT pipelines. You will develop scalable data architectures leveraging Azure and Snowflake capabilities. Key duties include integrating data from diverse sources like APIs, databases, and streaming platforms, ensuring high data quality and governance standards, and optimizing system performance.

This role also involves implementing effective monitoring, logging, and workflow automation. You will support the Analytics, BI, AI/ML, and reporting teams by providing reliable data solutions. Additionally, you'll be tasked with creating and maintaining comprehensive data models and essential technical documentation.

Qualifications

We are seeking candidates proficient in Snowflake, including Snowpipe, Streams & Tasks, Time Travel, and Snowpark. Expertise in the Azure Data Engineering Stack is essential, covering Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, and Azure Data Lake. Strong programming skills in Python, SQL/T-SQL, PySpark, and Spark SQL are mandatory, with basic knowledge of KQL being beneficial.

Essential data and ETL skills include Data Modeling (ERD, Dimensional Modeling) and ETL/ELT Development experience, particularly with ADF. Exposure to tools like dbt, Fivetran, Matillion, or Airflow is advantageous. Working knowledge of Hadoop & Spark, performance tuning, troubleshooting, Git, and Azure DevOps are also required. Preferred skills encompass chat applications, Micro Frontends, and Python-based web development.

Essential Skills

SnowflakeSnowflake Data WarehouseSnowpipeStreams & TasksTime TravelSnowparkAzure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure SQL DatabaseAzure Data LakePythonSQLT-SQLPySparkSpark SQLData ModelingETL/ELT DevelopmentGit

Good to Have

KQLdbtFivetranMatillionAirflowHadoopSparkPerformance TuningTroubleshootingAzure DevOpsMicrosoft Teams Bot FrameworkAdaptive CardsD3.jsHighchartsAzure Web Apps

Highlights

  • Actively hiring

More Details

RoleLead Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate
IndustryEngineering as a Service, Operate
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Engineering as a Service