Senior Consultant | Azure Databricks | Bengaluru | Engineering | Data Modernization & Migration

Deloitte

5–12 yrs Bengaluru Full Time Work from office
Deloitte logo
Posted : 1 week ago
Actively hiring

Job description

Deloitte seeks a seasoned Databricks Data Engineer to join our data modernization practice in Bengaluru. This role is crucial for designing, developing, and maintaining advanced data solutions on the Databricks platform. You will leverage your expertise to build impactful data-driven solutions for diverse clients, contributing to their strategic decision-making.

As part of Deloitte's Technology & Transformation practice, you will help organizations unlock value from their data. We offer a dynamic environment where you can collaborate with industry leaders, innovate, and grow your career while making a significant impact.

Responsibilities

Architect, develop, and maintain robust, scalable data engineering solutions using Databricks, PySpark, and SQL. Design and implement secure, reliable, and performant data architectures following Lakehouse and Medallion principles. Build and manage data pipelines for processing diverse data types, supporting both batch and near real-time processing.

Implement and manage key Databricks features such as Delta Lake, DLT, Workflows, Serverless Compute, and Unity Catalog for data governance. Optimize Spark jobs, SQL queries, and clusters for enhanced performance, scalability, and cost efficiency. Collaborate with stakeholders to translate business requirements into technical solutions, ensuring adherence to enterprise data governance and security standards.

Qualifications

A Bachelor's or Master's degree is required. Candidates should possess 7-12 years of experience, with at least 5 years of relevant hands-on experience in Databricks, PySpark, and SQL. Proficiency in cloud platforms like Azure, AWS, or GCP is essential.

Expertise in Delta Lake, Delta Live Tables, Unity Catalog, Databricks Workflows, and Serverless Compute is mandatory. Strong knowledge of Data Architecture, Data Modelling, Lakehouse Architecture, Data Warehousing, and the Medallion Framework is expected. Experience with GitHub, CI/CD pipelines, Agile methodologies, and DevOps practices is also required.

Essential Skills

DatabricksPySparkSQLAzureAWSGCPDelta LakeDelta Live TablesUnity CatalogData GovernanceDatabricks WorkflowsServerless ComputeData ArchitectureData ModellingLakehouse ArchitectureData WarehousingMedallion FrameworkGitHubCI/CDAgileDevOpsETLELTPython

Good to Have

GenieMosaic AIDatabricks Data Intelligence Platform

Highlights

  • Actively hiring

More Details

RoleSenior Consultant | Azure Databricks | Bengaluru | Engineering | Data Modernization & Migration
IndustryEngineering
DepartmentData Engineering, Consulting
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

Engineering

Senior Consultant | Azure Databricks | Bengaluru | Engineering | Data Modernization & Migration at Deloitte | SkillMX | SkillMX