T&T - Engineering - Consultant/Senior Consultant/Manager-Databricks - Multiple Location

Deloitte

4+ yrs Bengaluru, Pune, Mumbai, New Delhi, Kolkata, Coimbatore, Hyderabad Full Time Hybrid (office + remote)
Deloitte logo
Posted : 1 week ago
Actively hiring

Job description

Join Deloitte's Technology & Transformation practice as a skilled Azure Databricks Data Engineer. You'll be instrumental in modernizing data solutions, unlocking value from vast datasets, and supporting fact-driven decision-making for diverse clients. This role offers a unique opportunity to work with cutting-edge technologies and contribute to impactful data initiatives.

We are looking for professionals to design, develop, and maintain robust data solutions on the Databricks platform. Your expertise will be crucial in building scalable and efficient systems that drive data-driven insights across various customer projects.

Responsibilities

Design and implement high-performance, secure data architectures on Azure. Develop and optimize ETL/ELT pipelines using Databricks, Azure Data Factory, and Synapse Analytics. Implement robust data ingestion, transformation, and storage solutions. Build batch and real-time data processing workflows. Ensure data quality, governance, and security throughout the development lifecycle. Deploy solutions using Azure DevOps CI/CD pipelines and collaborate with cross-functional teams to support data-driven decision-making.

Qualifications

A minimum of 4 years of experience in data engineering is required. Proficiency in Databricks, PySpark, SQL, Azure Functions, Azure Data Factory, and Logic Apps is essential. Experience with live/streaming/batch processing, ELT/ETL, data integration, and GITHUB/Azure DevOps is also necessary. Strong SQL and Python skills are crucial for data transformation and analysis. Experience in designing and implementing data models, schemas, and performance-optimized queries is expected. Familiarity with Azure Data Lake, Azure SQL, Azure Synapse, Delta Live Tables, Event Hubs, Stream Analytics, Key Vault, ADLS, SQL Server, and Fabric is important. Exposure to project management methodologies like Agile is beneficial. Bachelor's degree or equivalent in a relevant field is expected.

Essential Skills

DatabricksPySparkSQLAzure FunctionsAzure Data FactoryLogic AppsELTETLData IntegrationData IngestionData ManipulationData ProcessingGitHubAzure DevOpsPythonAzure Data LakeAzure SQLAzure Synapse AnalyticsDelta Live TablesEvent HubsStream AnalyticsKey VaultADLSSQL ServerFabric

Good to Have

SynapseData ModelingProject ManagementScrum MasterAgile MethodologyStakeholder ManagementAzure CertificationsDatabricks Certification

Highlights

  • Actively hiring

More Details

RoleT&T - Engineering - Consultant/Senior Consultant/Manager-Databricks - Multiple Location
IndustryTechnology
DepartmentData Engineering, Cloud Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Technology

T&T - Engineering - Consultant/Senior Consultant/Manager-Databricks - Multiple Location at Deloitte | SkillMX | SkillMX