T&T - Engineering - Consultant/Senior Consultant/Manager-Databricks - Multiple Location
Deloitte
Deloitte
Join Deloitte's Technology & Transformation practice as a skilled Azure Databricks Data Engineer. You'll be instrumental in modernizing data solutions, unlocking value from vast datasets, and supporting fact-driven decision-making for diverse clients. This role offers a unique opportunity to work with cutting-edge technologies and contribute to impactful data initiatives.
We are looking for professionals to design, develop, and maintain robust data solutions on the Databricks platform. Your expertise will be crucial in building scalable and efficient systems that drive data-driven insights across various customer projects.
Design and implement high-performance, secure data architectures on Azure. Develop and optimize ETL/ELT pipelines using Databricks, Azure Data Factory, and Synapse Analytics. Implement robust data ingestion, transformation, and storage solutions. Build batch and real-time data processing workflows. Ensure data quality, governance, and security throughout the development lifecycle. Deploy solutions using Azure DevOps CI/CD pipelines and collaborate with cross-functional teams to support data-driven decision-making.
A minimum of 4 years of experience in data engineering is required. Proficiency in Databricks, PySpark, SQL, Azure Functions, Azure Data Factory, and Logic Apps is essential. Experience with live/streaming/batch processing, ELT/ETL, data integration, and GITHUB/Azure DevOps is also necessary. Strong SQL and Python skills are crucial for data transformation and analysis. Experience in designing and implementing data models, schemas, and performance-optimized queries is expected. Familiarity with Azure Data Lake, Azure SQL, Azure Synapse, Delta Live Tables, Event Hubs, Stream Analytics, Key Vault, ADLS, SQL Server, and Fabric is important. Exposure to project management methodologies like Agile is beneficial. Bachelor's degree or equivalent in a relevant field is expected.
Deloitte
Technology