Senior Consultant | Azure Databricks | Bengaluru | Engineering | Data Modernization & Migration
Deloitte
Deloitte
Deloitte seeks a seasoned Databricks Data Engineer to join our data modernization practice in Bengaluru. This role is crucial for designing, developing, and maintaining advanced data solutions on the Databricks platform. You will leverage your expertise to build impactful data-driven solutions for diverse clients, contributing to their strategic decision-making.
As part of Deloitte's Technology & Transformation practice, you will help organizations unlock value from their data. We offer a dynamic environment where you can collaborate with industry leaders, innovate, and grow your career while making a significant impact.
Architect, develop, and maintain robust, scalable data engineering solutions using Databricks, PySpark, and SQL. Design and implement secure, reliable, and performant data architectures following Lakehouse and Medallion principles. Build and manage data pipelines for processing diverse data types, supporting both batch and near real-time processing.
Implement and manage key Databricks features such as Delta Lake, DLT, Workflows, Serverless Compute, and Unity Catalog for data governance. Optimize Spark jobs, SQL queries, and clusters for enhanced performance, scalability, and cost efficiency. Collaborate with stakeholders to translate business requirements into technical solutions, ensuring adherence to enterprise data governance and security standards.
A Bachelor's or Master's degree is required. Candidates should possess 7-12 years of experience, with at least 5 years of relevant hands-on experience in Databricks, PySpark, and SQL. Proficiency in cloud platforms like Azure, AWS, or GCP is essential.
Expertise in Delta Lake, Delta Live Tables, Unity Catalog, Databricks Workflows, and Serverless Compute is mandatory. Strong knowledge of Data Architecture, Data Modelling, Lakehouse Architecture, Data Warehousing, and the Medallion Framework is expected. Experience with GitHub, CI/CD pipelines, Agile methodologies, and DevOps practices is also required.
Deloitte
Engineering