T&T| Engg| Databricks| Mumbai| Senior Consultant
Deloitte
Deloitte
Deloitte's Technology & Transformation practice empowers organizations to harness the full potential of their data. We provide strategic guidance and implementation services, enabling companies to consolidate data from various sources into actionable insights. Our expertise spans business intelligence, data management, performance management, and advanced analytics, including big data, cloud, and AI technologies.
This role focuses on leveraging the Databricks Lakehouse for transformative data solutions.
Lead the architecture, design, and implementation of scalable, secure, and cost-efficient data platforms using Databricks. Develop and optimize data pipelines with PySpark, Spark SQL, Delta Lake, Auto Loader, and Structured Streaming. Architect and manage lakehouse environments with Unity Catalog and cloud storage. Drive data modeling and performance optimization. Define and implement CI/CD for Databricks. Lead data migration and modernization efforts. Implement data quality frameworks and ensure enterprise-grade security and governance.
Optimize solutions for cost, scalability, and reliability. Serve as a technical advisor, review designs and code, and provide architectural guidance. Mentor junior team members and contribute to pre-sales activities.
Requires a minimum of 6 years of experience. Possesses deep hands-on expertise in Databricks, Spark, Delta Lake, and cloud data architectures. Advanced proficiency in SQL and PySpark/Scala is essential. Strong experience with distributed systems and large-scale data processing is necessary. Proven leadership in design reviews, architecture decisions, and technical governance is expected. Experience in client-facing consulting roles is a must. Excellent communication, problem-solving, and stakeholder management skills are required.
Deloitte
IT Consulting