Consultant | Databricks | Mumbai | Engineering

Deloitte

3–7 yrs Mumbai Full Time Remote
Deloitte logo
Posted : 2 weeks ago Actively Hiring

Job description

Join Deloitte's Technology & Transformation practice as a Databricks Data Engineer and play a key role in modernizing data solutions. You will leverage your expertise in data engineering and the Databricks platform to build robust solutions that drive data-driven decision-making for diverse clients. This role offers the opportunity to work with cutting-edge leaders and organizations shaping the future of the global economy.

Deloitte provides a dynamic environment to collaborate, innovate, and grow. We encourage you to bring your whole self to work and make a meaningful impact. Our practice focuses on business intelligence, data management, performance management, and next-generation analytics, including big data, cloud, cognitive, and machine learning.

Responsibilities

Develop and maintain scalable data engineering solutions using Databricks, PySpark, and SQL for enterprise data platforms. Implement and optimize secure, reliable, and performance-driven data architectures. Build and manage data pipelines for diverse data types from multiple sources. Develop and support batch and near real-time data processing solutions. Manage Databricks capabilities including Delta Lake, DLT, Unity Catalog, Workflows, and Serverless Compute. Develop data solutions following Lakehouse, Medallion, Data Warehouse, and Data Mart standards. Optimize Spark jobs, SQL queries, and data pipelines for efficiency and cost-effectiveness. Monitor Databricks clusters and workload performance. Collaborate with stakeholders to translate business requirements into technical solutions. Implement data governance, security, and compliance standards. Leverage cloud-native services (Azure, AWS, GCP) for integrated solutions. Deploy code using GitHub, CI/CD, and Agile methodologies. Work with large-scale datasets, implementing robust security, data quality, and performance optimization techniques. Perform system integration and testing. Analyze and resolve defects and production incidents promptly.

Qualifications

A Bachelor’s or Master’s degree in any field is required. Candidates must possess significant experience in designing, implementing, and maintaining data solutions on the Databricks platform. Proficiency with at least one major cloud platform (Azure, AWS, or GCP) is essential.

Demonstrated experience with ETL/ELT processes, data warehousing, and data modeling concepts is necessary. Strong programming skills in Python or SQL, coupled with hands-on experience with Delta Lake, are mandatory. A solid understanding of DevOps principles and practices is also required.

Exceptional problem-solving, troubleshooting, and communication skills are vital for this role. The ability to work effectively in a team and collaborate across functions will contribute to success in delivering high-impact solutions.

Essential Skills

DatabricksPySparkSQLAzureAWSGCPDelta LakeDelta Live Tables (DLT)Unity CatalogData GovernanceDatabricks WorkflowsServerless ComputeData ArchitectureData ModelingLakehouse ArchitectureData WarehousingMedallion FrameworkGitHubCI/CDAgileDevOpsETLELTPython

Good to Have

GenieMosaic AIDatabricks Data Intelligence Platform

More Details

RoleConsultant | Databricks | Mumbai | Engineering
IndustryInformation Technology & Services, Management Consulting
DepartmentData Engineering
Employment TypeFull Time, Remote

About the Company

Deloitte logo

Deloitte

Information Technology & Services

Consultant | Databricks | Mumbai | Engineering at Deloitte | SkillMX | SkillMX