Consultant | Databricks | Kolkata | Engineering | Data Modernization & Migration (Bengaluru, IN)
Deloitte
Deloitte
Join Deloitte's Technology & Transformation practice as a Databricks Data Engineer and play a key role in our data modernization efforts. This is an exciting opportunity to work with cutting-edge leaders and organizations shaping the future.
Deloitte helps companies unlock value from vast amounts of data, providing strategic guidance and implementation services for data management, business intelligence, and next-generation analytics. We are looking for skilled professionals to build robust data solutions on the Databricks platform, driving data-driven decision-making for diverse clients.
Design, develop, and optimize data workflows and notebooks on the Databricks platform to ingest, transform, and load data. Build and maintain scalable, efficient data processing workflows using Spark (PySpark or Spark SQL), adhering to best practices. Collaborate with stakeholders to understand data requirements and translate them into technical solutions. Develop data models and schemas to support reporting and analytics. Ensure data quality, integrity, and security through rigorous checks and controls. Monitor and optimize data processing performance, actively resolving bottlenecks. Stay abreast of the latest advancements in data engineering and Databricks technologies.
Hold a Bachelor's or Master's degree in any field. Possess demonstrated experience in designing, implementing, and maintaining data solutions on Databricks. Have hands-on experience with at least one major cloud platform: Azure, AWS, or GCP. Familiarity with ETL and ELT processes is essential. Knowledge of data warehousing and data modeling concepts is required. Proficiency in Python or SQL is a must. Experience with Delta Lake is necessary. Understanding of DevOps principles and practices is beneficial. Exhibit excellent problem-solving, troubleshooting, communication, and teamwork skills.
Deloitte
Management Consulting