Consultant | Databricks | Kolkata | Engineering | Data Modernization & Migration
Deloitte
Deloitte
Deloitte's Technology & Transformation practice is seeking experienced Databricks Data Engineers to join our data modernization team in Kolkata. You will be instrumental in designing, developing, and maintaining robust data solutions on the Databricks platform, driving data-driven decision-making for our clients.
Our team helps organizations unlock value from vast amounts of data. We provide strategic guidance and implementation services for managing data from disparate sources, transforming it into actionable information. This role involves working with cutting-edge technologies, including big data, cloud, cognitive, and machine learning.
At Deloitte, we believe in unleashing your full potential. You'll collaborate with leaders and organizations shaping the future, grow your skills, and make a significant impact. We encourage a 'whole self' approach to work, fostering innovation and purpose-driven collaboration.
Design, develop, and optimize data workflows and notebooks on the Databricks platform to ingest and transform data from various sources into data lakes.
Build and maintain scalable, efficient data processing workflows using Spark (PySpark or Spark SQL), adhering to coding standards and best practices.
Collaborate with technical and business stakeholders to understand data requirements and translate them into effective technical solutions.
Develop data models and schemas to support reporting and analytics needs, ensuring data quality, integrity, and security.
Monitor and optimize data processing performance, proactively identifying and resolving bottlenecks.
Stay current with the latest advancements in data engineering and Databricks technologies.
Possess a Bachelor's or Master's degree in any field, coupled with proven experience in designing, implementing, and maintaining data solutions on Databricks.
Demonstrate experience with at least one major cloud platform: Azure, AWS, or GCP. Familiarity with ETL/ELT processes and data warehousing/modeling concepts is essential.
Proficiency in Python or SQL, along with experience using Delta Lake, is required. Understanding of DevOps principles and practices is beneficial.
Exhibit excellent problem-solving and troubleshooting skills, along with strong communication and teamwork abilities. This role is based in Kolkata, India.
Deloitte
IT Consulting