Join a leading Technology & Transformation practice focused on unlocking data's potential. We leverage a global network to guide and implement strategies for managing data from diverse sources, transforming it into actionable insights for fact-driven decision-making and competitive advantage. Our expertise spans business intelligence, data management, performance management, and next-generation analytics, including big data, cloud, cognitive, and machine learning.

We are seeking a Senior Databricks Engineer to design, build, and support modern Data Lakehouse solutions. This role demands hands-on expertise in Databricks, PySpark, Delta Lake, cloud platforms, and large-scale data processing. You will be instrumental in creating scalable data pipelines, optimizing distributed workloads, and advancing AI-driven initiatives.

Design and develop scalable data engineering solutions using Databricks. Build and optimize batch and real-time data processing pipelines. Develop ETL/ELT frameworks with PySpark and Spark SQL. Implement Delta Lake architecture and data governance standards. Process extensive structured, semi-structured, and streaming datasets. Optimize Spark jobs and cluster performance for peak efficiency. Create reusable frameworks, notebooks, workflows, and data products. Collaborate with cross-functional teams to deliver enterprise-grade solutions. Implement monitoring, alerting, security, and compliance measures. Participate in code reviews, deployment, and production support. Develop technical documentation and mentor junior engineers.

A Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field is required. Minimum of 4-9 years of IT experience, with at least 4 years dedicated to hands-on Databricks and Spark development. Demonstrate strong expertise in distributed data processing and Lakehouse architecture. Proven experience building enterprise-scale data engineering solutions. In-depth knowledge of PySpark, Spark SQL, and performance optimization techniques. Familiarity with Agile development methodologies. Possess excellent analytical, troubleshooting, and communication skills.