T&T | Engineering | ADMM | Consultant / Senior Consultant / Manager| Databricks | Multiple locations
Deloitte
Deloitte
Join our dynamic data modernization team as a skilled Azure Databricks Data Engineer. This role is crucial for designing, developing, and maintaining advanced data solutions on the Databricks platform. Your expertise will be key in enabling data-driven decision-making for a diverse range of clients through innovative data engineering practices.
Key responsibilities include designing and implementing scalable, secure, and high-performance data architectures on Azure. You will develop and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. This involves building robust data ingestion, transformation, and storage solutions, as well as batch and real-time data processing using Azure services like Delta Live Tables and Event Hubs. Ensuring data quality, governance, and security is paramount, alongside deploying solutions via Azure DevOps CI/CD pipelines. Collaboration with stakeholders, mentoring junior engineers, and providing technical direction are integral parts of this role.
We are looking for candidates with a B.Tech or BE in Computer Science or Information Technology and a minimum of 4 years of experience as a data engineer, focusing on tools like ADF, Databricks, and Azure Synapse. Proficiency in SQL and Python for data transformation is essential. Experience with data modeling, various data sources (structured, semi-structured, unstructured), and cloud infrastructure deployment is required. Familiarity with Agile methodologies, stakeholder management, and a proactive approach to problem-solving and delivering cost-optimized solutions are highly valued.
Deloitte
Information Technology & Services