Join our dynamic data modernization team as a skilled Azure Databricks Data Engineer. You will be central to creating, developing, and maintaining sophisticated data solutions utilizing the Databricks platform. Your expertise in data engineering, combined with a profound understanding of current technologies, will be crucial in constructing data-driven solutions that empower informed decision-making for diverse clients.

This role is part of Deloitte's Technology & Transformation practice, focused on unlocking the immense value within large datasets. We provide strategic guidance and implementation services, helping organizations manage data from various sources and transform it into actionable insights for a competitive advantage.

Design, develop, and maintain efficient data pipelines and ETL processes leveraging Microsoft Azure services like Azure Data Factory, Azure Synapse, Azure Databricks, and Azure Fabric. Utilize Azure data storage for managing pipeline outputs, such as Azure Data Lake Storage Gen 2 and Azure Blob Storage. Query modern RDBMS effectively using SQL DML (e.g., SQL Server, PostgreSQL). Collaborate with data architects and stakeholders to gather data requirements and deliver high-quality data solutions. Optimize data pipelines for performance, scalability, and reliability within the Azure ecosystem. Collect, clean, and validate data from multiple sources to ensure accuracy and integrity, implementing data validation techniques and frameworks. Monitor and resolve data pipeline issues promptly. Manage the CI/CD process for deploying and maintaining data solutions, staying current with industry trends and emerging technologies.

Requires 3-5 years of proven experience as a Data Engineer, with a strong background in data and ETL processes. Experience working within regulated environments and adhering to internal quality policies is essential. Proficiency in development and deployment of cloud infrastructure is expected. Strong SQL and Python skills are necessary for data transformation and analysis. Responsibilities include designing and implementing data models, schemas, and performance-optimized queries, while ensuring data quality, governance, and security. Experience deploying data solutions via Azure DevOps CI/CD pipelines is required. Demonstrating strategic thinking and problem-solving abilities to address business issues and complex challenges is key. Preferred qualifications include a B.Tech/BE in Computer Science or Information Technology. Knowledge of PowerApps, Power Automate, and Power BI is beneficial, as is familiarity with REST-API and OAuth.