T&T | Engineering | ADMM | Consultant / Senior Consultant / Manager| Databricks | Multiple locations (Bengaluru, IN)
Deloitte
Deloitte
Join our dynamic data modernization team as a skilled Azure Databricks Data Engineer. You will be central to architecting, building, and maintaining sophisticated data solutions on the Databricks platform. Your expertise in data engineering and broad understanding of current technologies will be key to developing impactful, data-driven solutions for our diverse clientele.
Design and implement scalable, secure, high-performance data architectures on Azure. Develop and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Implement data ingestion, transformation, and storage using Azure Data Lake, Azure SQL, and Azure Synapse. Build batch and real-time data processing solutions with Azure services like Delta Live Tables, Event Hubs, and Stream Analytics. Create robust data models, schemas, and optimize queries for performance. Ensure data quality, governance, and security across all implemented solutions. Deploy data solutions effectively using Azure DevOps CI/CD pipelines. Collaborate closely with data scientists, analysts, and business stakeholders to foster data-driven decision-making. Troubleshoot and enhance data workflows for optimal scalability and performance. Implement comprehensive logging, monitoring, and alerting using Azure Monitor and Log Analytics.
Proven experience as a data engineer with a strong focus on Azure Databricks, Azure Data Factory, and Azure Synapse Analytics. Proficiency in designing and implementing data solutions on Azure cloud infrastructure. Expertise in developing and optimizing ETL/ELT data pipelines. Solid understanding of data ingestion, transformation, and storage strategies using Azure services. Experience with batch and real-time data processing technologies. Strong SQL and Python skills for data manipulation and analysis. Ability to design efficient data models and schemas. Familiarity with working with structured, semi-structured, and unstructured data. Commitment to data quality, governance, and security best practices. Experience with CI/CD deployment using Azure DevOps. Excellent communication and collaboration skills, with the ability to work effectively in a multicultural environment. A proactive approach to problem-solving and a passion for new technologies. Experience in project management, including status reporting and Agile methodologies. Ability to mentor junior data engineers and analysts. A self-starter mentality, focused on delivering cost- and performance-efficient solutions.
Deloitte
IT Services and Consulting