Azure Senior Data Technical Specialist (IN)
HCLTech
HCLTech
Join HCLTech as a Senior Databricks Engineer (E3.2 Band) and lead the charge in designing and implementing cutting-edge data engineering solutions on Azure. This role offers end-to-end ownership, focusing on architecting scalable data pipelines and driving best practices.
As a key member of our global technology team, you will collaborate closely with stakeholders to translate business needs into robust, data-driven platforms. HCLTech is at the forefront of digital, engineering, and cloud innovation, enabling enterprises worldwide to achieve transformative success.
Lead the architecture and implementation of enterprise-grade data solutions, specifically leveraging Azure Databricks. Optimize end-to-end data pipelines using Azure Data Factory, Databricks, and Synapse. Drive sophisticated data ingestion, transformation, and integration strategies across diverse data sources.
Provide strong technical leadership and mentorship to junior engineers. Translate complex business requirements into scalable and efficient data solutions. Enhance the performance, cost-effectiveness, and reliability of Azure data platforms. Implement robust CI/CD pipelines with Azure DevOps and ensure strict adherence to data quality, security, and compliance standards.
A strong foundation in the Azure Data Engineering ecosystem is essential, including advanced expertise in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure Storage (ADLS Gen2). Proven experience with Azure DevOps for CI/CD is required.
Deep understanding of ETL/ELT frameworks and data modeling concepts, coupled with advanced SQL and relational database proficiency. Hands-on experience with Python and Spark (PySpark preferred) is critical for large-scale data processing and performance tuning. Experience in solution design and architectural discussions is a must.
HCLTech
IT Consulting