Azure Senior Data Technical Specialist (IN)
HCLTech
HCLTech
HCLTech, a global leader in digital, engineering, and cloud solutions, seeks a Senior Databricks Engineer (E3.2 Band) to drive innovation in data platforms. This role offers the opportunity to shape scalable, data-driven solutions for enterprise clients.
As a key member of the team, you will lead the design and implementation of advanced data engineering solutions on Azure, ensuring cutting-edge technology is leveraged for client success. Your contributions will be crucial in transforming how businesses utilize their data assets.
Spearhead the architecture and development of enterprise-grade data solutions utilizing Azure Databricks. Optimize end-to-end data pipelines with ADF, Databricks, and Synapse, and define robust data ingestion, transformation, and integration strategies. Provide essential technical guidance to junior engineers, collaborate with stakeholders to translate business needs into scalable technical solutions, and ensure the optimal performance, cost-efficiency, and reliability of Azure data platforms.
Implement CI/CD pipelines and governance frameworks through Azure DevOps, upholding stringent data quality, security, and compliance standards. Actively participate in solution architecture discussions, design reviews, and critical technical decision-making processes.
We are looking for extensive expertise in the Azure Data Engineering ecosystem, specifically advanced implementation and optimization of Azure Databricks, complex pipeline orchestration with Azure Data Factory, and proficiency in Azure Synapse Analytics and Azure Storage (ADLS Gen2). A strong understanding of ETL/ELT frameworks, data modeling, and advanced SQL is essential.
Hands-on experience with Python and Spark (PySpark) is required, alongside a proven track record in performance tuning and large-scale data processing. Experience in solution design and architecture discussions is also a must. A Bachelor’s degree in Computer Science, IT, or a related field is necessary. Familiarity with client-facing roles, data governance, and real-time data processing is advantageous.
HCLTech
Information Technology & Services