Azure Data Technical Specialist (IN)
HCLTech
HCLTech
Join HCLTech, a global leader in digital, engineering, and cloud solutions, and drive innovation in data-driven platforms. This role is integral to transforming enterprises through scalable, cutting-edge technologies. We are committed to customer success and fostering a collaborative environment.
As a Senior Databricks Engineer, you will spearhead the design and implementation of sophisticated data engineering solutions within the Azure ecosystem. This position offers a significant opportunity to architect robust data pipelines, lead technical discussions, and champion best practices across diverse projects. Collaboration with business stakeholders and cross-functional teams will be key to delivering impactful results.
Lead the end-to-end design and deployment of enterprise-grade data solutions utilizing Azure Databricks. Architect and refine complex data pipelines by leveraging Azure Data Factory, Databricks, and Synapse. Drive strategic data ingestion, transformation, and integration initiatives across various data sources. Provide essential technical leadership and mentorship to junior engineers and project teams. Collaborate closely with stakeholders to align business requirements with scalable, efficient solutions. Optimize Azure data platforms for peak performance, cost-effectiveness, and reliability. Implement robust CI/CD pipelines and governance frameworks using Azure DevOps. Uphold stringent data quality, security, and compliance standards. Actively contribute to solution architecture, design reviews, and critical technical decision-making processes.
Possess deep expertise in the Azure Data Engineering landscape, with advanced implementation and optimization skills in Azure Databricks. Demonstrate proficiency in orchestrating complex pipelines using Azure Data Factory and Azure Synapse Analytics. Strong working knowledge of Azure Storage and ADLS Gen2 is essential. Experience with Azure DevOps for CI/CD pipelines is required. A solid understanding of ETL/ELT frameworks and data modeling concepts is crucial. Advanced proficiency in SQL and relational databases is a must. Significant experience in performance tuning and handling large-scale data processing is expected. Hands-on experience with Python and Spark, preferably PySpark, is necessary. Proven experience in solution design and architectural discussions is vital.
HCLTech
Information Technology & Services