Azure Data Technical Specialist (IN)
HCLTech
HCLTech
HCLTech, a global leader in digital, engineering, and cloud solutions, is seeking an experienced Senior Databricks Architect. This role focuses on designing and implementing cutting-edge data engineering solutions within the Azure ecosystem. You will be instrumental in architecting scalable data pipelines and driving best practices, collaborating closely with business stakeholders and cross-functional teams to ensure transformative, data-driven outcomes.
This position offers an opportunity to lead significant projects, mentor junior engineers, and contribute to high-level technical decision-making. We are committed to innovation and delivering exceptional value to our enterprise clients through robust and scalable data platforms.
Lead the end-to-end design and implementation of enterprise-grade data solutions using Azure Databricks. Architect and optimize complex data pipelines, incorporating Azure Data Factory, Databricks, and Synapse. Define and execute strategies for data ingestion, transformation, and integration from diverse data sources. Provide strong technical leadership and mentorship to engineering teams. Collaborate with stakeholders to understand business requirements and translate them into effective, scalable solutions. Focus on optimizing the performance, cost-efficiency, and reliability of Azure data platforms. Implement robust CI/CD pipelines and governance mechanisms with Azure DevOps. Ensure strict adherence to data quality, security, and compliance standards. Actively participate in solution architecture reviews and technical decision-making processes.
Demonstrated expertise in the Azure Data Engineering landscape, with advanced skills in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure Storage (ADLS Gen2). Proficiency in orchestrating complex pipelines using Azure Data Factory and implementing CI/CD using Azure DevOps. Solid understanding of ETL/ELT frameworks and data modeling principles. Advanced SQL skills and experience with relational databases. Proven ability in performance tuning for large-scale data processing. Hands-on experience with Python and Spark, preferably PySpark. Experience in solution design and architectural discussions is essential. While not mandatory, relevant certifications in Azure Data Factory, Azure Databricks, SQL, or Python are advantageous.
HCLTech
Information Technology & Services