Azure Data Technical Specialist (IN)
HCLTech
HCLTech
HCLTech, a global technology leader, is seeking a Senior Databricks Engineer to spearhead the design and implementation of cutting-edge data engineering solutions on the Azure platform. This role offers the opportunity to architect scalable data pipelines, influence technical direction, and collaborate with diverse teams to drive innovation.
As a key player, you will contribute to transforming enterprises through robust, data-driven platforms. Your expertise will be instrumental in shaping scalable, reliable, and cost-effective Azure data solutions that meet evolving business demands.
Lead the end-to-end design and implementation of enterprise-grade data solutions using Azure Databricks. Architect and optimize data pipelines across Azure Data Factory, Databricks, and Synapse. Drive data ingestion, transformation, and integration strategies from various sources. Provide technical leadership and mentorship to engineering teams. Collaborate with stakeholders to translate business requirements into technical solutions. Optimize performance, cost, and reliability of Azure data platforms. Implement CI/CD pipelines and governance frameworks using Azure DevOps. Uphold data quality, security, and compliance standards. Contribute to solution architecture and technical decision-making processes.
Requires advanced expertise in Azure Databricks, Azure Data Factory, and Azure Synapse Analytics. Strong knowledge of Azure Storage, ADLS Gen2, and Azure DevOps for CI/CD pipelines is essential. A deep understanding of ETL/ELT frameworks and data modeling concepts is crucial. Proficiency in SQL and relational databases, coupled with experience in performance tuning for large-scale data processing. Hands-on experience with Python and Spark (PySpark preferred) is required. Demonstrated experience in solution design and architecture discussions. Bachelor's degree in Computer Science, IT, or a related field is necessary.
HCLTech
Information Technology & Services