Azure Senior Data Technical Specialist (IN)
HCLTech
HCLTech
Join HCLTech, a global leader in digital, engineering, and cloud solutions, as a Senior Databricks Engineer (E3.2 Band). This role offers an exciting opportunity to own the end-to-end design and delivery of sophisticated data engineering solutions on the Azure platform. You will be instrumental in shaping scalable data architectures, leading crucial technical dialogues, and embedding best practices across projects. Collaboration with business stakeholders and cross-functional teams will be central to your success.
You will architect and implement enterprise-grade data solutions, focusing on Azure Databricks. This includes designing and optimizing complex data pipelines using Azure Data Factory, Databricks, and Synapse. You will lead data ingestion, transformation, and integration efforts across diverse data sources, providing technical guidance to engineering teams. Translating business needs into scalable solutions and optimizing the performance, cost, and reliability of Azure data platforms are key aspects of this role. Building CI/CD pipelines with Azure DevOps and ensuring adherence to stringent data quality, security, and compliance standards are also essential functions. Active participation in solution architecture and design reviews is expected.
Candidates should possess strong expertise in the Azure Data Engineering ecosystem, with advanced implementation and optimization skills in Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. A solid understanding of ETL/ELT frameworks and data modeling concepts is mandatory, alongside advanced proficiency in SQL and relational databases. Proven experience in performance tuning and large-scale data processing is required. Hands-on implementation experience with Python and Spark (preferably PySpark) is essential. Experience in solution design and contributing to architectural discussions is also a prerequisite. A Bachelor’s degree in Computer Science, IT, or a related field is required.
HCLTech
IT Consulting