Azure Senior Data Lead (IN)
HCLTech
HCLTech
We are looking for a skilled Databricks Engineer to architect, build, and refine data solutions within the Microsoft Azure ecosystem. This pivotal role involves creating robust data pipelines, merging diverse data sources, and delivering impactful analytics solutions that align with organizational goals, thereby empowering data-driven decision-making.
This opportunity emphasizes leveraging Azure Databricks and the broader Azure platform to create scalable and efficient data infrastructures.
Key responsibilities include designing and developing scalable data solutions using Azure Databricks and other Azure services. You will build and manage Azure Data Factory (ADF) pipelines for streamlined data ingestion and transformation. Integrating structured and unstructured data from various sources into Azure Data Lake or Analytics platforms is crucial. Developing ETL processes to support analytics and reporting needs, collaborating with cross-functional teams to deliver high-quality data solutions, and translating business requirements into scalable technical designs are also key.
Furthermore, you will ensure optimal performance, data quality, and reliability across all data pipelines. Supporting deployment and version control through Azure DevOps is an integral part of this role.
Essential skills include strong expertise in the Microsoft Azure Stack, encompassing T-SQL, SSIS, SSAS, and SSRS. Hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake is mandatory. A solid understanding of ETL processes and data integration, coupled with proficiency in SQL and relational databases, is required. Strong analytical and problem-solving abilities are also fundamental.
Beneficial skills to have include experience with Python scripting and Spark APIs. Familiarity with client-facing roles and stakeholder interactions, as well as Agile/Scrum methodologies, would be advantageous. A Bachelor’s degree in Computer Science, Information Technology, or a related field is required. Azure certifications are a plus.
HCLTech
IT Consulting