Azure Senior Data Engineer (IN)
HCLTech
HCLTech
Join our team as a Senior Data Engineer specializing in Azure Databricks to architect, build, and refine data solutions on the Microsoft Azure platform. Your expertise will be instrumental in empowering data-driven decision-making through the creation of robust data pipelines, the seamless integration of varied data sources, and the delivery of high-quality analytics that align with our strategic business goals.
Architect and implement scalable data solutions leveraging Azure Databricks and the broader Azure ecosystem. Develop and maintain Azure Data Factory (ADF) pipelines for efficient data ingestion and transformation. Integrate structured and unstructured data from diverse origins into Azure Data Lake or Analytics platforms. Design and build robust ETL processes to meet analytical and reporting needs. Collaborate with cross-functional teams to ensure the successful delivery of data solutions. Translate complex business requirements into scalable technical designs and architectures. Focus on performance optimization, data quality assurance, and pipeline reliability. Utilize Azure DevOps for deployment and version control of data solutions.
Mandatory skills include deep expertise in the Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS), practical experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. A solid understanding of ETL processes, data integration, proficiency in SQL and relational databases, and strong analytical and problem-solving abilities are essential.
Preferred qualifications include experience with Python scripting and Spark APIs, exposure to client-facing roles and stakeholder management, and familiarity with Agile/Scrum methodologies. A Bachelor’s degree in Computer Science, Information Technology, or a related field is required. Certification as an Azure Data Engineer Associate or Microsoft Certified: Azure Data & AI Associate is a plus.
HCLTech
IT Consulting