Azure Senior Data Engineer (IN)
HCLTech
HCLTech
Seeking a proficient Azure Senior Data Engineer to architect, develop, and refine data solutions on the Microsoft Azure platform. This pivotal role supports data-driven decisions by constructing robust data pipelines, integrating diverse data sources, and delivering high-quality analytics solutions that align with core business objectives.
This position emphasizes hands-on experience with Azure Databricks and the broader Azure ecosystem, focusing on building scalable data solutions and managing Azure Data Factory pipelines for efficient data ingestion and transformation. You will integrate structured and unstructured data into Azure Data Lake/Analytics platforms and develop comprehensive ETL processes to support advanced analytics and reporting needs.
Collaboration is key as you work with cross-functional teams to deliver exceptional data solutions. The role involves translating intricate business requirements into clear technical designs and implementing scalable architectures. Ensuring top-tier performance, data integrity, and pipeline reliability are paramount. Experience with Azure DevOps for deployment and version control is also essential.
Design and develop scalable data solutions leveraging Azure Databricks and the Azure ecosystem. Build and manage efficient Azure Data Factory (ADF) pipelines for data ingestion and transformation. Integrate structured and unstructured data from various sources into Azure Data Lake or Analytics platforms. Develop robust ETL processes to effectively support analytics and reporting requirements. Collaborate closely with cross-functional teams to deliver high-quality, impactful data solutions. Translate complex business requirements into well-defined technical designs and implement scalable architectures. Ensure optimal performance, maintain data quality, and guarantee reliability across all data pipelines. Support deployment processes and manage version control using Azure DevOps.
Mandatory Skills: - Strong expertise within the Microsoft Azure Stack, including T-SQL, SSIS, SSAS, and SSRS. - Hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. - Solid understanding of ETL processes and data integration methodologies. - Proficiency in SQL and working with relational databases. - Strong analytical and problem-solving capabilities.
Preferred Skills (Good to Have): - Experience with Python scripting and Spark APIs. - Exposure to client-facing roles and effective stakeholder interactions. - Familiarity with Agile / Scrum methodologies.
Educational Qualification: - Bachelor’s degree in Computer Science, Information Technology, or a related field.
Additional Consideration: - Azure Data Engineer Associate or Microsoft Certified Azure Data & AI Associate certification is a valuable asset.
HCLTech
IT Consulting