Azure Senior Data Engineer (IN)
HCLTech
HCLTech
Join our team as a Senior Azure Data Engineer and play a pivotal role in architecting and implementing robust data solutions within the Microsoft Azure environment. This position is key to empowering data-driven insights by developing scalable data pipelines, consolidating diverse data sources, and delivering advanced analytics solutions that align with strategic business goals.
This role focuses on leveraging Azure Databricks and the broader Azure ecosystem to build efficient and reliable data infrastructures. You will be instrumental in transforming raw data into actionable intelligence.
Design, develop, and optimize scalable data solutions using Azure Databricks and the Azure ecosystem.
Build and maintain efficient data ingestion and transformation pipelines using Azure Data Factory (ADF).
Integrate structured and unstructured data from various sources into Azure Data Lake or Analytics platforms.
Develop comprehensive ETL processes to support critical analytics and reporting functions.
Collaborate closely with cross-functional teams to deliver high-quality, impactful data solutions.
Translate complex business requirements into detailed technical designs and implement scalable, robust architectures.
Ensure optimal performance, data integrity, and reliability across all data pipelines.
Support deployment processes and manage version control effectively using Azure DevOps.
Mandatory Skills: - Strong proficiency with the Microsoft Azure Stack, including T-SQL, SSIS, SSAS, and SSRS. - Hands-on experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. - Solid understanding of ETL processes and data integration principles. - Proficiency in SQL and working with relational databases. - Excellent analytical and problem-solving capabilities.
Preferred Skills: - Experience with Python scripting and Spark APIs. - Exposure to client-facing roles and stakeholder management. - Familiarity with Agile or Scrum methodologies.
Education: - Bachelor’s degree in Computer Science, Information Technology, or a related field.
Certifications: - Azure Data Engineer Associate or Microsoft Certified: Azure Data & AI Associate certification is a significant advantage.
HCLTech
IT Consulting