Azure Senior Data Engineer (IN)
HCLTech
HCLTech
Seeking a proficient Databricks Engineer to architect, build, and refine data solutions within the Microsoft Azure environment. This role is pivotal in empowering data-informed strategies by constructing robust data pipelines, integrating varied data sources, and delivering impactful analytics solutions that align with organizational goals.
Opportunity to leverage cutting-edge Azure technologies to drive business insights.
Design and implement scalable data solutions using Azure Databricks and the broader Azure ecosystem. Develop and maintain Azure Data Factory (ADF) pipelines for efficient data ingestion and transformation. Integrate structured and unstructured data from multiple sources into Azure Data Lake/Analytics platforms. Build ETL processes to effectively support analytics and reporting needs. Collaborate with cross-functional teams to deliver high-quality, data-driven solutions. Translate business requirements into technical designs and architect scalable systems. Ensure optimal performance, data integrity, and reliability across all data pipelines. Manage deployment and version control utilizing Azure DevOps.
Mandatory skills include strong expertise in the Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS) and hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. A solid understanding of ETL processes and data integration is essential, along with proficiency in SQL and relational databases. Strong analytical and problem-solving abilities are key.
Preferred skills encompass experience with Python scripting and Spark APIs, exposure to client-facing roles and stakeholder interactions, and familiarity with Agile/Scrum methodologies. A Bachelor’s degree in Computer Science, Information Technology, or a related field is required.
Azure Data Engineer Associate or Microsoft Certified: Azure Data & AI Associate certification is a plus.
HCLTech
IT Consulting