Azure Senior Data Engineer (IN)
HCLTech
HCLTech
Seeking a skilled Azure Data Engineer to architect, build, and refine data solutions within the Microsoft Azure environment. This pivotal role focuses on developing robust, scalable data pipelines and integrating diverse data sources to empower data-informed decision-making and achieve key business objectives.
This position emphasizes hands-on development using Azure Databricks and the broader Azure ecosystem. You will be instrumental in constructing efficient data ingestion and transformation workflows, ensuring the seamless integration of structured and unstructured data into Azure's analytical platforms. The role requires a strong grasp of ETL processes and a commitment to delivering high-quality analytics solutions.
Design and implement scalable data solutions leveraging Azure Databricks and the Azure ecosystem. Build and maintain Azure Data Factory (ADF) pipelines for optimized data ingestion and transformation. Integrate structured and unstructured data from various sources into Azure Data Lake/Analytics platforms. Develop robust ETL processes to support comprehensive analytics and reporting needs. Collaborate with cross-functional teams to deliver exceptional data solutions. Translate business requirements into well-defined technical designs and scalable architectures. Ensure optimal performance, data quality, and reliability across all data pipelines. Utilize Azure DevOps for deployment and version control.
Mandatory expertise in the Microsoft Azure Stack, including T-SQL, SSIS, SSAS, and SSRS. Practical experience with Azure Data Factory (ADF), Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. A solid understanding of ETL methodologies and data integration techniques. Proficiency in SQL and relational database management. Excellent analytical and problem-solving capabilities. Preferred: Experience with Python scripting and Spark APIs, exposure to client-facing roles, and familiarity with Agile/Scrum frameworks. A Bachelor’s degree in Computer Science, Information Technology, or a related discipline is required. Azure Data Engineer Associate or Microsoft Certified: Azure Data & AI Associate certification is a plus.
HCLTech
IT Consulting