Azure Senior Data Technical Specialist (IN)
HCLTech
HCLTech
Join HCLTech, a global leader in digital, engineering, and cloud solutions, and shape the future of enterprise data platforms. As a Senior Databricks Engineer, you will drive innovation by designing and delivering cutting-edge data engineering solutions on Azure. This role offers the opportunity to influence technical strategy and collaborate with diverse teams to achieve business success through scalable, data-driven approaches.
This position is ideal for experienced professionals passionate about leveraging advanced Azure technologies to solve complex data challenges. You will be instrumental in building robust and efficient data architectures that support critical business functions.
Take full ownership of designing and implementing enterprise-grade data solutions utilizing Azure Databricks.
Architect and optimize comprehensive data pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
Lead data ingestion, transformation, and integration efforts across various data sources.
Provide expert technical guidance and mentorship to junior engineers and project teams.
Collaborate with stakeholders to understand business requirements and translate them into scalable, effective solutions.
Ensure optimal performance, cost-efficiency, and reliability of Azure data platforms.
Implement CI/CD pipelines and establish robust governance practices with Azure DevOps.
Uphold stringent data quality, security, and compliance standards throughout projects.
Demonstrate advanced expertise in the Azure Data Engineering ecosystem, including Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and ADLS Gen2.
Possess a deep understanding of ETL/ELT frameworks and data modeling concepts, coupled with advanced SQL proficiency.
Showcase strong experience in performance tuning and handling large-scale data processing.
Have hands-on implementation experience with Python and Spark, preferably PySpark.
Exhibit proven experience in solution design and architectural discussions.
A Bachelor’s degree in Computer Science, IT, or a related field is required. Familiarity with Azure DevOps for CI/CD pipelines is essential.
HCLTech
IT Consulting