Azure Senior Data Technical Specialist (IN)
HCLTech
HCLTech
Join HCLTech, a leading global technology firm specializing in digital, engineering, and cloud solutions. We empower enterprises with scalable, data-driven platforms. As a Senior Databricks Engineer (E3.2 Band), you will drive the end-to-end design and delivery of advanced Azure data engineering solutions.
This role involves architecting robust data pipelines, leading technical discussions, and embedding best practices across projects. You will collaborate closely with business stakeholders and cross-functional teams to achieve impactful results.
Spearhead the design and implementation of enterprise-grade data solutions utilizing Azure Databricks. Architect and optimize comprehensive data pipelines with ADF, Databricks, and Synapse. Lead data ingestion, transformation, and integration initiatives across diverse data sources.
Provide pivotal technical leadership and mentorship to junior engineers and project teams. Engage proactively with stakeholders to grasp business requirements and translate them into scalable architectural designs. Optimize the performance, cost-efficiency, and reliability of Azure data platforms.
Implement CI/CD pipelines and governance frameworks using Azure DevOps. Ensure strict adherence to data quality, security, and compliance standards. Actively contribute to solution architecture, design reviews, and critical technical decision-making processes.
Demonstrate strong expertise within the Azure Data Engineering ecosystem, including advanced Azure Databricks implementation and optimization, complex Azure Data Factory pipeline orchestration, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. Possess a deep understanding of ETL/ELT frameworks and data modeling concepts.
Exhibit advanced proficiency in SQL and relational databases. Showcase strong experience in performance tuning and handling large-scale data processing. Provide hands-on experience with Python and Spark (PySpark is highly preferred). Experience in solution design and architectural discussions is essential.
Preferred qualifications include experience in client-facing or consulting roles, exposure to data governance, security, and compliance frameworks, and knowledge of real-time/streaming data processing using Kafka or Event Hub. Familiarity with Agile/Scrum methodologies and relevant Azure/Databricks certifications are advantageous.
HCLTech
Information Technology & Services