Azure Data Technical Specialist (IN)
HCLTech
HCLTech
HCLTech, a global technology leader, specializes in delivering cutting-edge digital, engineering, and cloud solutions. We empower enterprises with scalable, data-driven platforms and a relentless focus on innovation and client success.
This role is for a Senior Databricks Architect (E3.1) who will lead the end-to-end design and deployment of sophisticated data engineering solutions on Azure. You will be instrumental in architecting robust data pipelines, guiding technical discussions, and championing best practices across projects.
Collaboration is key, as you'll work closely with business stakeholders and diverse cross-functional teams to ensure alignment and impactful outcomes.
Spearhead the creation and implementation of enterprise-grade data solutions using Azure Databricks. Architect and refine comprehensive data pipelines utilizing ADF, Databricks, and Synapse. Drive strategies for data ingestion, transformation, and integration from various sources. Provide expert technical leadership and mentorship to junior engineers and project teams. Collaborate with stakeholders to grasp business requirements and translate them into scalable, effective solutions. Focus on optimizing the performance, cost, and reliability of Azure data platforms. Implement CI/CD processes and robust governance frameworks via Azure DevOps. Uphold stringent data quality, security, and compliance standards. Actively contribute to solution architecture, design reviews, and critical technical decision-making.
Demonstrate deep expertise within the Azure Data Engineering ecosystem, including Azure Databricks (advanced implementation & optimization), Azure Data Factory (complex pipeline orchestration), Azure Synapse Analytics, Azure Storage/Data Lake (ADLS Gen2), and Azure DevOps (CI/CD). Possess a thorough understanding of ETL/ELT frameworks and data modeling principles. Exhibit advanced proficiency in SQL and relational database management. Showcase significant experience in performance tuning and handling large-scale data processing. Provide hands-on experience with Python and Spark, with PySpark being preferred. Have proven experience in solution design and participating in architecture discussions.
A Bachelor’s degree in Computer Science, IT, or a related field is required. Experience in client-facing roles, familiarity with data governance, real-time data processing, and Agile methodologies are advantageous. Relevant Azure or Databricks certifications are a plus.
HCLTech
Information Technology & Services