Senior Technical Lead (IN)

HCLTech

5+ yrs India Full Time Remote
HCLTech logo
Posted : today
Actively hiring

Job description

Join our Global Analytics team as a Data Engineer, crafting high-quality, scalable data services for analytics, AI, and GenAI initiatives. You'll be instrumental in designing and implementing data pipelines, data models, orchestration, storage, and observability tools.

This role involves close collaboration with AI Engineers, Data Scientists, Product Owners, and Platform teams to deliver robust, governed, and self-service data products. You will focus on building and maintaining efficient data infrastructure that empowers advanced analytics and AI innovation.

Responsibilities

Design and build scalable data pipelines for batch, streaming, and event-driven data. Develop modular data models and semantic layers for analytics and AI use cases. Implement and operate orchestration workflows and compute engines using Spark, SQL, and Python. Work with storage technologies like Delta Lake, ADLS, and feature/vector stores. Ensure data reliability through quality checks, validations, and monitoring. Contribute to data lineage, metadata management, and documentation. Apply observability practices using tools like Great Expectations. Deliver curated datasets and reusable data assets for ML and GenAI applications. Process structured, graph, and unstructured data, including text and images. Support AI Engineering with data preparation for embeddings and RAG pipelines. Enhance data engineering tooling and frameworks for efficient development. Develop data pipelines using dbt and Databricks Lakeflow. Promote reuse of data services via clear documentation and templates. Collaborate with cross-functional teams including Data Scientists and Product Owners. Participate actively in technical design discussions and code reviews. Adhere to engineering best practices for version control, testing, CI/CD, and operational excellence.

Qualifications

A minimum of 5 years of experience in data engineering and building production-grade data pipelines is required. Demonstrate strong hands-on experience with data platforms, particularly Databricks. Possess solid knowledge of data modeling, SQL, Spark, and Python. Experience with orchestration frameworks, data quality tools, and observability practices is essential. Exposure to processing unstructured data and building AI/GenAI data pipelines is highly advantageous. Experience working within a global, multi-team environment is beneficial.

Essential Skills

Data EngineeringData PipelinesDatabricksData ModelingSQLSparkPythonOrchestration FrameworksData Quality ToolingObservability PracticesUnstructured Data ProcessingAI/GenAI Data PipelinesdbtDatabricks LakeflowVersion ControlTestingCI/CD

Highlights

  • Actively hiring

More Details

RoleSenior Technical Lead (IN)
Employment TypeFull Time, Remote

About the Company

HCLTech logo

HCLTech

IT Consulting

Senior Technical Lead (IN) at HCLTech | SkillMX | SkillMX