Senior Technical Manager (IN)
HCLTech
HCLTech
Drive the future of Generative AI by architecting and implementing robust, scalable, and secure data pipelines. This role is central to ensuring high-quality, accessible data for advanced AI models. You will be instrumental in integrating diverse global data sources, managing RAG indexes, and continuously enhancing our data infrastructure to support cutting-edge AI solutions and data-driven enterprise experiences.
You will be responsible for designing, building, and maintaining sophisticated data pipelines and ETL processes. This includes monitoring pipeline performance, integrating various structured and unstructured data sources globally, and identifying opportunities for new data integration. A key aspect will be developing and optimizing Retrieval-Augmented Generation (RAG) indexes for large-scale datasets, ensuring data quality, consistency, and compliance. You will also implement monitoring and alerting systems, and collaborate closely with AI/ML engineers, data scientists, and product teams to deliver comprehensive end-to-end solutions.
A Bachelor's or Master's degree in Computer Science Engineering with a minimum of 12 years of experience is required. Essential technical skills include proficiency in Python, PySpark, and SQL, alongside experience with data engineering tools such as Azure DataBricks, Azure DevOps, and VS Code. A strong understanding of REST APIs for data integration and hands-on experience with RAG architecture and vector databases are crucial. Familiarity with Generative AI concepts, LLM integration, cloud-based data platforms, and scalable data architecture is expected. Excellent communication, adaptability, and a customer-focused, collaborative approach are also vital.
HCLTech
IT Consulting