Technical Lead (IN)
HCLTech
HCLTech
Seeking a skilled Technical Lead to drive the design, development, and maintenance of robust, scalable data pipelines. This role is crucial for ingesting, processing, and transforming data from diverse enterprise and eCommerce sources. You will be instrumental in building high-quality data products that empower reporting, analytics, and business intelligence initiatives, ensuring trusted business data through rigorous validation and quality monitoring. Embrace modern engineering practices and AI-enabled tools to enhance delivery efficiency and solution quality. This position offers the opportunity to collaborate with global teams and contribute to enterprise-wide data strategies.
Key responsibilities include architecting and implementing scalable data pipelines using AWS, Databricks, dbt, Spark, Python, and SQL. Develop and maintain reusable data products aligned with Medallion Architecture principles. Collaborate with stakeholders to translate requirements into technical solutions, and perform data profiling and quality checks. Support analytical and reporting needs by preparing datasets for tools like Power BI. Analyze data trends to drive operational improvements and contribute to data governance best practices. Troubleshoot pipeline issues and partner with engineering teams to ensure solutions meet enterprise standards. Continuously evaluate and adopt cutting-edge engineering practices and AI productivity tools.
Candidates should possess 4+ years of experience as a Data Engineer, with strong proficiency in SQL for data analysis, transformation, and optimization. Proven hands-on experience in developing scalable data pipelines using Python and Apache Spark is essential. Familiarity with Databricks for large-scale data processing and dbt for data transformation frameworks is required. A solid understanding of data warehousing concepts, dimensional modeling, Medallion Architecture, and modern data platform design is necessary. Experience building trusted datasets and semantic models for business intelligence, including Power BI, is expected. Familiarity with source control, CI/CD practices, and automated deployment processes is also important. Experience leveraging AI-assisted development tools and understanding responsible AI practices is highly valued. Strong analytical, problem-solving, collaboration, and communication skills are critical for success in this role.
HCLTech
IT Consulting