Technical Lead (IN)

HCLTech

4+ yrs Pune Full Time Work from office
HCLTech logo
Posted : today
Actively hiring

Job description

Join our team as a Data Engineer in Pune, working exclusively from the office. This role focuses on building and maintaining robust data pipelines using cutting-edge technologies like SQL, Python, AWS, and Databricks. You will play a key part in transforming raw data into valuable insights that drive business decisions.

This position offers an excellent opportunity to work with diverse enterprise and eCommerce data sources. You'll contribute to the development of high-quality data products essential for reporting, analytics, and business intelligence initiatives, ensuring data integrity and scalability throughout the process.

Responsibilities

Key responsibilities include designing, developing, and maintaining scalable data pipelines for ingesting and transforming data from various sources. You will build and support ELT/ETL workflows utilizing AWS, Databricks, dbt, Spark, Python, and SQL. Developing reliable, reusable, and high-quality data products for reporting and analytics is crucial. The role involves implementing data transformation and modeling aligned with Medallion Architecture principles and collaborating with stakeholders to translate requirements into technical solutions.

Additional duties encompass data profiling, validation, quality monitoring, and preparing datasets for Power BI. Troubleshooting pipeline issues, performance bottlenecks, and data quality concerns will be part of your daily work. You will also partner with engineering and business teams to ensure solutions align with enterprise architecture, security, and governance standards.

Qualifications

We are seeking candidates with a strong foundation in data engineering, evidenced by at least 4 years of relevant experience. Essential skills include proficiency in SQL, Python, AWS, and Databricks. Hands-on experience with Apache Spark, dbt, ETL/ELT development, and data modeling is required. Familiarity with data warehousing, Medallion Architecture, Power BI, and modern data platforms is also expected.

A solid understanding of data quality, governance, metadata management, lineage, CI/CD, and deployment processes is necessary. Candidates must possess strong analytical, problem-solving, collaboration, and communication skills. Experience with eCommerce data is desired, along with exposure to Scala, Machine Learning, AI, or real-time/streaming architectures and Agile methodologies.

Essential Skills

SQLPythonAWSDatabricksApache SparkdbtETL/ELT DevelopmentData ModelingData WarehousingMedallion ArchitecturePower BIData QualityData GovernanceMetadata ManagementLineageCI/CDDeployment ProcessesAnalytical SkillsProblem-SolvingCollaborationCommunication Skills

Good to Have

eCommerce DataDigital Commerce DataScalaMachine LearningAI-driven SolutionsReal-time ArchitecturesStreaming ArchitecturesCloud-native Data EngineeringAgile Methodologies

Highlights

  • Actively hiring

More Details

RoleTechnical Lead (IN)
DepartmentData Engineering
Employment TypeFull Time, Work from office

About the Company

HCLTech logo

HCLTech

IT Consulting

Technical Lead (IN) at HCLTech | SkillMX | SkillMX