Senior Technical Lead (IN)

HCLTech

8+ yrs India Full Time Hybrid (office + remote)
HCLTech logo
Posted : today
Actively hiring

Job description

Join our team as a Senior GCP Data Engineer and leverage your extensive experience to design, build, and optimize sophisticated data platforms on Google Cloud. This role is crucial for transforming complex data into reliable, secure, and analytics-ready assets. We seek a leader with strong production engineering discipline and the ability to translate business needs into resilient cloud solutions.

This position offers an opportunity to work with cutting-edge technologies and make a significant impact on our data strategy.

Responsibilities

Architect and develop scalable batch and near-real-time data pipelines on GCP. Build robust ETL/ELT solutions using Python, PySpark, and SQL, leveraging services like BigQuery, Dataflow, and Pub/Sub. Design diverse data models (dimensional, normalized, lakehouse) and optimize Spark jobs and BigQuery queries for maximum efficiency. Implement comprehensive data quality controls, security standards, and automated testing within CI/CD pipelines.

Troubleshoot production issues, conduct root-cause analysis, and implement lasting solutions. Collaborate with cross-functional teams to translate requirements into maintainable solutions. Provide technical leadership, mentor team members, and contribute to delivery planning.

Qualifications

A minimum of 8 years of professional experience in data engineering, data warehousing, big data, or cloud data platform development is required. Demonstrated production experience with Google Cloud Platform is essential. Advanced proficiency in Python for data processing and automation, along with deep expertise in PySpark and Apache Spark for large-scale distributed processing, is critical. Expert-level SQL skills for complex queries, optimization, and data modeling are necessary.

Hands-on experience with key GCP services such as BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, and Cloud Composer or Apache Airflow is mandatory. A strong understanding of ETL/ELT patterns, batch and streaming architectures, and data lake/warehouse/lakehouse concepts is expected. Familiarity with Git, CI/CD, logging, monitoring, and production support is also required.

A Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field, or equivalent practical experience, is needed. Strong analytical, problem-solving, communication, and technical leadership skills are paramount.

Essential Skills

GCPPythonPySparkSQLBigQueryCloud StorageDataprocDataflowPub/SubCloud ComposerApache AirflowETLELTData ModelingGitCI/CDData WarehousingBig DataCloud Data PlatformsTechnical LeadershipData EngineeringData PipelinesStreaming ArchitecturesBatch ArchitecturesData LakesData WarehousesLakehousesOrchestrationAutomated TestingLoggingMonitoringIncident ManagementProduction SupportGCP IAMNetworkingEncryptionData GovernanceData PrivacySecure Data ArchitectureProblem-SolvingStakeholder CommunicationDocumentation

Highlights

  • Actively hiring

More Details

RoleSenior Technical Lead (IN)
Employment TypeFull Time, Hybrid (office + remote)

About the Company

HCLTech logo

HCLTech

IT Consulting

Senior Technical Lead (IN) at HCLTech | SkillMX | SkillMX