Senior Technical Lead (IN)

HCLTech

1+ yrs India Full Time Work from office
HCLTech logo
Posted : today
Actively hiring

Job description

Seeking a Senior Technical Lead to drive data engineering initiatives. This role requires a solid understanding of Google Cloud Platform (GCP) and extensive experience in building robust data pipelines.

Ideal candidates will possess hands-on expertise in ETL/ELT processes for both batch and real-time data. A strong command of Python and SQL is essential, alongside practical experience with dbt for data transformation.

Experience with containerization using Docker and Kubernetes (GKE) is crucial. Proficiency in Git for version control and CI/CD implementation, as well as IaC tools like Terraform, will be highly valued.

Responsibilities

Lead and develop data engineering solutions on Google Cloud Platform.

Design and implement ETL/ELT pipelines for batch and real-time data processing.

Utilize BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataproc, and GCS for data management.

Monitor and log operations using Google Cloud Monitoring and Cloud Logging.

Develop data transformation models using dbt.

Deploy containerized applications on GKE and manage Kubernetes namespaces.

Implement robust Git-based source control, code reviews, and CI/CD pipelines.

Manage infrastructure as code using Terraform and deployment tools like Harness.

Qualifications

Minimum 1 year of experience in Data Engineering with a strong grasp of GCP architecture and services.

Proven hands-on experience in ETL/ELT development for batch and real-time data.

Familiarity with BigQuery, Dataflow, Cloud Composer, Pub/Sub, Dataproc, and GCS.

Experience with Google Cloud Monitoring and Cloud Logging.

Proficiency in Python and SQL is a must.

Hands-on experience with dbt for data transformation and modeling.

Experience with GKE, Kubernetes namespaces, and Docker container deployment.

Solid understanding of Git-based source control, code reviews, version management, and CI/CD pipelines.

Experience with Terraform for Infrastructure as Code and deployment tools like Harness.

Excellent troubleshooting, debugging, and production support skills.

Essential Skills

Data EngineeringGoogle Cloud Platform (GCP)ETL/ELTBigQueryDataflowCloud ComposerPub/SubDataprocGCSGoogle Cloud MonitoringCloud LoggingPythonSQLdbtGKEKubernetesDockerGitCI/CDTerraformHarness

Highlights

  • Actively hiring

More Details

RoleSenior Technical Lead (IN)
Employment TypeFull Time, Work from office

About the Company

HCLTech logo

HCLTech

IT Consulting

Senior Technical Lead (IN) at HCLTech | SkillMX | SkillMX