GCP Senior Technical Specialist (IN)

HCLTech

7–10 yrs India Full Time Remote
HCLTech logo
Posted : today
Actively hiring

Job description

This role seeks a seasoned GCP Data Engineer to architect, construct, and refine robust data pipelines and platforms on Google Cloud. You'll manage extensive datasets, ensure high data integrity, and facilitate analytics and reporting across diverse business units. Responsibilities include designing and maintaining data infrastructure using GCP services to support data-driven decision-making.

Key responsibilities involve developing and optimizing scalable data pipelines, building ETL/ELT workflows, and orchestrating data processing using Cloud Composer. You will also be involved in data ingestion, transformation, and integration from various sources, alongside designing data models and BigQuery-based data warehouses.

Responsibilities

Design, develop, and maintain scalable data pipelines on GCP using BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Build and manage ETL/ELT workflows for structured and unstructured data. Develop and orchestrate data pipelines using Cloud Composer (Airflow). Perform data ingestion, transformation, and integration across multiple source systems. Design and implement data models and BigQuery-based data warehouse solutions. Ensure data quality, validation, reconciliation, and governance. Monitor and optimize pipeline performance, cost, and scalability. Collaborate with data scientists, analysts, and business teams to deliver data solutions. Ensure security, compliance, and access control using IAM and best practices.

Qualifications

Requires 7+ years of experience in data engineering or cloud data platforms, with hands-on expertise in building data pipelines on GCP. Essential technical skills include strong experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer (Airflow), along with proficiency in Python and SQL. Candidates should possess a solid understanding of data warehousing, dimensional modeling, Medallion architecture, and data pipeline orchestration. Experience with batch and real-time data processing is crucial. Excellent problem-solving, analytical, communication, and collaboration skills are necessary, along with the ability to work within Agile/Scrum frameworks. A Bachelor's or Master's degree in Computer Science, Engineering, or a related field is required.

Essential Skills

GCP Data EngineeringBigQueryDataflowData PipelinesPythonSQLAirflowCI/CDData warehousing (DWH)Dimensional modelingMedallion architectureData pipeline orchestrationData pipeline schedulingBatch processingReal-time data processingGoogle Cloud Platform (GCP)Pub/SubCloud StorageCloud ComposerDataformETL/ELT pipelinesData modeling

Good to Have

Healthcare domainSparkML integrationGoogle BigQuery certificationSQL certificationPython certificationGoogle Dataflow certificationCA Erwin Data Modeler certification

Highlights

  • Actively hiring

More Details

RoleGCP Senior Technical Specialist (IN)
DepartmentData Engineering
Employment TypeFull Time, Remote

About the Company

HCLTech logo

HCLTech

IT Consulting

GCP Senior Technical Specialist (IN) at HCLTech | SkillMX | SkillMX