GCP Senior Technical Specialist (IN)
HCLTech
HCLTech
This role seeks a seasoned GCP Data Engineer to architect, construct, and refine robust data pipelines and platforms on Google Cloud. You'll manage extensive datasets, ensure high data integrity, and facilitate analytics and reporting across diverse business units. Responsibilities include designing and maintaining data infrastructure using GCP services to support data-driven decision-making.
Key responsibilities involve developing and optimizing scalable data pipelines, building ETL/ELT workflows, and orchestrating data processing using Cloud Composer. You will also be involved in data ingestion, transformation, and integration from various sources, alongside designing data models and BigQuery-based data warehouses.
Design, develop, and maintain scalable data pipelines on GCP using BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Build and manage ETL/ELT workflows for structured and unstructured data. Develop and orchestrate data pipelines using Cloud Composer (Airflow). Perform data ingestion, transformation, and integration across multiple source systems. Design and implement data models and BigQuery-based data warehouse solutions. Ensure data quality, validation, reconciliation, and governance. Monitor and optimize pipeline performance, cost, and scalability. Collaborate with data scientists, analysts, and business teams to deliver data solutions. Ensure security, compliance, and access control using IAM and best practices.
Requires 7+ years of experience in data engineering or cloud data platforms, with hands-on expertise in building data pipelines on GCP. Essential technical skills include strong experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer (Airflow), along with proficiency in Python and SQL. Candidates should possess a solid understanding of data warehousing, dimensional modeling, Medallion architecture, and data pipeline orchestration. Experience with batch and real-time data processing is crucial. Excellent problem-solving, analytical, communication, and collaboration skills are necessary, along with the ability to work within Agile/Scrum frameworks. A Bachelor's or Master's degree in Computer Science, Engineering, or a related field is required.
HCLTech
IT Consulting