Technical Specialist (IN)
HCLTech
HCLTech
We are seeking a skilled Technical Specialist to design and implement cutting-edge cloud-native data solutions within Google Cloud Platform (GCP) environments. This role focuses on building robust, secure, and scalable data provisioning, subsetting, and refresh capabilities for lower environments. You will leverage BigQuery and other GCP services to create efficient data pipelines that ensure data integrity and compliance with privacy and security standards.
Your key responsibilities will include designing and constructing automated provisioning pipelines for GCP and BigQuery lower environments. You will implement sophisticated metadata-driven workflows for data extraction, subsetting, transformation, loading, and refreshing. This role involves integrating TDM masking and synthetic data services for comprehensive data pipelines. You will develop advanced incremental and full refresh patterns with robust scheduling, restartability, reconciliation, and exception handling. Furthermore, you will optimize BigQuery SQL, partitioning, clustering, storage, and compute utilization, alongside implementing secure service integrations, access controls, encryption, logging, lineage, and audit evidence. Crucially, you will validate data accuracy and consistency post-provisioning and support environment onboarding, performance testing, and operational knowledge transfer.
The ideal candidate possesses 3-10 years of experience in data engineering or a related field. Proficiency in GCP, BigQuery, SQL, and Python is essential. Experience with data pipelines, orchestration, data subsetting, and automated refresh techniques is required. Strong knowledge of cloud security, Identity and Access Management (IAM), and data governance principles is expected. Familiarity with performance tuning and optimizing BigQuery performance is also a key requirement for this role.
HCLTech
IT Consulting