Senior Technical Lead (IN)
HCLTech
HCLTech
Join our team as a GCP Data Engineer to architect and implement robust data pipelines on Google Cloud Platform. This role focuses on building scalable ingestion, transformation, and data product solutions, leveraging cutting-edge cloud technologies. You will play a key part in optimizing data flow from raw sources to refined data products.
This is an excellent opportunity for an experienced professional to contribute to critical data infrastructure and drive innovation in data engineering practices.
Develop comprehensive data pipelines, progressing from Raw through Bronze, Silver, and Gold layers. Implement efficient CDC, batch, and streaming ingestion frameworks to handle diverse data sources.
Build sophisticated transformations using Dataform and design effective BigQuery solutions. Develop metadata-driven frameworks and implement robust data quality (DQ) validations.
Support CI/CD processes, performance tuning, monitoring, and seamless production deployments. Showcase expertise in prompt engineering with AI tools to translate business needs into technical artifacts.
Possess 5-8 years of professional experience in data engineering, with a strong focus on Google Cloud Platform (GCP). Demonstrated expertise in BigQuery, Dataform, Cloud Composer, Dataflow, and Pub/Sub is essential.
Proficiency in SQL and Python is required. Experience with Dataplex or Data Governance is a significant advantage.
Candidates should be adept at prompt engineering using AI tools and capable of converting business requirements into technical solutions. This onsite role is based in Bangalore, India.
HCLTech
IT Consulting