GCP Data Lead (IN)
HCLTech
HCLTech
Join a dynamic team as a Senior Data Engineer with extensive Google Cloud Platform (GCP) expertise. This pivotal role focuses on designing, building, and enhancing scalable data ecosystems to power data-driven decision-making across the enterprise. You will craft high-performance data pipelines, ensure data integrity, and champion analytics initiatives.
Collaboration is key; you'll work closely with data scientists, analysts, and business units to transform complex business needs into robust and effective data solutions.
Design, construct, and maintain high-performance, scalable data pipelines within the GCP environment. Develop and manage contemporary data architectures supporting both batch and real-time data processing. Implement standardized frameworks for data ingestion and transformation.
Utilize core GCP services like Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore to build efficient and scalable data integration workflows.
Optimize data storage and query performance, focusing on cost efficiency, tuning, and scalable design. Implement comprehensive data quality checks, validation mechanisms, and monitoring. Ensure strict adherence to data governance, security, and compliance standards.
Collaborate with stakeholders to understand requirements and deliver actionable insights. Monitor and troubleshoot data pipelines for high availability and performance, implementing robust logging and alerting.
Provide technical leadership and mentorship, promoting best practices in coding and architecture. Stay abreast of GCP advancements and data engineering innovations to proactively suggest system improvements.
A Bachelor's or Master's degree in Computer Science, IT, or a related field is required, complemented by 8+ years of hands-on data engineering experience, with a significant focus on GCP.
Essential technical skills include strong proficiency in Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Expertise in ETL/ELT processes, data warehousing, and data modeling is crucial. Solid programming abilities in Python and SQL are mandatory.
Key competencies encompass strong analytical and problem-solving capabilities, meticulous attention to detail, and the ability to work autonomously and collaboratively. Excellent communication and stakeholder management skills are vital for success in this role.
HCLTech
IT Consulting