GCP Data Lead (IN)
HCLTech
HCLTech
Seeking a Senior Data Engineer with extensive Google Cloud Platform (GCP) expertise to architect, develop, and optimize sophisticated data ecosystems. This role is pivotal in driving data-informed decisions by creating high-performance data pipelines, ensuring data integrity, and supporting broad analytics initiatives.
You will collaborate with diverse teams, including data scientists, analysts, and business units, to translate complex business needs into resilient and effective data solutions.
Design, build, and maintain robust, scalable data pipelines on GCP, supporting both batch and real-time processing. Develop and manage modern data architectures, implementing standardized ingestion and transformation frameworks.
Leverage GCP services like Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore to construct efficient and scalable data integration workflows. Optimize data storage and query performance, focusing on cost-efficiency and scalability.
Implement rigorous data quality checks, validation, and monitoring. Ensure strict adherence to data governance, security, and compliance standards.
Partner with stakeholders to understand requirements and deliver actionable insights. Monitor, troubleshoot, and ensure high availability of data pipelines, implementing comprehensive logging and alerting.
Provide technical leadership and mentorship, driving best practices in coding and architecture. Stay current with GCP advancements and proactively recommend system enhancements.
Requires a Bachelor's or Master's degree in Computer Science, IT, or a related discipline, coupled with 8+ years of data engineering experience, with a significant focus on GCP.
Core technical proficiencies include Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, Firestore, ETL/ELT processes, data warehousing, data modeling, and strong programming skills in Python and SQL.
Key competencies involve excellent analytical and problem-solving abilities, meticulous attention to detail, capacity for independent work within cross-functional teams, and strong communication and stakeholder management skills.
Preferred qualifications include GCP Professional Data Engineer or Cloud Architect certifications, experience with Big Data technologies like Hadoop and Spark, exposure to ML/AI workflows, and familiarity with DevOps and CI/CD practices.
HCLTech
IT Consulting