GCP Data Lead (IN)
HCLTech
HCLTech
Join our team as a Senior Data Engineer with extensive Google Cloud Platform (GCP) expertise. You will be instrumental in architecting, developing, and optimizing sophisticated data ecosystems to drive data-informed decision-making across the enterprise. This role involves building high-performance data pipelines and ensuring data integrity to support crucial analytics initiatives.
Collaborate closely with diverse teams, including data scientists, analysts, and business units, to transform complex business requirements into resilient and effective data solutions. Your work will directly influence the company's analytical capabilities and strategic direction.
Design, construct, and maintain highly scalable and performant data pipelines within GCP. Develop and manage modern data architectures for both batch and real-time data processing.
Leverage key GCP services like Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore to build efficient data integration workflows.
Enhance storage and query performance on GCP data platforms, focusing on cost optimization and scalability.
Implement comprehensive data quality checks, validation frameworks, and monitoring systems, ensuring compliance with data governance and security standards.
Partner with stakeholders to translate business challenges into technical data solutions.
Monitor, troubleshoot, and maintain high availability for data pipelines, establishing robust logging and alerting mechanisms.
Provide technical guidance and mentorship to junior engineers, promoting best practices in development and deployment.
Continuously explore GCP advancements and data engineering trends to propose system enhancements.
Possess strong hands-on experience with GCP services including Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Demonstrate expertise in ETL/ELT processes, data warehousing, and data modeling.
Proficiency in programming languages such as Python and SQL is essential. Key competencies include exceptional analytical and problem-solving abilities, meticulous attention to detail, and the capacity to work both independently and collaboratively within cross-functional teams.
Excellent communication and stakeholder management skills are vital for success in this role. A Bachelor's or Master's degree in Computer Science, IT, or a related field, coupled with 8+ years of data engineering experience heavily focused on GCP, is required. A Google Cloud Professional Data Engineer certification is highly advantageous.
HCLTech
IT Consulting