GCP Senior Data Engineer (IN)
HCLTech
HCLTech
Join our dynamic team as a Senior Data Engineer specializing in Google Cloud Platform (GCP). This role is pivotal for constructing and refining robust data ecosystems, empowering data-driven strategies across the enterprise. You will architect high-performance data pipelines, ensure data integrity, and collaborate closely with data scientists, analysts, and business units to translate complex requirements into efficient, scalable data solutions.
This position offers the chance to work on cutting-edge Enterprise Data & AI projects, contributing significantly to our analytics initiatives.
Architect, build, and maintain scalable, high-performance data pipelines utilizing GCP services such as Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore.
Develop and manage modern data architectures for both batch and real-time processing, implementing reusable frameworks for data ingestion and transformation.
Optimize data storage and query performance, focusing on cost-efficiency and scalability across GCP data platforms.
Implement rigorous data quality checks, validation, and monitoring mechanisms, ensuring compliance with governance, security, and industry standards.
Collaborate with stakeholders to understand business needs and deliver actionable insights through robust data solutions.
Monitor, troubleshoot, and ensure the high availability and performance of data pipelines, establishing comprehensive logging and alerting frameworks.
Provide technical leadership and mentorship to junior engineers, promoting best practices in coding, architecture, and deployment.
Stay abreast of GCP innovations and data engineering advancements, proactively recommending system enhancements.
Possess a Bachelor’s or Master’s degree in Computer Science, IT, or a related field, coupled with 5-6 years of dedicated data engineering experience, with a strong emphasis on GCP.
Demonstrate hands-on proficiency with GCP data services including Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore.
Exhibit expertise in ETL/ELT processes, data warehousing, and data modeling, alongside strong programming skills in Python and SQL.
Key competencies include strong analytical and problem-solving abilities, meticulous attention to data accuracy, and the capacity to thrive both independently and within cross-functional teams. Excellent communication and stakeholder management skills are essential.
HCLTech
IT Consulting