GCP Senior Data Engineer (IN)
HCLTech
HCLTech
We are seeking a Senior Data Engineer with profound expertise in Google Cloud Platform (GCP) to architect, develop, and refine robust data ecosystems. This pivotal role is instrumental in empowering data-informed decision-making by building high-performance data pipelines, ensuring data integrity, and supporting organization-wide analytics.
You will collaborate closely with diverse teams, including data scientists, analysts, and business units, to transform intricate business requirements into resilient and scalable data solutions.
Architect, construct, and maintain high-performance, scalable data pipelines on GCP. Develop and manage contemporary data architectures for both batch and real-time data processing. Implement reusable frameworks to standardize data ingestion and transformation workflows. Optimize storage and query performance across GCP data platforms. Ensure cost-effectiveness, performance tuning, and scalable data design. Implement rigorous data quality checks, validation, and monitoring. Uphold data governance, security, and compliance standards. Collaborate with stakeholders to understand needs and deliver actionable insights. Monitor, troubleshoot, and ensure the high availability and performance of data pipelines. Provide technical leadership and mentor junior engineers. Drive best practices in coding, architecture, and deployment. Stay abreast of GCP innovations and data engineering advancements.
A Bachelor’s or Master’s degree in Computer Science, IT, or a related discipline. Possess 5-6 years of hands-on experience in data engineering, with a strong focus on GCP. Demonstrate core technical proficiencies in Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Exhibit expertise in ETL/ELT processes, data warehousing, and data modeling. Possess strong programming skills in Python and SQL. Display excellent analytical and problem-solving capabilities. Show a keen attention to detail and a commitment to data accuracy. Ability to work effectively both independently and within cross-functional teams. Excellent communication and stakeholder management skills are essential.
HCLTech
IT Consulting