GCP Senior Data Engineer (IN)
HCLTech
HCLTech
Seeking a Senior Data Engineer with profound expertise in Google Cloud Platform (GCP) to architect, develop, and refine robust data ecosystems. This pivotal role empowers data-driven decision-making by creating high-performance data pipelines, ensuring data integrity, and supporting organization-wide analytics. Collaborate closely with cross-functional teams, including data scientists, analysts, and business units, to translate complex business needs into sophisticated data solutions.
Drive innovation and efficiency in data management and integration, contributing significantly to the company's analytical capabilities.
Design, build, and maintain scalable, high-performance data pipelines on GCP, managing modern data architectures for both batch and real-time processing. Implement reusable frameworks for standardized data ingestion and transformation. Leverage GCP services like Dataflow, BigQuery, Pub/Sub, Cloud Storage, and Cloud SQL/Firestore to build efficient data integration workflows. Optimize storage and query performance, ensuring cost-effectiveness and scalability. Implement rigorous data quality checks, validation, and monitoring. Collaborate with stakeholders to deliver actionable insights and translate business challenges into technical data solutions. Monitor, troubleshoot, and ensure high availability of data pipelines, implementing logging and alerting. Provide technical leadership and mentorship to junior engineers, driving best practices. Stay abreast of GCP innovations and proactively recommend system enhancements.
Possess a Bachelor’s or Master’s degree in Computer Science, IT, or a related discipline, coupled with 5-6 years of dedicated data engineering experience, with a strong emphasis on GCP. Must have hands-on proficiency with Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Expertise in ETL/ELT processes, data warehousing, and data modeling is essential. Strong programming skills in Python and SQL are required. Key competencies include strong analytical and problem-solving abilities, meticulous attention to detail, and excellent communication and stakeholder management skills. Experience with Big Data technologies, GCP certifications, Machine Learning/AI workflows, and DevOps practices are advantageous.
HCLTech
IT Consulting