GCP Senior Data Engineer (IN)

HCLTech

5–6 yrs India Full Time Remote
HCLTech logo
Posted : today
Actively hiring

Job description

Seeking a Senior Data Engineer with profound expertise in Google Cloud Platform (GCP) to architect, develop, and refine robust data ecosystems. This pivotal role empowers data-driven decision-making by creating high-performance data pipelines, ensuring data integrity, and supporting organization-wide analytics. Collaborate closely with cross-functional teams, including data scientists, analysts, and business units, to translate complex business needs into sophisticated data solutions.

Drive innovation and efficiency in data management and integration, contributing significantly to the company's analytical capabilities.

Responsibilities

Design, build, and maintain scalable, high-performance data pipelines on GCP, managing modern data architectures for both batch and real-time processing. Implement reusable frameworks for standardized data ingestion and transformation. Leverage GCP services like Dataflow, BigQuery, Pub/Sub, Cloud Storage, and Cloud SQL/Firestore to build efficient data integration workflows. Optimize storage and query performance, ensuring cost-effectiveness and scalability. Implement rigorous data quality checks, validation, and monitoring. Collaborate with stakeholders to deliver actionable insights and translate business challenges into technical data solutions. Monitor, troubleshoot, and ensure high availability of data pipelines, implementing logging and alerting. Provide technical leadership and mentorship to junior engineers, driving best practices. Stay abreast of GCP innovations and proactively recommend system enhancements.

Qualifications

Possess a Bachelor’s or Master’s degree in Computer Science, IT, or a related discipline, coupled with 5-6 years of dedicated data engineering experience, with a strong emphasis on GCP. Must have hands-on proficiency with Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Expertise in ETL/ELT processes, data warehousing, and data modeling is essential. Strong programming skills in Python and SQL are required. Key competencies include strong analytical and problem-solving abilities, meticulous attention to detail, and excellent communication and stakeholder management skills. Experience with Big Data technologies, GCP certifications, Machine Learning/AI workflows, and DevOps practices are advantageous.

Essential Skills

DataflowBig QueryPub/SubCloud StorageCloud SQLFire storeETLELTData warehousingData modelingPythonSQLData pipeline architectureData integrationData storage optimizationData qualityData securityMonitoringTroubleshooting

Good to Have

GCP CertificationsBig Data technologiesHadoopSparkMachine LearningAI workflowsDevOps practicesCI/CD pipelines

Highlights

  • Actively hiring

More Details

RoleGCP Senior Data Engineer (IN)
Employment TypeFull Time, Remote

About the Company

HCLTech logo

HCLTech

IT Consulting

GCP Senior Data Engineer (IN) at HCLTech | SkillMX | SkillMX