GCP Senior Data Lead (IN)

HCLTech

8+ yrs India Full Time Hybrid (office + remote)
HCLTech logo
Posted : today
Actively hiring

Job description

Seeking a seasoned Data Engineer with profound Google Cloud Platform (GCP) expertise to architect, construct, and refine robust data ecosystems. This pivotal role empowers data-driven strategies through the development of high-performance data pipelines, ensuring unwavering data reliability, and championing enterprise-wide analytics. Collaboration with diverse teams, including data scientists, analysts, and business units, is key to translating intricate business needs into sophisticated, dependable data solutions.

This position offers a dynamic environment where your contributions directly impact the organization's ability to make informed decisions through advanced data utilization. You'll be instrumental in shaping the future of our data infrastructure.

Responsibilities

Design, build, and maintain scalable, high-performance data pipelines within the GCP environment. Develop and manage contemporary data architectures for both batch and real-time processing. Implement standardized, reusable frameworks for efficient data ingestion and transformation.

Utilize core GCP services like Dataflow, Big Query, Pub/Sub, Cloud Storage, and Cloud SQL/Firestore. Construct and optimize data integration workflows for maximum efficiency and scalability. Focus on optimizing storage and query performance across all GCP data platforms, ensuring cost-effectiveness, fine-tuning for performance, and scalable data design.

Establish stringent data quality checks, validation mechanisms, and monitoring. Uphold strict adherence to data governance, security, and compliance mandates. Partner closely with data scientists, analysts, and business stakeholders to grasp requirements and deliver actionable insights. Transform complex business challenges into elegant technical data solutions.

Monitor, troubleshoot, and guarantee the high availability and performance of data pipelines. Implement comprehensive logging, alerting, and observability frameworks. Provide technical leadership and mentorship to junior engineers, fostering best practices in coding, architecture, and deployment. Stay abreast of the latest GCP innovations and data engineering advancements, proactively proposing enhancements for system performance and scalability.

Qualifications

A Bachelor's or Master's degree in Computer Science, IT, or a related discipline is required. A minimum of 8 years of experience in data engineering, with a significant emphasis on GCP, is essential.

Mandatory technical skills include strong hands-on experience with Dataflow, Big Query, Pub/Sub, Cloud Storage, Cloud SQL, and Firestore. Expertise in ETL/ELT processes, data warehousing, and data modeling is critical. Proficiency in Python and SQL programming is a must.

Key competencies for this role encompass strong analytical and problem-solving abilities, meticulous attention to detail, and a commitment to data accuracy. The ability to work autonomously and within cross-functional teams is vital, alongside excellent communication and stakeholder management skills. GCP Certifications, experience with Big Data technologies (Hadoop, Spark), exposure to ML/AI workflows, and familiarity with DevOps practices are highly desirable.

Essential Skills

DataflowBig QueryPub/SubCloud StorageCloud SQLFire storeETLELTData warehousingData modelingPythonSQLData Pipeline ArchitectureData IntegrationData Storage OptimizationData QualityData SecurityProgrammingStakeholder CollaborationMonitoringTroubleshootingLeadershipMentoring

Good to Have

GCP CertificationsBig Data technologiesHadoopSparkMachine LearningAI workflowsDevOps practicesCI/CD pipelines

Highlights

  • Actively hiring

More Details

RoleGCP Senior Data Lead (IN)
Employment TypeFull Time, Hybrid (office + remote)

About the Company

HCLTech logo

HCLTech

IT Consulting

GCP Senior Data Lead (IN) at HCLTech | SkillMX | SkillMX