GCP Data Engineer

Persistent

5–8 yrs Chennai Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join our dynamic data engineering team as a GCP Data Engineer and play a pivotal role in shaping scalable data solutions on Google Cloud Platform. This position focuses on developing high-performance data pipelines, optimizing BigQuery data models, and seamlessly integrating diverse enterprise data sources to empower analytics and reporting across the organization.

We are an AI-led digital engineering partner with extensive industry experience, dedicated to helping clients anticipate future needs and achieve a competitive edge. Our work with leading global organizations, including numerous Fortune 50 companies, underscores our commitment to innovation and client success in a fast-paced environment. Recognized for our leadership and inclusion, we foster continuous growth and embrace cutting-edge technologies.

Responsibilities

Design, build, and maintain robust data pipelines utilizing Google Cloud Platform services. Optimize and manage BigQuery data models to support analytical and reporting requirements. Develop ETL/ELT processes and data ingestion frameworks for various data types. Integrate data from diverse enterprise applications into a central cloud data platform.

Craft and optimize complex SQL queries for data transformation and analysis. Create and maintain dashboards and reports using Looker Studio. Monitor data workflows, enhancing performance through effective schema design and workload optimization. Implement data quality frameworks and validation mechanisms.

Establish and maintain metadata management, data governance, and lineage tracking. Leverage Python for data processing, automation, and API integrations. Collaborate closely with stakeholders to understand and fulfill data requirements. Troubleshoot and resolve data-related issues, ensuring platform availability and performance.

Support data platform modernization efforts and maintain comprehensive technical documentation and best practices.

Qualifications

A seasoned Data Engineer with 5 to 8 years of experience, showcasing significant expertise in Google Cloud Platform. Proven hands-on experience with BigQuery, including schema design, query optimization, partitioning, and clustering. Strong proficiency in SQL for advanced data manipulation and analytics.

Solid programming skills in Python for data engineering tasks, automation, and integration development. Familiarity with key GCP services such as Cloud Storage, Pub/Sub, Cloud Functions, and Cloud Monitoring. A deep understanding of ETL/ELT methodologies and large-scale data processing frameworks.

Experience integrating APIs and enterprise source systems into cloud data platforms. Knowledge of data governance, metadata management, data lineage, and data quality best practices. Experience in building and supporting cloud-native analytics and reporting platforms, along with familiarity with BI tools like Looker Studio.

Understanding of dimensional modeling and data warehousing concepts is essential. Exposure to machine learning workflows and supporting AI/ML initiatives is advantageous. Excellent analytical, troubleshooting, and problem-solving capabilities, coupled with strong communication and stakeholder management skills. Ability to thrive in Agile and collaborative team settings, driven by innovation and continuous improvement.

Essential Skills

GCPBigQuerySQLPythonETL/ELTLooker StudioData WarehousingCloud StoragePub/SubCloud FunctionsCloud MonitoringAPI Integration

Good to Have

Machine LearningAI/ML

Highlights

  • Actively hiring

More Details

RoleGCP Data Engineer
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

GCP Data Engineer at Persistent | SkillMX | SkillMX