Senior Data Engineer

Persistent

5–8 yrs Pune Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join Persistent as a Senior Data Engineer and spearhead large-scale Google Cloud Platform (GCP) data transformation initiatives. This role offers a unique opportunity to leverage your deep understanding of modern data engineering practices and cloud-native data platforms within enterprise data modernization programs.

You will play a pivotal role in driving project delivery, collaborating with architects, and ensuring the successful implementation of advanced data solutions. This position is ideal for experienced professionals looking to make a significant impact in a growth-oriented, AI-led digital engineering environment.

Responsibilities

Lead and mentor offshore engineering teams in executing enterprise GCP data platform projects. Drive project planning, risk management, and stakeholder communications. Collaborate with architects to implement target-state GCP data architecture, including Medallion Architecture across all layers.

Oversee the development of scalable data ingestion, transformation, and semantic layer solutions using GCP-native services. Manage reusable data pipelines and frameworks, ensuring successful integration of data from diverse sources like SAP, CRM, APIs, and flat files. Implement data governance, lineage, metadata management, and quality controls.

Coordinate sprint planning, development reviews, and deployment activities. Leverage iAURA accelerators for data modeling and quality initiatives. Ensure adherence to engineering best practices, DataOps standards, and CI/CD processes. Prepare comprehensive project status reports and executive dashboards.

Qualifications

Possess 5 to 8 years of experience in project management, data engineering, cloud data platforms, or data modernization. Demonstrated success in managing enterprise-scale data engineering and cloud transformation projects is essential.

Develop a strong command of the Google Cloud Platform (GCP) ecosystem, including hands-on experience with BigQuery, Dataflow, Dataproc, Cloud Composer, Pub/Sub, and Cloud Storage. A solid understanding of enterprise data architecture, data warehousing, and Lakehouse platforms is required.

Experience implementing Medallion Architecture and integrating various data sources such as SAP, CRM, and APIs is crucial. Expertise in Python and SQL for data engineering, coupled with proficiency in Agile methodologies and CI/CD pipelines, is expected. Excellent stakeholder management, communication, and leadership skills are vital.

Essential Skills

GCPPythonSQLBigQueryDataflowDataprocCloud ComposerPub/SubCloud StorageSAP integrationCRM integrationAPI integrationAgile methodologiesScrumCI/CDDataOpsDevOps

Good to Have

iAuraGCP Professional Data Engineer Certification

Highlights

  • Actively hiring

More Details

RoleSenior Data Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Senior Data Engineer at Persistent | SkillMX | SkillMX