Data Engineer

Persistent

3–5 yrs Indore Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Persistent is an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner. We empower clients with deep technical expertise and industry insights to anticipate future trends and gain a competitive edge. Our solutions are trusted by industry leaders across finance, technology, and healthcare. With a commitment to client success and agility, we consistently drive growth and innovation. Recognized for leadership and inclusion, our global team of over 29,500 professionals operates in 21 countries, enabling market leaders to transform their industries.

We are seeking a skilled GCP Data Engineer with 3 to 5 years of experience to design, develop, and maintain scalable data solutions on Google Cloud Platform. The ideal candidate will possess strong cloud-native data engineering, ETL/ELT pipeline development, Python programming, and data warehousing expertise. You will be instrumental in building robust data platforms that support analytics, reporting, and business intelligence. Collaborating closely with data analysts, data scientists, and cross-functional teams, your contributions will ensure the delivery of scalable, high-quality, and secure data solutions.

Responsibilities

Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform (GCP). Implement batch and streaming data ingestion frameworks utilizing GCP services like Dataflow, Dataproc, Pub/Sub, and Composer. Build, manage, and optimize cloud-based data warehouses and data lakes using BigQuery and Cloud Storage. Develop efficient Python-based solutions for data processing, transformation, and automation. Optimize data pipelines for peak performance, scalability, reliability, and cost-effectiveness. Extract, transform, and load data from diverse sources including APIs, databases, flat files, and streaming platforms. Process structured, semi-structured, and unstructured datasets to meet business requirements. Ensure data quality, integrity, governance, and compliance across all data pipelines and platforms. Collaborate with data analysts, data scientists, architects, and business stakeholders to deliver data-driven solutions. Troubleshoot and resolve data pipeline performance issues and production incidents. Document data workflows, schemas, architectures, and processes for maintainability and knowledge sharing. Participate in code reviews and contribute to engineering best practices and standards.

Qualifications

Possess 3 to 5 years of hands-on experience in Data Engineering and cloud-based data platform development. Demonstrate strong experience with Google Cloud Platform (GCP) services, including BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub, and Composer. Exhibit strong programming expertise in Python for data engineering, automation, and transformation tasks. Show a solid understanding of SQL development, query optimization, and performance tuning techniques. Have hands-on experience designing and implementing ETL/ELT pipelines. Be experienced with both batch and real-time streaming data processing. Possess a strong understanding of data modeling, schema design, and data warehousing principles. Be familiar with data formats such as Parquet, Avro, JSON, and CSV. Demonstrate experience integrating data from APIs, databases, and external systems. Have knowledge of cloud-native architecture patterns and modern data engineering practices. Understand data quality frameworks, monitoring, and governance principles. Exhibit strong analytical, troubleshooting, and problem-solving skills. Experience working within Agile development environments is preferred. Possess excellent communication and collaboration skills for cross-functional teamwork.

Essential Skills

GCPData EngineeringETL/ELTPythonData WarehousingBigQueryCloud StorageDataflowDataprocPub/SubComposerSQLData ModelingSchema DesignBatch ProcessingStreaming DataAPI IntegrationData QualityData GovernanceAgile

Good to Have

Generative AI Tools

Highlights

  • Actively hiring

More Details

RoleData Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Data Engineer at Persistent | SkillMX | SkillMX