Senior Data Engineer

Persistent

8–12 yrs Bengaluru Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Persistent is seeking a skilled Senior Data Engineer experienced in Oracle analytical platforms and Apache Spark to drive large-scale data modernization, migration, and analytics projects. This role requires expertise in building high-performance data pipelines, optimizing data processing, and integrating enterprise data with cloud analytics solutions.

Join a dynamic team that fosters innovation and collaboration. We offer a supportive work environment with opportunities for professional growth and development, working with industry leaders across various sectors.

Responsibilities

Design and optimize robust data processing solutions utilizing Apache Spark (PySpark/Scala) and Python. Develop and maintain scalable ETL/ELT pipelines for analytical and reporting needs. Optimize query performance, Spark jobs, and data processing pipelines for high-volume batch and near real-time workloads. Implement data integration, replication, and ingestion solutions using technologies like Oracle GoldenGate and Kafka.

Collaborate with application, data, and analytics teams to create scalable data models and processing frameworks. Drive performance tuning initiatives across Oracle, Spark, and distributed data processing environments. Oversee end-to-end implementation of data workflows, ensuring quality and timely distribution.

Qualifications

A minimum of 8 years in Data Engineering or a related field is essential, with strong hands-on experience in Apache Spark (PySpark/Scala) and Python. A deep understanding of Oracle databases for analytical workloads, including MS OLAP and Warehouses, is required. Proven ability to tune Spark applications, complex SQL queries, and large-scale ETL/ELT processes is crucial.

Solid data modeling skills and experience with enterprise-scale data integration technologies like Goldengate or CDC are necessary. Experience with cloud platforms such as GCP (Google BigQuery, Cloud Dataproc) or multi-cloud architectures is preferred. Experience supporting large-scale data migration and modernization programs is also advantageous.

Essential Skills

Apache SparkPythonOracleETLELTSQLData ModelingData IntegrationCDCPySparkScalaOracle PL/SQL

Good to Have

Exadata ServerGoogle BigQueryCloud DataprocCloud StoragePub/SubDataflowKafkaHadoopAzureOCIMulti-cloud

Highlights

  • Actively hiring

More Details

RoleSenior Data Engineer
IndustryIT Services and Consulting
DepartmentEngineering, Information Technology
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Services and Consulting

Senior Data Engineer at Persistent | SkillMX | SkillMX