Data Engineer

Persistent

5–8 yrs Bengaluru Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join our dynamic team as an experienced Data Engineer, focusing on Oracle-based analytical platforms and Apache Spark. You will play a crucial role in large-scale data modernization, migration, and analytics projects. We seek individuals with a proven track record in developing high-performance data pipelines and optimizing complex data processing workloads.

Our company is an AI-led digital engineering partner, committed to delivering innovative solutions. We collaborate with leading global organizations, empowering them to achieve a competitive edge. We foster a culture of continuous growth and recognize top talent with various awards.

Responsibilities

Design, develop, and optimize advanced data processing solutions utilizing Apache Spark (PySpark/Scala) and Python. Construct and maintain robust ETL/ELT pipelines for comprehensive analytical and reporting needs. Enhance query performance, Spark jobs, and end-to-end data processing for high-volume batch and near real-time scenarios.

Implement data integration, replication, and ingestion using technologies like Oracle GoldenGate, Kafka, and CDC frameworks. Partner with application, data, and analytics teams to architect scalable data models and processing frameworks. Lead performance tuning efforts across Oracle, Spark, and distributed data environments.

Qualifications

A minimum of 5 to 8 years of dedicated experience in Data Engineering or a comparable field is required. Demonstrable hands-on expertise with Spark (PySpark and/or Scala) and Python is essential. A deep comprehension of Oracle databases for OLAP, data warehousing, and analytical tasks is crucial.

Proven ability to tune and optimize Spark applications, complex SQL queries, large-scale ETL/ELT processes, and high-volume batch processing. Strong data modeling skills are necessary. Experience with Goldengate, Kafka, or similar enterprise-scale data integration technologies is beneficial. Familiarity with Exadata Server and large-scale Oracle analytics platforms is an advantage.

Experience with GCP services such as Google Big Query (GBQ), Cloud Dataproc, Cloud Storage, Pub/Sub, and Dataflow is expected. Proficiency in integrating Oracle with cloud data platforms, data lakes, Kafka, Hadoop, or Google Big Query (GBQ) is important. Exposure to Azure IaaS, OCI, or multi-cloud data architectures, along with experience supporting large-scale Data Migration and modernization programs, is highly valued.

Essential Skills

Apache SparkPySparkScalaPythonETL/ELTSQL OptimizationOracle GoldenGateKafkaCDCData ModelingGoogle BigQueryCloud DataprocCloud StoragePub/SubDataflowAzureOCIData MigrationData Modernization

Good to Have

Exadata ServerHadoop

Highlights

  • Actively hiring

More Details

RoleData Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Data Engineer at Persistent | SkillMX | SkillMX