Senior Data Engineer
Persistent
Persistent
Persistent is seeking a skilled Senior Data Engineer experienced in Oracle analytical platforms and Apache Spark to drive large-scale data modernization, migration, and analytics projects. This role requires expertise in building high-performance data pipelines, optimizing data processing, and integrating enterprise data with cloud analytics solutions.
Join a dynamic team that fosters innovation and collaboration. We offer a supportive work environment with opportunities for professional growth and development, working with industry leaders across various sectors.
Design and optimize robust data processing solutions utilizing Apache Spark (PySpark/Scala) and Python. Develop and maintain scalable ETL/ELT pipelines for analytical and reporting needs. Optimize query performance, Spark jobs, and data processing pipelines for high-volume batch and near real-time workloads. Implement data integration, replication, and ingestion solutions using technologies like Oracle GoldenGate and Kafka.
Collaborate with application, data, and analytics teams to create scalable data models and processing frameworks. Drive performance tuning initiatives across Oracle, Spark, and distributed data processing environments. Oversee end-to-end implementation of data workflows, ensuring quality and timely distribution.
A minimum of 8 years in Data Engineering or a related field is essential, with strong hands-on experience in Apache Spark (PySpark/Scala) and Python. A deep understanding of Oracle databases for analytical workloads, including MS OLAP and Warehouses, is required. Proven ability to tune Spark applications, complex SQL queries, and large-scale ETL/ELT processes is crucial.
Solid data modeling skills and experience with enterprise-scale data integration technologies like Goldengate or CDC are necessary. Experience with cloud platforms such as GCP (Google BigQuery, Cloud Dataproc) or multi-cloud architectures is preferred. Experience supporting large-scale data migration and modernization programs is also advantageous.
Persistent Systems
IT Services and Consulting