Senior Data Engineer
Persistent
Persistent
Join a leading AI-led digital engineering firm as a Senior Data Engineer. This role focuses on large-scale data modernization, migration, and analytics initiatives, leveraging deep expertise in Oracle and Apache Spark. You'll contribute to building high-performance data pipelines and integrating enterprise data platforms with modern cloud analytics solutions, driving competitive advantages for industry-leading organizations.
We are committed to client success and fostering a dynamic environment. Recognized for innovation and leadership, our growth momentum is sustained by a global team dedicated to transforming industries. Be part of a culture that values talent development, offering continuous learning and career advancement opportunities.
Design, develop, and optimize large-scale data processing solutions using Apache Spark (PySpark/Scala) and Python. Build and maintain scalable ETL/ELT pipelines for analytical and reporting workloads. Optimize query performance, Spark jobs, and end-to-end data processing pipelines for high-volume batch and near real-time data.
Implement data integration, replication, and ingestion solutions using technologies like Oracle GoldenGate, Kafka, and CDC frameworks. Collaborate with application, data, and analytics teams to develop scalable data models and processing frameworks. Drive performance tuning initiatives across Oracle, Spark, and distributed data processing environments.
Requires 8+ years of experience in Data Engineering or related fields, with strong hands-on proficiency in Apache Spark (PySpark and/or Scala) and Python. A deep understanding of Oracle databases for OLAP, data warehousing, and analytical workloads is essential.
Proven experience in tuning and optimizing Spark applications, complex SQL queries, and large-scale ETL/ELT processes is a must. Strong SQL and data modeling skills, along with experience in Oracle GoldenGate, CDC, or enterprise-scale data integration technologies, are required. Experience supporting large-scale data migration and modernization programs is preferred.
Persistent Systems
IT Consulting