Senior Data Engineer
Persistent
Persistent
Join a leading digital engineering partner focused on AI and platform-driven solutions. We empower clients globally with deep technical expertise and industry experience, helping them anticipate future trends and gain a competitive edge. Our commitment to client success and agile approach fuels our sustained growth. Recognized for innovation and leadership, we collaborate with industry pioneers, including top financial and healthcare organizations.
Our dynamic team is instrumental in transforming industries worldwide. We are committed to fostering a values-driven, people-centric, and inclusive work environment. Persistent champions diversity and encourages applications from all qualified individuals, including those with disabilities. We offer hybrid work arrangements and flexible hours to accommodate diverse lifestyles, alongside an accessibility-friendly office with assistive technologies.
Spearhead the design, development, and optimization of large-scale data processing solutions using Apache Spark (PySpark/Scala) and Python. Construct and maintain robust ETL/ELT pipelines for analytical and reporting needs. Enhance query performance, Spark jobs, and end-to-end data processing for high-volume batch and near real-time workloads.
Implement sophisticated data integration, replication, and ingestion solutions leveraging technologies like Oracle GoldenGate, Kafka, and CDC frameworks. Partner closely with application, data, and analytics teams to architect scalable data models and processing frameworks. Lead performance tuning initiatives across Oracle, Spark, and distributed data processing environments.
A seasoned Data Engineer with a minimum of 8 years of experience, possessing strong hands-on expertise in Apache Spark (PySpark and/or Scala) and Python. Demonstrated deep understanding of Oracle databases for OLAP, data warehousing, and analytical tasks is essential.
Proven track record in optimizing Spark applications, complex SQL queries, large-scale ETL/ELT processes, and high-volume batch processing. Proficiency in data modeling and experience with enterprise-scale data integration technologies such as Oracle GoldenGate, Kafka, or similar frameworks are mandatory. Experience with Exadata Server and large-scale Oracle analytics platforms is a significant advantage.
Persistent Systems
IT Consulting