Senior Data Engineer
Persistent
Persistent
Join a leading Digital Engineering and Enterprise Modernization partner that leverages AI and platform-driven solutions to help clients achieve a competitive advantage. We collaborate with industry leaders globally, including Fortune 50 companies and top financial institutions, across diverse sectors like healthcare. Our culture of innovation and client success fuels continuous growth, consistently delivering strong financial results. With a global team spanning 18 countries, we empower market leaders to transform their industries. Recognized for AI and Data Excellence, our commitment to next-generation data, analytics, and AI services is unmatched.
Design, develop, and optimize robust data processing solutions utilizing Apache Spark (PySpark/Scala) and Python. Build and maintain scalable ETL/ELT pipelines essential for analytical and reporting needs. Enhance query performance, Spark jobs, and end-to-end data processing for high-volume batch and near real-time workloads. Implement data integration, replication, and ingestion strategies using tools like Oracle GoldenGate, Kafka, and CDC frameworks. Collaborate with cross-functional teams to develop adaptable data models and processing frameworks. Lead performance tuning efforts across Oracle, Spark, and distributed data environments.
A minimum of 8 years of experience in Data Engineering or a related field is mandatory. Demonstrated expertise in Apache Spark (PySpark and/or Scala) and Python is crucial. A deep understanding of Oracle databases, specifically for OLAP, data warehousing, and analytical workloads, is required. Proven ability to tune and optimize Spark applications, complex SQL queries, and large-scale ETL/ELT processes is essential. Strong SQL and data modeling capabilities, alongside experience with Oracle GoldenGate, CDC, or enterprise-scale data integration technologies, are necessary.
Persistent Systems
IT Consulting