Data Engineer

Persistent

12–15 yrs Charlotte Full Time Hybrid (office + remote)
Persistent logo
Posted : today
Actively hiring

Job description

Join Persistent as a Senior Data Engineer and drive significant data modernization, migration, and analytics initiatives. This role offers a unique opportunity to leverage deep expertise in Oracle-based analytical platforms and Apache Spark. You will be instrumental in building high-performance data pipelines and optimizing large-scale data processing for enterprise data platforms integrated with modern cloud analytics solutions.

Our company is an AI-led, platform-driven Digital Engineering partner, committed to helping clients anticipate future needs. We collaborate with industry leaders globally, including Fortune 50 companies and top banks. Our sustained growth is fueled by a disruptor's mindset, client success focus, and agility in a dynamic environment. Recognized for innovation and leadership, we provide a $422.5M revenue stream in Q3 FY26 with a global team of over 26,500 members in 18 countries.

Responsibilities

Design, develop, and optimize large-scale data processing solutions utilizing Apache Spark (PySpark/Scala) and Python. Construct and maintain scalable ETL/ELT pipelines to support analytical and reporting workloads. Enhance query performance, Spark jobs, and end-to-end data processing for high-volume batch and near real-time scenarios. Implement data integration, replication, and ingestion solutions using technologies like Oracle GoldenGate, Kafka, and CDC frameworks.

Collaborate with application, data, and analytics teams to create scalable data models and processing frameworks. Lead performance tuning efforts across Oracle, Spark, and distributed data processing environments. You will oversee the end-to-end implementation of data ingestion, transformation, quality, and distribution workflows. Guide teams in optimizing pipeline performance, scalability, and reliability while ensuring robust observability, monitoring, and automation.

Qualifications

A minimum of 12-15 years of experience in Data Engineering is required. You should possess strong hands-on expertise with Apache Spark (PySpark and/or Scala) and Python, alongside a deep understanding of Oracle databases for OLAP, data warehousing, and analytical workloads. Proven experience in tuning and optimizing Spark applications, complex SQL queries, and large-scale ETL/ELT processes is essential.

Essential skills include strong SQL and data modeling capabilities, and experience with Oracle GoldenGate, CDC, or enterprise-scale data integration technologies. Preferred qualifications include experience with Oracle Exadata, GCP services (BigQuery, Dataproc, etc.), integrating Oracle with cloud platforms, Azure, OCI, or multi-cloud architectures, and supporting large-scale data migration programs. You will provide hands-on technical leadership, mentor engineers, lead code and solution reviews, and champion engineering excellence.

Essential Skills

Apache SparkPythonOracleSQLData ModelingETLELTData PipelinesPerformance TuningPySparkScalaOracle GoldenGateCDCData Integration

Good to Have

Oracle ExadataGoogle Cloud PlatformBigQueryDataprocCloud StoragePub/SubDataflowAzureOCIMulti-cloud

Highlights

  • Actively hiring

More Details

RoleData Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Persistent Systems logo

Persistent Systems

IT Consulting

Data Engineer at Persistent | SkillMX | SkillMX