Technical Program Manager
NTT DATA
NTT DATA
Seeking a seasoned Technical Program Manager with extensive experience in data engineering to drive critical initiatives. This role focuses on architecting and executing complex data solutions, ensuring robust and scalable data pipelines.
The ideal candidate will possess a deep understanding of data infrastructure and best practices, contributing to the mentorship and growth of the engineering team.
Lead complex, large-scale data table migrations with a focus on efficiency and accuracy.
Optimize Spark performance through advanced tuning techniques, ensuring efficient data processing.
Implement and manage robust checkpointing and restart mechanisms for data pipelines.
Develop and oversee data reconciliation processes to ensure data integrity.
Troubleshoot and resolve production issues related to data engineering workflows.
A minimum of 8-10 years of hands-on data engineering experience is essential.
Proficiency in Python, PySpark/Spark, SQL, Hadoop, Hive, and Apache Iceberg is required.
Demonstrated ability in complex data modeling and source-to-target mapping is crucial.
Proven experience in independently managing challenging migration tasks and production troubleshooting.
Capability to mentor junior engineers and contribute to team development.
NTT DATA
IT Consulting