Data Senior Engineer
NTT DATA
NTT DATA
Join NTT DATA as a Data Senior Engineer and contribute to a forward-thinking organization focused on innovation and client success. This role is integral to a large-scale data migration project, transitioning from Informatica PowerCenter to a modern data stack.
As a key technical contributor, you will design and implement robust data pipelines using Python, dbt, and Airflow. Your expertise will ensure the delivery of production-quality, functionally equivalent output at an enterprise scale, driving efficiency and modernization in our data operations.
Key responsibilities include assessing and translating complex Informatica workflows into Python EL scripts and dbt transformation models. You will develop and maintain high-volume data ingestion pipelines using Python, SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools. Designing and developing dbt models, incorporating best practices, and implementing comprehensive testing strategies are crucial.
Orchestrating end-to-end data flows with Airflow DAGs, contributing to CI/CD pipelines, performing peer code reviews, and troubleshooting performance issues are also vital. You will also be involved in creating technical documentation and handover materials to ensure seamless knowledge transfer.
We require candidates with a minimum of 5 years of experience in Informatica PowerCenter, including mappings, sessions, and workflows. Proficiency in dbt Core (3+ years) with experience in model layering, macros, and incremental strategies is essential. A strong background in Python (5+ years) for production data processing and extensive SQL experience (5+ years) with complex joins and aggregations are necessary.
Experience with Airflow, Oracle Data Pump or SQL Server BCP/BULK INSERT for high-volume data movement is required. Preferred qualifications include experience with SQLAlchemy, cx_Oracle, or pyodbc, and mentoring junior engineers in offshore delivery models.
NTT DATA
IT Consulting