Data Migration Engineer (SWP Workstream)
NTT DATA
NTT DATA
Join NTT DATA as a Data Migration Engineer, focusing on the SWP Workstream. This pivotal role involves architecting and implementing robust data pipelines for a significant migration from Informatica PowerCenter to a contemporary data stack.
You will be instrumental in converting intricate Informatica workflows into efficient Python, dbt, and Airflow solutions, ensuring seamless, production-ready output at an enterprise scale.
Your core responsibilities will include assessing and translating complex Informatica workflows into Python EL scripts and dbt models. You'll develop and maintain high-volume data pipelines using Python, leveraging tools like SQLAlchemy and Oracle Data Pump.
Furthermore, you will design and build dbt transformation models, incorporating best practices for layering, macros, and incremental strategies. Creating dbt-native and Python unit tests to ensure data quality and developing Airflow DAGs for end-to-end orchestration are also key aspects of this role. Contributing to GitLab CI/CD and conducting code reviews will further enhance the team's output.
We are seeking candidates with a minimum of 5 years of experience in Informatica PowerCenter, including mappings, sessions, and workflows. You should also possess at least 3 years of hands-on experience with dbt Core and Airflow, coupled with 5+ years of Python proficiency in production data processing.
A strong command of SQL, including complex joins and aggregations on large datasets, is essential. Experience with high-volume data movement tools like Oracle Data Pump or SQL Server BCP is also required. Familiarity with SQLAlchemy, cx_Oracle, or pyodbc is preferred, along with any experience mentoring junior engineers.
NTT DATA
IT Consulting