Data Engineer Advisor
NTT DATA
NTT DATA
Join NTT DATA as a Data Engineer Advisor in Bangalore, India, and play a pivotal role in modernizing our data infrastructure. This advisory position focuses on hands-on technical contributions and delivery leadership. You will be instrumental in migrating complex data workflows from Informatica PowerCenter to a contemporary data stack, leveraging Python, dbt, and Airflow to achieve enterprise-scale, production-quality results.
NTT DATA is a global leader in business and technology services, committed to driving client success and positive societal impact through responsible innovation. As part of the NTT Group, we offer unparalleled expertise in AI, cloud, security, and digital solutions.
Your core responsibilities will involve assessing intricate Informatica PowerCenter workflows and translating them into equivalent Python EL scripts and dbt transformation models. You will develop and maintain robust Python pipelines for high-volume data ingestion into the target warehouse, utilizing tools like SQLAlchemy and Oracle Data Pump. Crafting dbt transformation models with best practices, implementing comprehensive testing strategies, and orchestrating end-to-end data pipelines using Airflow are also key aspects of this role.
Further contributions include enhancing GitLab CI/CD pipelines, conducting peer code reviews, troubleshooting performance issues, and creating essential technical documentation. Experience in mentoring junior engineers is a plus.
We are looking for candidates with a strong foundation in data engineering, specifically 5+ years of experience with Informatica PowerCenter, including mappings, sessions, and workflows. A minimum of 3 years of hands-on experience with dbt Core, covering model layering, macros, and tests, is essential. Proficiency in Python for production data processing, extensive SQL skills for complex data manipulation, and experience with Airflow for DAG authoring are required.
Familiarity with high-volume data movement tools like Oracle Data Pump or SQL Server BCP is also necessary. Preferred qualifications include experience with SQLAlchemy, cx_Oracle, or pyodbc for database connectivity.
NTT DATA
IT Services and Consulting