Data Engineer Advisor

NTT DATA

5 yrs Bengaluru Full Time Work from office
NTT DATA logo
Posted : today
Actively hiring

Job description

Join NTT DATA as a Data Engineer Advisor in Bangalore, India, and play a pivotal role in modernizing our data infrastructure. This advisory position focuses on hands-on technical contributions and delivery leadership. You will be instrumental in migrating complex data workflows from Informatica PowerCenter to a contemporary data stack, leveraging Python, dbt, and Airflow to achieve enterprise-scale, production-quality results.

NTT DATA is a global leader in business and technology services, committed to driving client success and positive societal impact through responsible innovation. As part of the NTT Group, we offer unparalleled expertise in AI, cloud, security, and digital solutions.

Responsibilities

Your core responsibilities will involve assessing intricate Informatica PowerCenter workflows and translating them into equivalent Python EL scripts and dbt transformation models. You will develop and maintain robust Python pipelines for high-volume data ingestion into the target warehouse, utilizing tools like SQLAlchemy and Oracle Data Pump. Crafting dbt transformation models with best practices, implementing comprehensive testing strategies, and orchestrating end-to-end data pipelines using Airflow are also key aspects of this role.

Further contributions include enhancing GitLab CI/CD pipelines, conducting peer code reviews, troubleshooting performance issues, and creating essential technical documentation. Experience in mentoring junior engineers is a plus.

Qualifications

We are looking for candidates with a strong foundation in data engineering, specifically 5+ years of experience with Informatica PowerCenter, including mappings, sessions, and workflows. A minimum of 3 years of hands-on experience with dbt Core, covering model layering, macros, and tests, is essential. Proficiency in Python for production data processing, extensive SQL skills for complex data manipulation, and experience with Airflow for DAG authoring are required.

Familiarity with high-volume data movement tools like Oracle Data Pump or SQL Server BCP is also necessary. Preferred qualifications include experience with SQLAlchemy, cx_Oracle, or pyodbc for database connectivity.

Essential Skills

Informatica PowerCenterPythondbt CoreSQLAirflowOracle Data PumpSQL Server BCP

Good to Have

SQLAlchemycx_Oraclepyodbc

Highlights

  • Actively hiring

More Details

RoleData Engineer Advisor
IndustryIT Services and Consulting
DepartmentData Engineering, Software Development
Employment TypeFull Time, Work from office

About the Company

NTT DATA logo

NTT DATA

IT Services and Consulting

Data Engineer Advisor at NTT DATA | SkillMX | SkillMX