Data Engineer Senior Consultant
NTT DATA
NTT DATA
Seeking a Senior Consultant with expertise in Data Engineering to lead complex data transformation initiatives. This role involves translating existing Informatica workflows into modern Python and dbt-based solutions. You will be instrumental in designing, developing, and orchestrating robust data pipelines, ensuring high data quality and performance.
This is an opportunity to leverage your skills in cloud data warehousing and CI/CD practices, contributing to a high-impact team. We are looking for a proactive individual who can drive technical excellence and provide valuable mentorship.
• Convert intricate Informatica workflows into equivalent Python EL scripts and dbt transformation models. • Build and maintain high-volume Python EL pipelines for data loading into warehouses. • Design and implement dbt transformation models following best practices. • Develop comprehensive dbt and Python unit tests for data validation. • Create Airflow DAGs for end-to-end orchestration of data processes. • Contribute to GitLab CI/CD pipelines for code quality and deployment. • Conduct peer code reviews and offer constructive technical feedback. • Troubleshoot performance and data integrity issues during testing phases. • Generate technical documentation and handover materials.
• Proven experience in translating Informatica workflows to Python EL and dbt models. • Strong proficiency in Python, dbt, and Airflow for data pipeline development and orchestration. • Hands-on experience with data loading tools like Oracle Data Pump and SQL Server BCP. • Familiarity with data warehousing concepts and best practices. • Experience with CI/CD tools, particularly GitLab CI/CD. • Ability to perform code reviews and provide technical guidance. • Strong problem-solving skills for performance tuning and data reconciliation. • Excellent communication and documentation skills.
NTT DATA
IT Consulting