Seeking a Senior Data Engineer Consultant to drive critical data transformation initiatives. This role focuses on migrating complex Informatica workflows to modern Python and dbt-based ELT processes.

You will be instrumental in designing, developing, and deploying robust data pipelines that handle high volumes of data. Collaboration and technical leadership are key to success in this position.

Translate intricate Informatica workflows into efficient Python EL scripts and dbt transformation models. Build and manage Python pipelines for landing large datasets into data warehouses, leveraging tools like SQLAlchemy and bulk export utilities. Design dbt models adhering to best practices, including layering, macros, and incremental strategies.

Develop comprehensive dbt tests and Python unit tests to ensure data accuracy. Orchestrate end-to-end data flows using Airflow DAGs. Contribute to GitLab CI/CD pipelines for code quality and deployment. Conduct code reviews and provide technical feedback. Troubleshoot performance and data integrity issues, and create essential technical documentation.

Proven experience in assessing and migrating Informatica workflows. Strong proficiency in Python for data engineering and dbt for data transformation. Hands-on experience with tools like SQLAlchemy, Oracle Data Pump, and SQL Server BCP. Familiarity with Airflow for workflow orchestration and GitLab CI/CD for pipeline automation.

Experience in designing dbt models with best practices and developing unit tests is essential. Ability to troubleshoot complex data issues and reconcile row counts between source and target systems. Excellent communication and collaboration skills for peer reviews and documentation.