Seeking a Senior Consultant Data Engineer to transform complex Informatica workflows into efficient Python EL scripts and dbt transformation models. This role involves developing robust data pipelines and ensuring high data quality and performance.

Join our team to leverage your expertise in data engineering best practices and contribute to critical data initiatives. You will play a key part in modernizing our data infrastructure.

Translate complex Informatica workflows (sessions, mappings, parameterizations) into Python EL scripts and dbt transformation models. Develop and maintain Python EL pipelines for high-volume data ingestion into data warehouses using tools like SQLAlchemy and bulk export utilities. Design and implement dbt transformation models following best practices, including layering, macros, and incremental strategies. Create comprehensive dbt-native tests and custom Python unit tests to ensure data accuracy and quality. Orchestrate Python EL and dbt scripts using Airflow DAGs, ensuring functional equivalence to source Informatica workflows. Contribute to GitLab CI/CD pipelines for dbt and Airflow code, incorporating linting, automated testing, and deployment processes. Provide constructive technical feedback through peer code reviews. Troubleshoot performance bottlenecks and data inconsistencies during SIT and UAT phases, including row-count reconciliation. Develop and maintain technical documentation, runbooks, and handover materials.

Proficiency in Python, dbt, and data warehousing concepts. Experience with data pipeline development tools such as SQLAlchemy, cx_Oracle, pyodbc, Oracle Data Pump, and SQL Server BCP. Strong understanding of dbt best practices, including model layering, macros, and incremental strategies. Familiarity with Airflow for workflow orchestration. Experience with CI/CD pipelines, specifically GitLab CI/CD. Ability to troubleshoot performance issues and data discrepancies effectively. Excellent communication and collaboration skills for peer code reviews and documentation.