Join our team as a Data Senior Engineer and play a pivotal role in modernizing our data workflows. This position focuses on translating complex Informatica processes into efficient Python EL scripts and dbt transformation models. You will be instrumental in building robust data pipelines and ensuring high data quality for our data warehouse.

This role offers a challenging opportunity to work with large datasets and cutting-edge technologies, contributing directly to our data infrastructure's evolution. If you are passionate about data engineering and have a knack for optimization, this is the perfect fit.

Design and implement Python EL pipelines for high-volume data ingestion into the data warehouse. Develop and maintain dbt transformation models, adhering to best practices for layering, macros, and incremental strategies. Create comprehensive dbt-native and Python unit tests to ensure transformation accuracy and data integrity. Orchestrate Python EL and dbt scripts using Airflow DAGs, ensuring functional equivalence to existing Informatica workflows. Contribute to GitLab CI/CD pipelines for code quality, automated testing, and deployment. Conduct peer code reviews, offering constructive technical feedback. Troubleshoot performance bottlenecks and data discrepancies, performing reconciliation between source systems and the data warehouse. Develop and maintain technical documentation, runbooks, and handover materials.

Proven experience in assessing and translating Informatica workflows into Python EL scripts and dbt models. Expertise in developing Python EL pipelines using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools like Oracle Data Pump and SQL Server BCP. Strong skills in designing and developing dbt transformation models, including layering, macros, and incremental strategies. Familiarity with dbt-native testing and custom Python unit testing frameworks. Experience orchestrating data pipelines with Airflow. Proficiency in GitLab CI/CD for pipeline automation and deployment. Ability to troubleshoot performance issues and data quality problems. Excellent communication and collaboration skills for peer reviews and documentation.