Sr Tech Data Validation & DBT Engineer
NTT DATA
NTT DATA
Join our team as a Senior Technical Data Validation Engineer and be instrumental in a crucial Data Warehouse Modernization Program. You will focus on System Integration Testing (SIT), ensuring the integrity of migrated data pipelines through meticulous source-to-target reconciliation. Your expertise will be key in pinpointing data discrepancies, identifying their root causes, and collaborating with development teams to expedite defect resolution.
We seek a candidate with a robust background in DBT, Snowflake, ETL/Data Warehouse principles, SQL-based reconciliation, and legacy Informatica workflows. The ability to independently analyze complex data issues and provide precise diagnostic information for defects is essential for this role.
Your responsibilities will encompass comprehensive data validation across Informatica and DBT implementations, ensuring data completeness, accuracy, and adherence to business rules across all data layers. You will execute various validation types, including record count, aggregate, reconciliation, SCD, and incremental loads.
Key duties involve analyzing data discrepancies, identifying root causes, and preparing detailed defect diagnostics and SQL evidence to enhance defect quality and speed up resolution. You will actively participate in SIT defect triage sessions and collaborate closely with development teams for timely issue resolution. Additionally, you'll validate data lineage and trace data flow through source systems, DBT models, and Snowflake objects.
This role also involves translating Informatica mappings into DBT models, developing and maintaining DBT tests, and designing data layers using DBT best practices. You will contribute to performance analysis and optimization of DBT models and Snowflake queries, supporting deployment validation and migration activities. Furthermore, you will contribute to SIT strategy, test case reviews, and regression testing, while maintaining crucial validation documentation.
We are looking for professionals with over 7 years of experience in Data Warehouse, ETL, Data Engineering, or Data Validation. A minimum of 2 years of hands-on experience with DBT (Core or Cloud) is required, alongside significant experience in Data Warehouse Migration/Modernization programs and supporting SIT or large-scale data validation initiatives.
Essential skills include a developer-level understanding of Informatica mappings, workflows, and transformations, along with experience using Snowflake and modern cloud data platforms. Strong communication skills and the ability to interpret existing ETL logic and requirements documentation are also vital.
Key technical proficiencies include advanced SQL, ETL/Data Warehouse testing, source-to-target data validation, DBT, Snowflake, data mapping, complex joins and transformation validation, various incremental load validation techniques, and robust defect/root-cause analysis. Experience with SIT execution, defect triage, debugging, reconciliation reporting, and business rule validation is also mandatory. Experience with Databricks, CI/CD tools, Python for data validation, and data-validation automation frameworks is strongly preferred.
NTT DATA
IT Consulting