Sr Tech Data Validation & DBT Engineer

NTT DATA

7+ yrs Bengaluru Full Time Work from office
NTT DATA logo
Posted : today
Actively hiring

Job description

Join our team as a Senior Technical Data Validation Engineer and be instrumental in a crucial Data Warehouse Modernization Program. You will focus on System Integration Testing (SIT), ensuring the integrity of migrated data pipelines through meticulous source-to-target reconciliation. Your expertise will be key in pinpointing data discrepancies, identifying their root causes, and collaborating with development teams to expedite defect resolution.

We seek a candidate with a robust background in DBT, Snowflake, ETL/Data Warehouse principles, SQL-based reconciliation, and legacy Informatica workflows. The ability to independently analyze complex data issues and provide precise diagnostic information for defects is essential for this role.

Responsibilities

Your responsibilities will encompass comprehensive data validation across Informatica and DBT implementations, ensuring data completeness, accuracy, and adherence to business rules across all data layers. You will execute various validation types, including record count, aggregate, reconciliation, SCD, and incremental loads.

Key duties involve analyzing data discrepancies, identifying root causes, and preparing detailed defect diagnostics and SQL evidence to enhance defect quality and speed up resolution. You will actively participate in SIT defect triage sessions and collaborate closely with development teams for timely issue resolution. Additionally, you'll validate data lineage and trace data flow through source systems, DBT models, and Snowflake objects.

This role also involves translating Informatica mappings into DBT models, developing and maintaining DBT tests, and designing data layers using DBT best practices. You will contribute to performance analysis and optimization of DBT models and Snowflake queries, supporting deployment validation and migration activities. Furthermore, you will contribute to SIT strategy, test case reviews, and regression testing, while maintaining crucial validation documentation.

Qualifications

We are looking for professionals with over 7 years of experience in Data Warehouse, ETL, Data Engineering, or Data Validation. A minimum of 2 years of hands-on experience with DBT (Core or Cloud) is required, alongside significant experience in Data Warehouse Migration/Modernization programs and supporting SIT or large-scale data validation initiatives.

Essential skills include a developer-level understanding of Informatica mappings, workflows, and transformations, along with experience using Snowflake and modern cloud data platforms. Strong communication skills and the ability to interpret existing ETL logic and requirements documentation are also vital.

Key technical proficiencies include advanced SQL, ETL/Data Warehouse testing, source-to-target data validation, DBT, Snowflake, data mapping, complex joins and transformation validation, various incremental load validation techniques, and robust defect/root-cause analysis. Experience with SIT execution, defect triage, debugging, reconciliation reporting, and business rule validation is also mandatory. Experience with Databricks, CI/CD tools, Python for data validation, and data-validation automation frameworks is strongly preferred.

Essential Skills

DBTSnowflakeETLData WarehouseSQLData ValidationSource-to-Target ReconciliationDefect AnalysisRoot Cause AnalysisInformaticaData Engineering

Good to Have

DatabricksAzure DevOpsPython

Highlights

  • Actively hiring

More Details

RoleSr Tech Data Validation & DBT Engineer
DepartmentData Engineering, Quality Assurance
Employment TypeFull Time, Work from office

About the Company

NTT DATA logo

NTT DATA

IT Consulting

Sr Tech Data Validation & DBT Engineer at NTT DATA | SkillMX | SkillMX