Databricks Engineer
NTT DATA
NTT DATA
NTT DATA is seeking a skilled Databricks Engineer to join our dynamic team. This role involves contributing to innovative projects and growing within a forward-thinking organization.
As a Databricks Engineer, you will play a key role in migrating Snowflake workloads to Databricks. You will be instrumental in ensuring the successful conversion, implementation, and validation of data pipelines and related components.
Join a company that is a leader in business and technology services, committed to client success and positive societal impact through responsible innovation. NTT DATA is at the forefront of AI and digital infrastructure, offering unparalleled capabilities.
Execute assigned migration tasks, supporting the conversion and implementation of data pipelines, jobs, and scripts within Databricks.
Conduct comprehensive data validation, reconciliation, and parity checks between Snowflake and Databricks outputs to ensure accuracy.
Perform unit and integration testing for migrated jobs and data flows, identifying and resolving any defects.
Investigate and address data mismatches, execution failures, and dependency issues encountered during validation.
Support deployment activities across SIT, QA, and PROD environments in accordance with established release processes.
Prepare essential technical documentation, including test evidence and transition artifacts for assigned workloads.
Possess proven experience with SQL, Python, Databricks, Snowflake, and Delta Lake.
Demonstrate expertise in data pipeline development, job monitoring, data validation, and reconciliation techniques.
Familiarity with Git for version control and experience in unit testing and defect triage is essential.
Ability to adhere to migration standards, meticulously document results, and collaborate effectively with QA, architecture, and release teams within a structured delivery framework.
NTT DATA
IT Consulting