Databricks Engineer

NTT DATA

Fresher Bengaluru Full Time Hybrid (office + remote)
NTT DATA logo
Posted : 1 week ago
Actively hiring

Job description

NTT DATA is seeking a skilled Databricks Engineer to join our dynamic team. This role involves contributing to innovative projects and growing within a forward-thinking organization.

As a Databricks Engineer, you will play a key role in migrating Snowflake workloads to Databricks. You will be instrumental in ensuring the successful conversion, implementation, and validation of data pipelines and related components.

Join a company that is a leader in business and technology services, committed to client success and positive societal impact through responsible innovation. NTT DATA is at the forefront of AI and digital infrastructure, offering unparalleled capabilities.

Responsibilities

Execute assigned migration tasks, supporting the conversion and implementation of data pipelines, jobs, and scripts within Databricks.

Conduct comprehensive data validation, reconciliation, and parity checks between Snowflake and Databricks outputs to ensure accuracy.

Perform unit and integration testing for migrated jobs and data flows, identifying and resolving any defects.

Investigate and address data mismatches, execution failures, and dependency issues encountered during validation.

Support deployment activities across SIT, QA, and PROD environments in accordance with established release processes.

Prepare essential technical documentation, including test evidence and transition artifacts for assigned workloads.

Qualifications

Possess proven experience with SQL, Python, Databricks, Snowflake, and Delta Lake.

Demonstrate expertise in data pipeline development, job monitoring, data validation, and reconciliation techniques.

Familiarity with Git for version control and experience in unit testing and defect triage is essential.

Ability to adhere to migration standards, meticulously document results, and collaborate effectively with QA, architecture, and release teams within a structured delivery framework.

Essential Skills

SQLPythonDatabricksSnowflakeDelta LakeData Pipeline DevelopmentJob MonitoringData ValidationReconciliationGitUnit TestingDefect TriageCloud Data Engineering

Highlights

  • Actively hiring

More Details

RoleDatabricks Engineer
DepartmentData Engineering
Employment TypeFull Time, Hybrid (office + remote)

About the Company

NTT DATA logo

NTT DATA

IT Consulting

Databricks Engineer at NTT DATA | SkillMX | SkillMX