Data Engineer - Fabric Pipelines / Orchestration

NTT DATA

8–10 yrs New Delhi Contract Remote
NTT DATA logo
Posted : 1 week ago
Actively hiring

Job description

Join NTT DATA as a Data Engineer specializing in Fabric Pipelines and Orchestration for The Coca-Cola Company's Symphony program. This contract role offers an ongoing, quarterly renewal engagement in an offshore, remote capacity. We are seeking innovative and passionate individuals to contribute to an inclusive and forward-thinking organization.

As part of the Core Team, you will be instrumental in modernizing data infrastructure. Your work will directly impact client success and societal advancement through responsible innovation. This is an opportunity to grow with a global leader in business and technology services.

Responsibilities

Your daily tasks will involve migrating Spark Job Definitions from Synapse to Fabric, and building robust Fabric Pipelines with integrated data orchestration. You will design, develop, and maintain data pipelines utilizing Scala and SQL on Apache Spark.

Key responsibilities include monitoring and supporting Phase 1 pipelines, investigating and resolving pipeline failures, and addressing data quality and performance issues. You will lead code refactoring, optimize solutions for performance and scalability, and contribute to reusable patterns and automation frameworks. Ensuring adherence to TCCC’s metadata-driven architecture and managing code via GitHub version control are also crucial aspects of this role.

Qualifications

We are looking for experienced data engineers with 8-10 years of hands-on experience. A strong understanding of Apache Spark and its core concepts is essential.

Proficiency in Scala and/or Java, employing a code-first approach, is required. Advanced SQL skills and prior experience with Azure Synapse are necessary. Familiarity with GitHub for source control and experience in data warehousing and large-scale data integration are also vital. Candidates must be hands-on builders and available to mobilize immediately. A Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience, is expected.

Essential Skills

Apache SparkScalaSQLAzure SynapseGitHub

Good to Have

Microsoft FabricMetadata-driven architectures

Highlights

  • Actively hiring

More Details

RoleData Engineer - Fabric Pipelines / Orchestration
DepartmentData Engineering
Employment TypeContract, Remote

About the Company

NTT DATA logo

NTT DATA

IT Consulting