Data Engineer - Fabric Pipelines / Orchestration
NTT DATA
NTT DATA
Join NTT DATA as a Data Engineer specializing in Fabric Pipelines and Orchestration for The Coca-Cola Company's Symphony program. This contract role offers an ongoing, quarterly renewal engagement in an offshore, remote capacity. We are seeking innovative and passionate individuals to contribute to an inclusive and forward-thinking organization.
As part of the Core Team, you will be instrumental in modernizing data infrastructure. Your work will directly impact client success and societal advancement through responsible innovation. This is an opportunity to grow with a global leader in business and technology services.
Your daily tasks will involve migrating Spark Job Definitions from Synapse to Fabric, and building robust Fabric Pipelines with integrated data orchestration. You will design, develop, and maintain data pipelines utilizing Scala and SQL on Apache Spark.
Key responsibilities include monitoring and supporting Phase 1 pipelines, investigating and resolving pipeline failures, and addressing data quality and performance issues. You will lead code refactoring, optimize solutions for performance and scalability, and contribute to reusable patterns and automation frameworks. Ensuring adherence to TCCC’s metadata-driven architecture and managing code via GitHub version control are also crucial aspects of this role.
We are looking for experienced data engineers with 8-10 years of hands-on experience. A strong understanding of Apache Spark and its core concepts is essential.
Proficiency in Scala and/or Java, employing a code-first approach, is required. Advanced SQL skills and prior experience with Azure Synapse are necessary. Familiarity with GitHub for source control and experience in data warehousing and large-scale data integration are also vital. Candidates must be hands-on builders and available to mobilize immediately. A Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience, is expected.
NTT DATA
IT Consulting