Join NTT DATA, a global leader in technology services, and contribute to innovative projects for clients like The Coca-Cola Company. This contract role focuses on building and optimizing data pipelines within a core team, offering an ongoing engagement with quarterly renewals.

This is a remote opportunity for a skilled Data Engineer passionate about developing robust and scalable data solutions. You will be instrumental in migrating existing Spark jobs to Fabric and establishing efficient data orchestration processes.

If you are a hands-on builder with a proven track record in data engineering and a desire to work on cutting-edge cloud technologies, this role is an excellent fit for your career growth. We are looking for immediate mobilization for this critical project.

Key responsibilities include migrating Spark job definitions from Synapse to Fabric and developing new Fabric Pipelines with comprehensive data orchestration.

You will be designing, developing, and maintaining complex data pipelines utilizing Scala and SQL on Apache Spark. Post go-live, you'll actively monitor and support Phase 1 pipelines, diligently investigating and resolving any failures, data quality issues, or performance bottlenecks.

This role also involves leading the refactoring and cleanup of existing code, optimizing solutions for enhanced performance and scalability, and building reusable patterns and automation frameworks. Working within a metadata-driven architecture, you will ensure pipelines are strictly used for scheduling, with ETL logic residing in code, and manage all code via GitHub.

We are seeking candidates with 8-10 years of extensive hands-on data engineering experience, including a strong grasp of Apache Spark and its fundamental concepts.

Essential technical skills include proficiency in Scala and/or Java with a code-first approach, advanced SQL capabilities, and practical experience with Azure Synapse. Familiarity with GitHub for source control and a solid understanding of data warehousing and large-scale data integration are also required.

A Bachelor's degree in Computer Science, Information Technology, or a related field, or equivalent practical work experience, is necessary. Experience with Microsoft Fabric, marketing data, consumer goods analytics, and metadata-driven architectures are considered advantageous but not mandatory.