NTT DATA is seeking a seasoned Data Engineer Senior Advisor to lead our Level 3 production support for a cutting-edge cloud-based data platform. This role offers a unique blend of deep data engineering expertise, technical leadership, and production support experience. You will be instrumental in resolving complex production issues, conducting root cause analysis, enhancing platform reliability and performance, optimizing Snowflake costs, and driving automation across our support functions.

Ideal candidates possess robust experience with Snowflake and modern data engineering tools, including Streamlit, Snowflake Cortex, dbt, Kafka/Snowpipe Streaming, GitHub, and cloud services from AWS or GCP. Familiarity with Observe/Streamline dashboarding solutions is also beneficial.

As the L3 Support Team Lead / Senior Data Engineer, you will guide the production data platform support team, acting as the primary technical escalation point for intricate data, application, integration, and performance incidents. You will troubleshoot and resolve critical production issues within service level agreements (SLAs), conduct thorough root cause analysis for major incidents, and implement corrective actions. Responsibilities include identifying and resolving recurring issues, driving automation, establishing operational runbooks, and mentoring junior team members.

You will also engage in hands-on Snowflake engineering and support, addressing complex SQL, data pipeline, data quality, ingestion, transformation, and performance challenges. Performance tuning and cost optimization within Snowflake are key aspects of this role, alongside working with dbt for data transformation and supporting Streamlit applications integrated with Snowflake. Troubleshooting and enhancing solutions involving Snowflake Cortex AI capabilities, and supporting real-time data ingestion via Kafka and Snowpipe Streaming are also critical functions.

A strong background in cloud, DevOps, and automation is essential, including extensive experience with GitHub and Git-based development practices, CI/CD processes, and branching strategies. You should have significant experience with AWS services, particularly serverless and integration components like AWS Lambda, and a working understanding of equivalent GCP services. Automating support activities and collaborating with engineering teams to refine deployment, monitoring, and recovery processes are expected.

This role requires developing and maintaining dashboards for proactive data platform monitoring, building operational dashboards for pipeline health, failures, latency, performance, SLA adherence, and Snowflake consumption. Strong technical leadership, team management skills, and the ability to remain hands-on are crucial. Excellent analytical and troubleshooting abilities across multiple technology layers, coupled with effective stakeholder management and clear communication skills, are vital for success. A continuous improvement mindset focused on automation, reliability, performance, scalability, and cost optimization, along with a capacity to mentor engineers, is highly valued.

We are looking for candidates with 8-10+ years of overall data engineering experience, including 4-6+ years of hands-on Snowflake expertise. Prior L3 production support experience, experience leading data engineering or support teams, and familiarity with ITIL-based processes are required. Experience collaborating with distributed teams across application, infrastructure, cloud, DevOps, and business stakeholders is also necessary. You must be technically adept at investigating production issues at code, SQL, pipeline, Snowflake, streaming, and cloud service levels, while simultaneously providing leadership.