Join Disney Entertainment and ESPN Product & Technology, a global team of innovators building the future of media technology. We combine creativity with cutting-edge tech to develop world-class products and enhance storytelling for millions worldwide.

This role is integral to our Ad Platforms team, focusing on the reliability, scalability, and performance of Disney’s advertising technology and big data infrastructure. You'll be instrumental in ensuring our data pipelines are resilient, cost-effective, and performant at scale, contributing to industry-leading ad tech solutions.

As a Senior Data Engineer, you will design, optimize, and maintain Spark and Flink data pipelines within Databricks and Airflow environments. Your focus will be on ensuring production workflows are highly reliable and available.

You will be responsible for tuning Spark jobs and clusters for optimal performance and cost efficiency, and proactively monitor pipeline health using observability tools. Additionally, you will participate in incident response, conduct root cause analyses, and collaborate with cross-functional teams to deliver accurate and timely data. Mentoring junior engineers and contributing to best practices are also key aspects of this role.

We are looking for a seasoned Data Engineer with at least 4 years of experience in data engineering or big data platform operations. You must have hands-on experience with Databricks, Spark, Flink, or Airflow (MWAA) in production environments.

Essential skills include strong SQL proficiency, ETL/ELT pipeline development, and familiarity with AWS services like S3, Glue, Athena, EMR, and EKS. Working knowledge of observability tools (Datadog, CloudWatch, Prometheus) and proficiency in Python, Scala, or Java are required. Experience with infrastructure-as-code tools like Terraform and strong problem-solving skills in a distributed team setting are also necessary.

A Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent experience, is required.