Join a dynamic team focused on enhancing Disney Entertainment's data-driven capabilities. As a Senior Data Engineer, you'll play a crucial role in ensuring the reliability and observability of critical data pipelines. This is an opportunity to make a significant impact within an organization that prioritizes data. We are a dedicated team with ambitious goals, seeking individuals passionate about tackling complex challenges at scale. You'll thrive in a fast-paced, collaborative environment, working with distributed systems. This role involves on-call duties, including rotational weekend shifts, while maintaining a healthy work-life balance.

You will lead and mentor the Data Reliability Engineering team, managing production incidents from triage to root cause analysis and ensuring timely resolutions. Offer insightful recommendations through Root Cause Analyses to prevent future incidents. Contribute to designing and developing a platform for incident observability and automation, building high-quality data models and products to monitor data pipeline health and quality. Collaborate with engineering teams to optimize, maintain, and tune our big data pipeline infrastructure, responding effectively to incidents. Develop advanced observability and intelligent monitoring for data pipelines and infrastructure, enabling early, automated anomaly detection and alerting. Present your findings and research clearly and concisely to diverse audiences across the company.

A minimum of 5 years of experience is required for working on mission-critical data pipelines and ETL systems, along with 5+ years of hands-on experience with big data technologies like AWS, Hadoop, Hive, and Snowflake. A meticulous approach to problem-solving, combined with a strong sense of ownership and drive, is essential. We seek candidates with a proactive bias for action and a passion for delivering high-quality data solutions. Expertise in common Data Engineering languages such as Python, Scala, Java, SQL, and the ability to quickly learn new languages, is vital. Experience with workflow orchestration tools like Airflow is necessary. A deep understanding of end-to-end pipeline design and implementation, along with excellent problem-solving and interpersonal skills, is expected. While advanced degrees are a plus, a degree in Computer Science, Engineering, or a related field is required.