Join EY, a global leader in professional services, and build a career that's as unique as you are. We are seeking a Senior Apache Airflow Platform Engineer to provide critical L2 operational support, platform administration, and drive continuous improvement within our enterprise workflow orchestration environments. This role demands strong expertise in Airflow DAG development, platform operations, DevOps automation, cloud-native infrastructure, and CI/CD implementation.

At EY, we are dedicated to shaping your future with confidence, helping you succeed within a globally connected powerhouse of diverse teams. We offer the support and inclusive culture necessary for you to become the best version of yourself. Your unique perspective is vital to our growth and to building a better working world for all.

As a Senior Apache Airflow Platform Engineer, you will ensure the reliability, scalability, security, and performance of the Airflow platform. Your responsibilities include providing L2/L3 support, troubleshooting and resolving issues related to DAG execution and platform stability, and performing root cause analysis for incidents.

You will manage Airflow components, conduct platform administration, configuration, upgrades, and patching. This role involves designing and developing Airflow DAGs for complex workflows, optimizing their performance, and supporting new integrations. Additionally, you will design, implement, and maintain CI/CD pipelines using GitHub Actions, automate deployment processes, and support GitOps and Infrastructure-as-Code practices.

Further responsibilities include supporting Airflow deployments on AWS EKS, managing Kubernetes workloads, and developing/maintaining Helm charts. You will also build and manage Infrastructure-as-Code solutions using Terraform and support containerized environments with Docker and Kubernetes. Database administration and troubleshooting for PostgreSQL are also key aspects of this role.

We are looking for candidates with 3-5 years of experience in supporting, administering, and engineering Apache Airflow platforms in enterprise settings. Essential skills include robust experience in Airflow DAG development, workflow orchestration, scheduling, and production platform support.

Deep understanding of Airflow architecture and extensive experience troubleshooting DAG failures, scheduler bottlenecks, and platform stability issues are required. Proficiency in designing and developing CI/CD pipelines with GitHub Actions, implementing DevOps and GitOps practices, and Infrastructure-as-Code methodologies is crucial.

Strong hands-on experience with AWS cloud services, AWS EKS, Kubernetes, Docker, Terraform, and PostgreSQL is mandatory. Experience integrating Airflow with enterprise applications, APIs, and databases, along with familiarity with enterprise monitoring and observability tools, is also necessary. Practical experience with Incident Management, Problem Management, and driving continuous service improvement initiatives is expected. Knowledge of enterprise security, audit, governance, and compliance requirements within cloud-native environments is also valued.