Lead Senior Associate | Data Engineering | Chennai | Engineering as a Service/ Operate (Chennai, IN)

Deloitte

4+ yrs Chennai Full Time Work from office
Deloitte logo
Posted : today
Actively hiring

Job description

Join Disney Entertainment and ESPN Product & Technology as a Senior Data Engineer I, playing a vital role in advancing the technological backbone for Disney's global media business. This team blends technology with creativity to develop world-class products, enhance storytelling, and drive innovation and scalability. You'll contribute to building the future of Disney's media platforms, impacting millions of users worldwide through products like Disney+, Hulu, and ESPN.

This role offers an unparalleled opportunity to work on cutting-edge technology, shaping industry norms and solving complex technical challenges within Disney's ad platforms. You'll be instrumental in driving advertising performance, innovation, and value across all media platforms.

Responsibilities

As a Senior Data Engineer I, you will be responsible for the reliability, scalability, and performance of Disney’s Ad Technology big data platforms and pipelines. Your hands-on development will focus on Databricks, Spark, Flink, and Airflow (MWAA) environments, ensuring production data workflows are resilient, cost-efficient, and performant at scale.

Key responsibilities include designing, optimizing, and supporting data pipelines, contributing to automation, monitoring, and incident response. You will collaborate closely with platform, BI, and analytics teams to ensure timely and accurate data delivery. Additionally, you will mentor junior engineers, develop runbooks, and help evolve best practices under the guidance of leadership.

Qualifications

We are looking for a seasoned Data Engineer with a minimum of 4 years of experience in data engineering or big data platform operations. Essential hands-on experience includes Databricks, Spark, Flink, or Airflow (MWAA) in production environments. A strong command of SQL and experience with ETL/ELT pipeline development are critical.

Familiarity with AWS services such as S3, Glue, Athena, EMR, and EKS for pipeline management is required, alongside working knowledge of observability tools like Datadog, CloudWatch, or Prometheus. Proficiency in Python, Scala, or Java for pipeline development and automation is necessary. Experience with infrastructure-as-code tools like Terraform and strong collaboration and problem-solving skills within distributed teams are also expected.

Essential Skills

DatabricksSparkFlinkAirflowSQLETLELTAWSPythonScalaJavaObservability Tools

Good to Have

Infrastructure-as-CodeTerraformCI/CDGitLabJenkinsGitHub ActionsData GovernanceAccess ControlCost OptimizationDatabricks Certified Data Engineer AssociateAWS Certified Solutions Architect - Associate

Highlights

  • Actively hiring

More Details

RoleLead Senior Associate | Data Engineering | Chennai | Engineering as a Service/ Operate (Chennai, IN)
IndustryMedia & Entertainment
DepartmentData Engineering, Software Development
Employment TypeFull Time, Work from office

About the Company

Deloitte logo

Deloitte

Media & Entertainment

Lead Senior Associate | Data Engineering | Chennai | Engineering as a Service/ Operate (Chennai, IN) at Deloitte | SkillMX | SkillMX