Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate

Deloitte

5+ yrs Bengaluru Full Time Hybrid (office + remote)
Deloitte logo
Posted : yesterday
Actively hiring

Job description

Join a dynamic team as a Senior Data Engineer, playing a crucial role in making Disney Entertainment a more data-driven organization. You'll collaborate with partner teams to enhance the reliability and observability of critical data pipelines. This position offers the opportunity to make a significant impact within an organization that prioritizes data excellence. We thrive in a fast-paced, collaborative environment, seeking passionate individuals adept at solving complex challenges and working with distributed systems at scale. On-call duties, including rotational weekend shifts, are part of the role, balanced with a commitment to a healthy work-life balance.

Responsibilities

Lead and mentor the Data Reliability Engineering team, managing production incidents, performing root cause analysis, and ensuring timely resolutions through Tier 1 and Tier 2 support. Develop RCAs to prevent future incidents for engineering partners. Design and build a platform for incident observability and automation, creating high-quality data models and products to monitor data pipeline health and quality. Collaborate with engineering teams to maintain, performance-tune, and respond to incidents impacting our big data pipeline infrastructure. Implement robust observability and intelligent monitoring for data pipelines and infrastructure, enabling early, automated anomaly detection and alerting. Present research and insights clearly and concisely to various organizational levels.

Qualifications

Requires a minimum of 5 years of experience with mission-critical data pipelines and ETL systems. Possess 5+ years of hands-on experience with big data technologies and tools like AWS, Hadoop, Hive, and Snowflake. Demonstrated expertise in common data engineering languages including Python, Scala, Java, and SQL, with a proven capacity to learn new programming languages. Experience with workflow orchestration tools such as Airflow is essential. A deep understanding of end-to-end pipeline design and implementation, coupled with strong problem-solving, attention to detail, and interpersonal skills, is expected.

Essential Skills

PythonScalaJavaSQLAWSHadoopHiveSnowflakeAirflowETLData Pipelines

Good to Have

DockerKubernetesJenkinsApache KafkaData Visualization

Highlights

  • Actively hiring

More Details

RoleSenior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate
IndustryTechnology, Entertainment
DepartmentData Engineering, Software Development
Employment TypeFull Time, Hybrid (office + remote)

About the Company

Deloitte logo

Deloitte

Technology

Senior Associate | Data Engineering | Bengaluru | Engineering as a Service/ Operate at Deloitte | SkillMX | SkillMX