Senior Associate | Databricks | Bengaluru | Engineering as a Service/ Operate (Bengaluru, IN)
Deloitte
Deloitte
Join our dynamic team as a Senior Product Development Engineer I, focusing on maintaining and enhancing the cloud infrastructure that powers critical Ad Technology data platforms. This role is pivotal for ensuring the day-to-day stability and optimal performance of systems utilizing Airflow (MWAA), Spark, Flink on EKS, and Databricks within the AWS environment. You will be instrumental in addressing incidents, resolving complex issues, maintaining infrastructure integrity, and implementing impactful improvements for greater reliability and efficiency.
This is an exceptional opportunity for a seasoned engineer who thrives in production settings, enjoys tackling intricate infrastructure challenges, and is dedicated to upholding the robustness of platforms vital to Disney’s advertising operations.
You will be responsible for hands-on platform support of production EKS workloads, CI/CD pipelines, and AWS infrastructure. Key duties include building and maintaining Terraform modules, scripts, and monitoring tools for platform diagnostics and issue resolution. You'll actively troubleshoot and perform root cause analysis on EKS, Istio, and CI/CD systems, ensuring swift recovery and detailed documentation.
Collaboration is essential as you partner with application and DevOps teams on shared projects. You will also contribute to operational runbooks, define infrastructure standards, and promote best practices for platform reliability.
We are seeking candidates with a minimum of 4 years of experience in infrastructure, platform engineering, or DevOps roles, complemented by a background in data systems support. A strong operational grasp of AWS infrastructure, including IAM, VPC, EKS, and ALB/NLB, is essential. You should possess hands-on knowledge of data infrastructure platforms such as MWAA, Databricks, and running Spark and Flink on Kubernetes in production.
Experience supporting CI/CD platforms like Jenkins and Spinnaker, including troubleshooting pipelines, is required. Familiarity with cloud security and networking concepts relevant to EKS (IAM, TLS, VPCs, DNS) is important. Excellent collaboration and communication skills are necessary to align with distributed engineering teams. Proficiency in infrastructure-as-code tools like Terraform and scripting languages such as Python or Go is a must. Participation in on-call rotations and experience with high-severity incident resolution are also key qualifications. A Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent experience, is required.
Deloitte
Technology