TechOps-CloudOps-Data Platform and Engineering Support

EY

5–8 yrs Thiruvananthapuram Full Time Remote
EY logo
Posted : today
Actively hiring

Job description

Join EY's Global Delivery Services as a Senior Data Platform & Engineering Support Engineer. This role offers the opportunity to provide critical production and operational support for enterprise data platforms, focusing on Databricks, Python, PySpark, and ETL solutions. You will be instrumental in troubleshooting, administering, and optimizing complex data workloads.

EY is a global leader committed to building a better working world. Our diverse teams in over 150 countries leverage data and technology to build trust and help clients grow and transform. We foster an inclusive culture where unique perspectives are celebrated and contribute to our success.

Responsibilities

Provide day-to-day production and operational support for Databricks environments, including jobs, notebooks, pipelines, and clusters. Monitor workloads, identify failures, and coordinate service restoration within agreed SLAs. Troubleshoot code failures, data issues, and cluster problems, performing root cause analysis for recurring incidents. Optimize workload performance and provide Databricks platform administration, including Unity Catalog support. Oversee production deployments using Git and CI/CD practices, and collaborate with cross-functional teams to ensure platform reliability.

Key duties also include creating runbooks, participating in health checks and cost reviews, and contributing to disaster recovery exercises. This role involves decision-making, process optimization, resource management, and potentially team supervision to achieve organizational goals.

Qualifications

A Bachelor's degree in a relevant field or equivalent professional experience is required, along with 5-8 years of experience in data engineering, platform support, or production operations. You must possess strong hands-on experience supporting Databricks workloads and proficient programming and troubleshooting skills in Python and PySpark.

Essential experience includes supporting ETL/ELT pipelines, Databricks platform administration (including Unity Catalog), and SQL with relational databases. Proven ability in leading complex incident resolution, root cause analysis, and working with Git-based development and CI/CD pipelines is crucial. Experience with distributed teams and a willingness to participate in 24/7 support rotations are also necessary.

Essential Skills

DatabricksPythonPySparkETLSQLSparkData EngineeringProduction SupportIncident ManagementRoot Cause AnalysisGitCI/CD

Good to Have

AzureAWSTerraformDatabricks Mosaic AIMicrosoft Copilot StudioLangChain

Highlights

  • Actively hiring

More Details

RoleTechOps-CloudOps-Data Platform and Engineering Support
IndustryManagement Consulting
DepartmentData Engineering
Employment TypeFull Time, Remote

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

Management Consulting