TechOps-CloudOps-AI-ML Platform Operations Senior Engineer

EY

5–8 yrs Thiruvananthapuram Full Time Hybrid (office + remote)
EY logo
Posted : today
Actively hiring

Job description

Join EY's Global Delivery Services as a Senior AI/ML Platform Operations Engineer. This role focuses on operating, supporting, and enhancing enterprise machine learning and generative AI platforms. You will be instrumental in MLOps and LLMOps, covering model deployment, monitoring, API management, and incident resolution.

As a key technical escalation point for production AI services, you will collaborate with data scientists, ML engineers, application teams, cloud specialists, security, and business stakeholders to ensure the delivery of reliable, secure, scalable, and cost-effective AI solutions.

EY offers a unique career path with global scale and a supportive, inclusive culture. Shape your future with confidence and contribute to building a better working world.

Responsibilities

Provide essential day-to-day production and operational support for machine learning and generative AI platforms across all environments. Deploy, configure, and validate ML models and inference services using robust MLOps and LLMOps practices.

Monitor real-time and batch inference, APIs, endpoints, and pipelines, ensuring prompt restoration of degraded services. Troubleshoot a wide range of issues including endpoint errors, latency, authentication, and scaling problems.

Operate and maintain model lifecycle pipelines, including training, evaluation, deployment, and rollback. Support prompt templates, system instructions, model parameters, and guardrails. Implement and maintain comprehensive observability for model quality, performance, cost, drift, and safety.

Investigate production incidents, perform root cause analysis, and implement preventive measures. Develop and maintain Python utilities, automation scripts, and operational dashboards. Support enterprise integrations with leading AI services and platforms.

Ensure secure handling of sensitive data, model endpoints, and API keys. Support capacity planning, autoscaling, and cost optimization for AI workloads. Coordinate controlled releases using Git and CI/CD, including testing, versioning, and post-release monitoring.

Manage complex incidents, service requests, and changes, mentoring junior engineers. Create and maintain essential operational documentation, including runbooks and knowledge bases. Drive decision-making and optimize processes for efficient task execution.

Qualifications

We seek a Senior AI/ML Platform Operations Engineer with 5-8 years of experience in platform engineering, DevOps, or cloud operations, including at least 2 years supporting ML or generative AI workloads. A Bachelor's degree in a relevant field or equivalent professional experience is required.

Key technical skills include strong hands-on MLOps and LLMOps knowledge, experience with model APIs and endpoints, and proficiency in Python for automation and troubleshooting. Familiarity with OpenAI APIs, AWS Bedrock, or comparable platforms is essential.

You should possess a solid understanding of machine learning and generative AI evaluation methods, with the ability to interpret complex system telemetry to isolate failures. Strong incident management, root cause analysis, and problem-solving skills are crucial.

Excellent communication and stakeholder management abilities are necessary to explain operational risks and remediation plans effectively. The capacity to mentor engineers and promote reliability standards is also valued. Willingness to participate in 24/7 support rotations is required.

Essential Skills

MLOpsLLMOpsPythonAPI OperationsObservabilityIncident ManagementRoot Cause AnalysisCI/CDGitProduction SupportStakeholder ManagementCloud Operations

Good to Have

OpenAI APIsAWS BedrockAzure OpenAIKubernetesDockerTerraformAWS CloudFormationAmazon CloudWatchAzure MonitorPrometheusGrafanaResponsible AIAI SecurityVector DatabasesLangChainLangGraphSemantic Kernel

Highlights

  • Actively hiring

More Details

RoleTechOps-CloudOps-AI-ML Platform Operations Senior Engineer
IndustryFinancial Services, Management Consulting
DepartmentData Science
Employment TypeFull Time, Hybrid (office + remote)

About the Company

EY Global Delivery Services ( EY GDS) logo

EY Global Delivery Services ( EY GDS)

Financial Services