Join our AI Infra Operations team as a Principal Systems Engineer, focusing on GPU infrastructure within Oracle Cloud Infrastructure (OCI). This role is for a technical operations leader passionate about driving the development and maintenance of automation and operational tools for GPU fleets across various regions, ensuring maximum availability.

You will collaborate closely with engineering and operations teams to develop robust automation, enhance observability, and implement reliability solutions. Your continuous efforts will be crucial in improving our GPU operations and ensuring the smooth functioning of our AI infrastructure.

This is an opportunity to be at the forefront of cutting-edge technology, working with large-scale GPU deployments and contributing to the success of Oracle's cloud services.

Develop and maintain automation and operational tooling for OCI GPU infrastructure spanning multiple geographic regions.

Drive collaborative efforts with software engineers, hardware teams, and operations partners to ensure a highly available GPU fleet.

Build and enhance monitoring, alerting, and diagnostics for GPU fleet health, performance, capacity, and utilization using tools like Grafana.

Serve as the senior escalation point for complex GPU host and repair issues, providing expert guidance.

Participate actively in incident response and root-cause analysis to resolve blockers impacting GPU capacity, availability, and regional deployments.

Continuously refine AI2 Ops processes, GPU fleet automation, and OCI region build readiness.

Engage in on-call rotations, offering support for critical infrastructure challenges.

Document operational procedures, automation workflows, troubleshooting guides, and runbooks to ensure knowledge transfer.

Develop and improve AI agents, overseeing their safe rollout, execution, and monitoring.

Mentor and guide junior engineers on operational best practices, provide senior technical support, and foster a culture of constant improvement.

Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Minimum of 7 years in software operations or infrastructure automation, with strong proficiency in Python and Bash.

Expert-level Linux administration experience, specifically with Ubuntu and Oracle Linux, in large-scale production environments.

Solid understanding of distributed systems, including peer-to-peer, node-to-node, and service-to-service communication patterns.

Extensive experience with data-center and host-lifecycle management, encompassing provisioning, validation, repair workflows, hardware replacement, and fleet recovery.

Exceptional problem-solving and troubleshooting capabilities.

Excellent communication and teamwork skills are essential for this role.

Proven experience with observability tooling, including metrics, logging, dashboards, and alerting.

Familiarity with AI agents and related tooling.

Experience leading on-call operations and incident response activities.