Principal Core Infrastructure Engineer
Oracle
Oracle
Lead the architecture and development of highly scalable, elastic distributed systems. Drive improvements in performance, reliability, security, and operational excellence. This role involves defining scalability requirements and SLOs, designing fault-tolerant services for zero-downtime upgrades, and establishing robust telemetry and resilience testing practices. You'll also tackle complex production issues, mentor fellow engineers, and build infrastructure automation for secure deployments, patching, and rollbacks.
Develop and implement cutting-edge components for scalable distributed systems, focusing on horizontal and vertical scaling to meet dynamic demands. Optimize code and systems for large-scale data processing and high-throughput needs, ensuring they support hyper-scale environments. You will define clear scalability requirements for your components and ensure designs and implementations meet these crucial metrics. Design systems for elasticity, allowing for efficient scaling both up and down, and leverage data plane platforms for effective large-scale data retrieval, storage, and processing. Performance and load testing will be integral to your design process.
Build and design fault-tolerant components and systems capable of withstanding in-service updates through redundancy, replication, and automatic failover. Design systems to effectively manage service disruptions, prioritizing consistency, availability, or partition tolerance. Implement and optimize strategies for handling network unreliability, including load-shedding, throttling, and rate-limiting. Ensure components and systems are durable and adhere to Service Level Objectives (SLOs), setting clear expectations for the availability and durability of other services within the department.
Define key performance indicators (KPIs) and telemetry to proactively identify gaps or issues in running systems. Construct and customize sophisticated dashboards, telemetry systems, and alerting mechanisms to monitor component and system health. Design and implement functional and correctness requirements for features and systems, both new and existing. Develop complex test scenarios, such as fault injection and brown-outs, to rigorously evaluate system correctness. Implement data replication and synchronization techniques to uphold data integrity and availability.
Take a lead role in diagnosing, debugging, and resolving issues in active components and systems to ensure ongoing operation, while also mentoring others. Implement strategies to prevent service interruptions, ensuring no maintenance windows are required for customers and users during issue resolution. Maintain deep expertise in your owned components and systems to facilitate effective troubleshooting and performance optimization. Meet operational readiness expectations through thoughtful design and implementation. Participate in operational support rotations, providing expert guidance during incident response and root cause investigations.
Implement robust security measures to safeguard data and applications in multi-tenant environments, including advanced encryption techniques and access controls. Execute remediation plans to address identified security vulnerabilities. Ensure cloud infrastructure adheres to industry standards and regulations, and maintain up-to-date documentation.
Develop and maintain automation scripts and tools, such as Infrastructure as Code (IaC), to efficiently manage cloud infrastructure. Create and follow change management plans for patching, updating, and rolling back applications, and begin designing systems and components to facilitate automation of these processes.
Lead the architecture and development of scalable distributed systems, focusing on performance, reliability, and security. Define scalability requirements, SLOs, and design fault-tolerant services for zero-downtime upgrades. Establish telemetry, rigorous resilience testing, and resolve complex production issues. Mentor engineers and build infrastructure automation for safe deployments, patching, and rollbacks. Optimize code and systems for large-scale data processing and high-throughput requirements. Design systems for elasticity and leverage data plane platforms for effective data management. Build and design fault-tolerant components with redundancy and automatic failover mechanisms. Implement strategies for handling network unreliability, including load-shedding and throttling. Define KPIs and telemetry to monitor system health and proactively identify issues. Design and implement functional and correctness requirements for systems, including complex test scenarios. Take a proactive role in diagnosing, debugging, and resolving production issues. Implement robust security measures and execute remediation plans for identified gaps. Develop and maintain automation scripts and tools, including Infrastructure as Code (IaC).
7+ years of industry experience in commercial or open-source software development. Strong fluency in modern programming languages such as C++ or Java. Excellent problem-solving skills and a deep understanding of Computer Science fundamentals, including data structures, algorithms, and distributed systems. Experience with cloud infrastructure (AWS/GCP/Azure) and building control plane systems for cloud scale. Strong systems programming skills, including multi-threading and concurrency. A solid foundation in distributed systems concepts like consistency, scaling, and failure recovery. Experience with implementation testing, debugging, and documentation within a Linux development environment. BS in Computer Science; Masters degree is preferred. Demonstrated curiosity, a willingness to question, and a passion for improving systems. Proven experience designing architectures with deep technical depth or broad product span, enabling high availability, scalability, and flexibility for future business demands.
Oracle
IT Consulting