Lead the design and development of highly scalable, elastic distributed systems. You will architect key components, define and enforce scalability requirements, and optimize code and data paths for massive workloads. Expertise in designing fault-tolerant, continuously upgradable systems with advanced techniques like redundancy, replication, and failover is essential. This role involves leveraging data plane platforms for large-scale data operations and ensuring system resilience through strategies like load-shedding and throttling.

You will establish critical KPIs and telemetry, build proactive monitoring dashboards and alerts, and design sophisticated validation mechanisms, including fault injection and brownouts, to guarantee correctness and durability. The role also encompasses proactive production issue resolution, mentoring peers, and ensuring operational readiness. Additionally, you'll implement robust security controls, manage remediation, maintain compliance documentation, and develop Infrastructure as Code (IaC) and automation for safe patching and rollbacks within defined change management plans.

Architect and lead the development of scalable distributed system components, focusing on horizontal and vertical scaling and distributed state management. Optimize systems for large-scale data processing and high-throughput requirements, ensuring elasticity for both scaling up and down. Design and implement fault-tolerant systems with redundancy, replication, and automatic failover mechanisms, effectively handling network partitions and disruptions. Develop and customize dashboards, telemetry systems, and alerting mechanisms for proactive monitoring and issue identification. Design and implement functional and correctness requirements for new and existing systems, employing techniques like fault-injection and data replication. Proactively diagnose, debug, and resolve production issues, mentor team members, and ensure operational readiness and expertise. Implement robust security measures, execute remediation plans, ensure compliance with industry standards, and maintain up-to-date documentation. Develop and maintain IaC and automation scripts for managing cloud infrastructure, adhering to change management plans for updates and rollbacks.

Proven experience in leading the development and architecture of scalable, elastic distributed systems. Strong understanding of system scalability principles, including horizontal and vertical scaling, and distributed state management. Expertise in designing fault-tolerant, in-service-upgradable systems using redundancy, replication, and failover. Proficiency in optimizing code and data paths for high-throughput, hyper-scale workloads. Experience with data plane platforms for large-scale retrieval, storage, and processing. Knowledge of strategies for handling network unreliability, including load-shedding, throttling, and rate-limiting. Ability to establish KPIs and telemetry, and build proactive dashboards and alerts. Experience designing complex validation scenarios like fault injection and brownouts. Demonstrated ability to proactively diagnose and resolve production issues. Experience implementing robust security controls and executing remediation plans. Proficiency in developing IaC and automation for cloud infrastructure management and change control. Excellent problem-solving, collaboration, and communication skills. Mentoring capabilities are highly valued.