Join Google Cloud as a Staff Software Engineer, focusing on Infrastructure. You'll be instrumental in developing cutting-edge technologies that empower billions of users globally. This role involves tackling complex challenges in areas like large-scale systems, distributed computing, and AI, contributing to products that handle information at a massive scale. You will have the opportunity to switch between diverse projects, driving innovation across the full stack.

Google Cloud is dedicated to digitally transforming businesses and industries worldwide. We provide enterprise-grade solutions leveraging Google's advanced technology, enabling developers to build more sustainably. Trusted by customers in over 200 countries, we partner to foster growth and resolve critical business challenges.

Design and implement enhancements for telemetry, monitoring, and logging systems to boost observability and debugging for Dataproc and Managed Service for Apache Spark.

Architect and optimize observability pipelines for Spark Streaming and Structured Streaming, offering insights into micro-batch latencies, checkpointing, and input message lag.

Utilize deep understanding of Apache Spark internals to develop tools for detecting performance regressions, data skew, and resource inefficiencies.

Collaborate with product and UX teams to create intuitive monitoring dashboards, cost-attribution features, and developer tools.

Partner with Dataproc and Cloud Platform teams to integrate and deploy telemetry features, OpenTelemetry pipelines, and diagnostic frameworks safely at scale, building robust monitoring for big data workloads.

A Bachelor's degree or equivalent practical experience is required.

Candidates must possess 8 years of programming experience in C++, Python, C, C++, Java, and JavaScript.

Significant experience (5 years) is needed in building and developing large-scale infrastructure, distributed systems, or networks, or in compute technologies, storage, or hardware architecture.

A minimum of 5 years of experience in testing and launching software products is essential.

Preferred qualifications include 8 years of experience with data structures and algorithms, 3 years in a technical leadership role, and 3 years of experience in complex, cross-functional projects. Familiarity with backend server infrastructure and a strong grasp of algorithm performance are also beneficial.