Join Google's innovative Search Platforms team as a Senior Software Engineer, focusing on LLM Evaluation Infrastructure. You will play a crucial role in developing cutting-edge platforms that power the next generation of Google Search, handling massive scale and complex information.
This position offers the chance to contribute to a global mission, shaping how billions interact with information. You'll work on challenging engineering problems, expand critical infrastructure, and ensure a universally accessible and useful search experience.
As part of the Search team, your contributions will directly impact users worldwide. This is an opportunity to be at the forefront of search technology evolution.
Architect, develop, and maintain robust, high-throughput platform services and orchestration pipelines for automated evaluation, benchmarking, and metric computation of Generative AI search experiences.
Design sophisticated evaluation systems to detect metric drift, optimize throughput, and scale AI-assisted rating workflows efficiently.
Lead the modernization and integration of disparate evaluation pipelines into a unified core platform, creating reusable and extensible frameworks.
Enhance system throughput, reduce execution times, and optimize resource utilization for continuous, high-volume evaluation workloads.
Incorporate advanced AI tooling, automated validation, and AI-assisted workflows to elevate developer productivity, evaluation quality, and system reliability.
A Bachelor's degree or equivalent practical experience is required, along with 5 years of software development experience in at least one programming language. You'll also need 3 years of experience with embedded operating systems and 3 years working with software products, including testing, maintenance, or launches. A year of experience in software design and architecture is essential.
Preferred qualifications include a Master's degree or PhD in Computer Science or a related technical field, 5 years of experience with data structures and algorithms, and 1 year in a technical leadership role. Experience developing accessible technologies is also highly valued.
IT Consulting