Software Development Engineer, AI Runtime

Amazon

3+ yrs Pune Full Time Work from office
Amazon logo
Posted : today
Actively hiring

Job description

Join our dynamic team as a Software Development Engineer focused on AI Runtime infrastructure for Alexa+. This is a key role where you will architect and implement critical distributed systems essential for expert agent execution, LLM inference pipelines, and low-latency global delivery across Alexa devices. Your contributions will directly influence the daily experience of millions of users.

This high-impact position offers the opportunity to shape the future of AI-driven interactions. Be part of a team building the foundational elements that make Alexa+ feel magical.

Responsibilities

Design, develop, and maintain large-scale distributed services powering Alexa+ Expert executions. Optimize LLM orchestration pipelines, including model serving, prompt routing, and inference efficiency. Build sophisticated multi-agent coordination systems for minimal latency request routing. Ensure operational excellence and high availability for Tier-1 services. Collaborate closely with applied scientists and ML engineers to integrate cutting-edge AI capabilities into production. Drive architectural decisions balancing performance, reliability, and cost. Mentor team members and elevate engineering standards through comprehensive code and design reviews.

Qualifications

A minimum of 3 years of professional software development experience (excluding internships) is required. Additionally, at least 2 years of experience in designing or architecting new and existing systems, focusing on design patterns, reliability, and scaling, is essential. A Bachelor's degree or its foreign equivalent in Computer Science, Engineering, Mathematics, or a related field is necessary. Proficiency in at least one programming language is a must.

Preferred qualifications include 3+ years of experience across the full software development life cycle, encompassing coding standards, code reviews, source control, build processes, testing, and operations. A Bachelor's degree in Computer Science or equivalent is beneficial. Experience with system design incorporating AI components, evaluating latency, cost, reliability, and accuracy, is highly valued.

Essential Skills

Software DevelopmentSystem DesignDistributed SystemsAILLMOrchestrationInferenceLatencyReliabilityScalingArchitectureProgramming Languages

Good to Have

Full Software Development Life CycleCoding StandardsCode ReviewsSource Control ManagementBuild ProcessesTestingOperationsAI Components

Highlights

  • Actively hiring

More Details

RoleSoftware Development Engineer, AI Runtime
DepartmentSoftware Development
Employment TypeFull Time, Work from office

About the Company

Amazon logo

Amazon

IT Consulting

Software Development Engineer, AI Runtime at Amazon | SkillMX | SkillMX