Join Amazon's Selection Monitoring team and contribute to building and operating large-scale data processing systems that enhance catalog intelligence globally. Our innovative systems process billions of products, utilizing cutting-edge parallel processing, machine learning, and deep learning algorithms to ensure comprehensive and high-quality product information. This role is pivotal in creating datasets and insights that empower Amazon teams to make data-driven decisions, ultimately improving customer experiences.

We specialize in developing state-of-the-art data processing pipelines and Information Retrieval (IR) systems designed to manage diverse data streams and automatically structure unstructured or semi-structured data. The team consistently pushes the boundaries of large-scale distributed systems, streaming and batch processing, elastic computing, big data, artificial intelligence, and service-oriented architectures to address challenges at Amazon's immense scale. Become part of our mission to build the foundational data infrastructure powering Amazon's catalog intelligence.

As a key member of our team, you will be instrumental in:

- Designing and constructing scalable data processing systems capable of handling real-time crawler data and pre-computed datasets from various sources, ensuring seamless integration and orchestration. - Developing robust pipelines and frameworks for ingesting, processing, transforming, and enriching product data at scale using AWS technologies, including both streaming and batch processing platforms. - Collaborating with Senior Engineers to shape the technical and architectural direction of systems responsible for generating structured domain entities from diverse data sources. - Building comprehensive observability and metrics systems to proactively identify bottlenecks, monitor system health, and provide actionable reporting for informed decision-making. - Tackling complex challenges in data integration, entity resolution, deduplication, and classification across heterogeneous data sources with varying quality and formats. - Designing and implementing efficient storage solutions for large-scale datasets, optimizing performance for high-volume ingestion and read-intensive analytical workloads. - Leading and mentoring fellow engineers, championing best practices in design, coding, testability, operational excellence, and security. - Owning the end-to-end delivery of critical systems, from initial requirements to ongoing operational support.

We are seeking Software Development Engineers (SDEs) with strong technical acumen and a proven background in engineering large-scale software systems. A passion for solving complex problems is essential. This role requires a high-performing, flexible individual ready to take ownership of system success and drive solutions from conception through design, coding, testing, and deployment in a fast-paced environment.

The ideal candidate will play a significant part in developing innovative solutions for processing and integrating data from multiple sources at scale. You should possess a high degree of ownership, the ability to deliver end-to-end solutions, and drive measurable impact. This position offers exposure to solving large-scale problems in data engineering, real-time and batch processing, observability, artificial intelligence, big data, and cloud-scale distributed systems.

Basic Qualifications: - A minimum of 3 years of professional software development experience, excluding internships. - At least 2 years of experience in designing or architecting new and existing systems, focusing on design patterns, reliability, and scaling. - Proficiency in at least one software programming language.

Preferred Qualifications: - Over 3 years of experience across the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing, and operations. - A Bachelor's degree in Computer Science or a related field is preferred.