Sr Applied Scientist LLM, Amazon Search

We’re working to improve shopping on Amazon using the conversational capabilities of large language models, and are searching for pioneers who are passionate about technology, innovation, and customer experience, and are ready to make a lasting impact on the industry. You'll be working with talented scientists, engineers, and technical program managers (TPM) to innovate on behalf of our customers. If you're fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey!BASIC QUALIFICATIONS- 3+ years of building machine learning models for business application experience- PhD, or Master's degree and 6+ years of applied research experience- Experience programming in Java, C++, Python or related language- Experience with neural deep learning methods and machine learning ...

Sr Economist, Amazon Search, Amazon

Amazon is one of the most popular sites in the US. Our product search engine, one of the most heavily used services in the world, indexes billions of products and serves hundreds of millions of customers world-wide.Within Amazon Search, the Data Science team brings expertise in constrained optimization, modeling data, and experimental methods. We partner with internal and external teams to bring create pioneering new insights, develop new measurement and testing methodologies, and hone optimization strategies. We ensure Search's systems, models, and teams properly optimizing over trade-offs in the function of the search experience. In addition to working with partners, we incubate new modeling techniques, and perform 'front line recon' on potential new models and tools. We are looking for a Senior Economist to independently leverage petabyte scale data, seek out opportunities, and deliver models, metrics, or insights that creates wins for customers.Key job responsibilitiesMeasure / Quantify / Expand- Design, size, and analyze field experiments at scale.- Apply econometric or statistical knowledge to improve Amazon Search (using machine learning techniques is a plus)- Retrieve, synthesize, and present critical data in a format that is immediately useful to answering specific questions or improving system performance.- Analyze historical data to identify trends and support decision making.Explore / Enlighten- Formalize assumptions about how Amazon Search is expected to work.- Given anomalies, whether anecdotal or identified automatically, deep dive to explain why they happen, and identify fixes.Decide / Recommend- Build decision-making models and propose solution for the business problem you defined- Analyze A/B tests and extract understanding of customer behavioral responses- Conduct written and verbal presentation to share insights and recommendations to audiences of varying levels of technical sophistication.- Utilize code (python or another object oriented language) for data analyzing and modeling algorithmAbout the teamThe mission of the Search Data Science team is to build a world class shopping experience that delights customers. We focus on the long term and big picture, ensuring that the search page is balancing strategic trade-offs. We bring to this effort expertise in constrained optimization, causal inference, and marketplace equilibrium effects. We build systems, metrics, and mechanisms to ensure that product decisions are scientifically sound. We develop models to estimate the downstream dollar value of the quality of the experience. We spend time on evaluating experiments to develop durable learnings.BASIC QUALIFICATIONS- PhD in economics or equivalent- Experience in building statistical models using R, Python, STATA, or a related software ...

Sr. Applied Scientist, Amazon

The Amazon Search Mission Understanding (SMU) team is at the forefront of revolutionizing the online shopping experience through the Amazon search page. Our ambition extends beyond facilitating a seamless shopping journey; we are committed to creating the next generation of intelligent shopping assistants. Leveraging cutting-edge Large Language Models (LLMs), we aim to redefine navigation and decision-making in e-commerce by deeply understanding our users' shopping missions, preferences, and goals. By developing responsive and scalable solutions, we not only accomplish the shopping mission but also foster unparalleled trust among our customers. Through our advanced technology, we generate valuable insights, providing a guided navigation system into various search missions, ensuring a comprehensive and holistic shopping experience. Our dedication to continuous improvement through constant measurement and enhancement of the shopper experience is crucial, as we strategically navigate the balance between immediate results and long-term business growth.We are seeking an Applied Scientist who is not just adept in the theoretical aspects of Machine Learning (ML), Artificial Intelligence (AI), and Large Language Models (LLMs) but also possesses a pragmatic, hands-on approach to navigating the complexities of innovation. The ideal candidate will have a profound expertise in developing, deploying, and contributing to the next-generation shopping search engine, including but not limited to Retrieval-Augmented Generation (RAG) models, specifically tailored towards enhancing the Rufus application—an integral part of our mission to revolutionize shopping assistance. You will take the lead in conceptualizing, building, and launching groundbreaking models that significantly improve our understanding of and capabilities in enhancing the search experience. A successful applicant will display a comprehensive skill set across machine learning model development, implementation, and optimization. This includes a strong foundation in data management, software engineering best practices, and a keen awareness of the latest developments in distributed systems technology. We are looking for individuals who are determined, analytically rigorous, passionate about applied sciences, creative, and possess strong logical reasoning abilities.Join the Search Mission Understanding team, a group of pioneering ML scientists and engineers dedicated to building core ML models and developing the infrastructure for model innovation. As part of Amazon Search, you will experience the dynamic, innovative culture of a startup, backed by the extensive resources of Amazon.com (AMZN), a global leader in internet services. Our collaborative, customer-centric work environment spans across our offices in Palo Alto, CA, and Seattle, WA, offering a unique blend of opportunities for professional growth and innovation.Key job responsibilitiesCollaborate with cross-functional teams to identify requirements for ML model development, focusing on enhancing mission understanding through innovative AI techniques, including retrieval-Augmented Generation or LLM in general. Design and implement scalable ML models capable of processing and analyzing large datasets to improve search and shopping experiences. Must have a strong background in machine learning, AI, or computational sciences.Lead the management and experiments of ML models at scale, applying advanced ML techniques to optimize science solution.Serve as a technical lead and liaison for ML projects, facilitating collaboration across teams and addressing technical challenges. Requires strong leadership and communication skills, with a PhD in Computer Science, Machine Learning, or a related field.BASIC QUALIFICATIONS- 3+ years of building models for business application experience- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience- Experience with Large Language Models- Experience programming in Java, C++, Python or related language ...

Sr. Applied Scientist, LLM, Natural Language Shopping, Search Quality

Come transform Amazon Search using Large Language Models (LLMs). We are building new approaches to bring in a step change to both Amazon Rufus and Amazon Search.You will innovate with your team to provide delightful answers to customers by incorporating world knowledge in matching and ranking models, and helping the models deeply understand semantic meaning in descriptive and conversational queries such as "light tent for snow camping with my son", “best toys for on the go” or “cheap plus size summer pajamas”.Key job responsibilities- You will analyze large scale datasets- define metrics that reflect customer experience- invent techniques that improve capabilities such as understanding of natural language queries, questions and conversations- test your ideas in controlled experiments- train, fine-tune and align Large Language Models (LLMs).- distill Large Language Models into Fast Language Models and deploy them to operate at Amazon scale with imperceptible latenciesBASIC QUALIFICATIONS- 3+ years of building machine learning models for business application experience- PhD, or Master's degree and 6+ years of applied research experience- Experience programming in Java, C++, Python or related language- Experience with neural deep learning methods and machine learning ...

Sr. Applied Scientist, Search Experimentation and ML

The Amazon Search team creates powerful, customer-focused search solutions and technologies. Whenever a customer visits an Amazon site worldwide and types in a query or browses through product categories, Amazon Product Search services go to work. We design, develop, and deploy high performance, fault-tolerant distributed search systems used by millions of Amazon customers every day. Our Search Relevance team works to maximize the quality and effectiveness of the search experience for visitors to Amazon websites worldwide.The Search Relevance team focuses on several technical areas for improving search quality. In this role, you will invent universally applicable signals and algorithms for training machine-learned ranking models. The relevance improvements you make will help millions of customers discover the products they want from a catalog containing millions of products. You will work on problems such as predicting the popularity of new products, developing new ranking features and algorithms that capture unique characteristics, and analyzing the differences in behavior of different categories of customers. The work will span the whole development pipeline, including data analysis, prototyping, A/B testing, and creating production-level components.Joining this team, you’ll experience the benefits of working in a dynamic, entrepreneurial environment, while leveraging the resources of Amazon.com (AMZN), one of the world’s leading Internet companies. We provide a highly customer-centric, team-oriented environment in our offices located in Palo Alto, California.Please visit https://www.amazon.science for more information.Key job responsibilitiesKey job responsibilities for this role include but not limited to 1) exploring new hypotheses related to better search ranking, 2) training state of the art DL ranking models to balance multiple aspects of relevance and personalization, and 3) design, running, and analyzing AB tests to validate your hypotheses.BASIC QUALIFICATIONS- 3+ years of building machine learning models for business application experience- PhD, or Master's degree and 4+ years of applied research experience- Experience programming in Java, C++, Python or related language- Experience with neural deep learning methods and machine learning- Experience in patents or publications at top-tier peer-reviewed conferences or journals ...

Sr. Applied Scientist, Search Ranking

The Amazon Search team creates customer-focused search solutions and technologies. Whenever a customer visits an Amazon site worldwide and types in a query or browses through product categories, our services go to work. We design, develop, and deploy high performance, fault-tolerant distributed search systems used by millions of Amazon customers every day.Within Amazon Search, the Relevance Ranking team has a mission to solve customer problems that require advancing the state of the art in ranking. We work backwards from the customer to create value for them by addressing an underlying, unsolved scientific problem. We deploy our solutions through distributed systems that operate at millisecond latencies at Amazon scale. We strive to publish our solutions and open-source our software so that the broader scientific community can benefit.As a Sr. Applied Scientist on our team, your role is to leverage your strong background in Computer Science, Deep Learning and Generative AI to help build the next generation of our model development and assessment pipeline, harness and explain rich data at Amazon scale, and provide automated insights to improve machine learned models that impact millions of customers every day. This role requires a pragmatic technical leader comfortable with ambiguity, capable of summarizing complex data and models through clear visual and written explanations. The ideal candidate will have experience with deep learning models and information retrieval/recommendation systems. We are particularly interested in experience applying natural language processing, deep learning, and generative AI at scale. Additionally, we are seeking candidates with strong rigor in applied sciences and engineering, creativity, curiosity, and great judgment.Your responsibilities include: - Analyze the data and metrics resulting from traffic into Amazon's product search service. - Design, build, and deploy effective and innovative ML solutions to improve search ranking. - Evaluate the proposed solutions via offline benchmark tests as well as online A/B tests in production. - Publish and present your work at internal and external scientific venues in the fields of ML/NLP/IR.Your benefits include: - Working on a high-impact, high-visibility product, with your work improving the experience of millions of customers. - The opportunity to use (and innovate) state-of-the-art ML methods to solve real-world problems. - Excellent opportunities, and ample support, for career growth, development, and mentorship. - Competitive compensation, including relocation support.The Relevance Ranking team operates primarily out of Amazon's Palo Alto office. You will have an opportunity to influence our goals and mission. Your solutions will impact all of Amazon's retail customers. We are a mix of applied scientists and software engineers who collaborate with other teams within Amazon Search to solve and deploy deep learning solutions at scale.BASIC QUALIFICATIONS- 5+ years of building machine learning models for business application experience- PhD, or Master's degree- Experience programming in Java, C++, Python or related language- Experience with neural deep learning methods and machine learning ...

Sr. Financial Analyst, Shopping Finance

We are seeking a Sr. Financial Analyst to join the Finance Team supporting and partnering with the Amazon Search team in the Shopping org. We at Shopping finance are at the intersection of Amazon Retail and Shopping Technology. We are insightful, influential, inquisitive, and analytical. We collaborate across organizations, celebrate and leverage diverse perspectives, and support our peers to excel both at work and away from work. As a Sr. Financial Analyst, you will work closely with finance and business leaders to develop financial models, provide analytical insights to assist in evaluating new business concepts, turn insights into operational measurements, and identify paths to improve the planning and reporting process.Key job responsibilities- Collect, analyze and manage quantitative data to create meaningful analyses and build financial models that drive business decisions.- Create, improve, and maintain reports for key financial and operation metrics.- Analyze monthly financial and business metrics, report on key trends vs. plan, peel back the layers to understand underlying drivers of financial performance.- Perform Month end close related activities.- Execute monthly, quarterly, and ad-hoc operating expense reports for the Search org.- Partner with finance technology partners to identify opportunities to create efficiencies, streamline reporting and planning of infrastructure expenses and drive automation.- Partner with business teams to enable success in the annual Goals process.- Drive continuous improvement and standardization of processes, including implementation of best practices, and collaborate with other teams.BASIC QUALIFICATIONS- Bachelor's degree in finance, accounting or related field- 3+ years of tax, finance or a related analytical field experience ...

Sr. Research Scientist, Ads Science and Analysis Team

We are seeking a scientist to further the development and application of analytics methods to examine the complex data flows of Amazon Ads and to translate deep-dives into actionable insights for our product teams. In this role you will develop new tools to analyze our advertising data to help improve the performance of our bidding algorithms, targeting and relevance systems, help advance our supply strategy, and evaluate the adoption and impact of feature releases.Key job responsibilities- Analyze data trends regarding supply, optimization, ad load, and advertising mix effects that affect advertiser performance and contribute to achieving advertiser goals- Present papers to senior leaders on issues like feature development impact on identity recognition rates, and changes of ad selection systems to improve fill rate highlighting insights that will inform our business development and engineering roadmaps- Formalize our analytics approach to Ads auctions by analyzing bid spreads, auction depth, and simulating impacts of potential auction structure changes- Identify, standardize, and operationalize KPIs to effectively measure the performance of all systems involved in ad serving, and use trend insights to inform business priorities- Partner with engineering teams to define data logging requirements and getting these prioritized in engineering roadmaps- Validate financial models through analysis- Develop and own ad revenue and supply intelligence analytics decks that provide ongoing deep-divesA day in the lifeThe Ads Scientist will work closely with business leaders and engineers on developing common data architecture that will optimize our data logging at different grains, and will allow data interoperability from bid flow to optimization to campaign delivery. The candidate will then analyze the data and present papers and ongoing reports on actionable insights.About the teamThe Ads Science Product Team's Mission: Work alongside those who need product data to apply objective perspective and business logic to uncover insights, advise strategic decisions, and adjust to industry changes.BASIC QUALIFICATIONS- 3+ years of investigating the feasibility of applying scientific principles and concepts to business problems and products experience- PhD, or Master's degree and 5+ years of quantitative field research experience- Experience with big data technologies such as AWS, Hadoop, Spark, Pig, Hive etc.- Experience communicating qualitative research methods and findings to non-qualitative researchers ...

Sr. Software Development Engineer - Data Infra, Search Ranking

The Amazon Search team creates powerful, customer-focused search and advertising solutions and technologies. Whenever a customer visits an Amazon site worldwide and types in a query or browses through product categories, Amazon Search services go to work. We design, develop, and deploy high performance, fault-tolerant distributed search systems used by millions of Amazon customers every day. Our Search Relevance team works to maximize the quality and effectiveness of the search experience for visitors to Amazon websites worldwide. Amazon’s large scale brings with it unique problems to solve in designing, testing, and deploying relevance deep-learned models. We are seeking a strong software engineer to join the Search Relevance team and build data infrastructure to cater the needs to build deep learned models.In this role, you will: * Design, develop and deploy ML Data infrastructure for search ranking at Amazon scale. * Be curious. You will work alongside systems engineers, machine learning scientists, and data analysts. Your effectiveness and impact will depend on discussing problems with and learning from them. * Take ownership and understand the needs of various search teams (including search science teams), distil those into coherent projects, and implement them with an eye on long-term impact. You will see the fruits of your efforts used by hundreds of millions of users. * Be a leader. You will use your expertise to set a high bar for the team, mentor team members, set the tone for how to take on and deliver on large scale complex projects. * Be ambitious. You will find and eagerly tackle hard problems. The phrase ‘can’t be done’ should energize you. * Be customer focused. You will work backwards from customer problems, figure out elegant solutions, and implement them for speed and scalability. * Join a highly talented team of Engineers working on solving interesting problems in a fun and collaborative environment. * Get exposure to large scale use of various AWS components such EC2, S3, EMR, Sagemaker etc. * Have access to the vast technical tools and resources of Amazon. Joining this team, you’ll experience the benefits of working in a dynamic, entrepreneurial environment, while leveraging the resources of Amazon.com (AMZN), one of the world's leading internet companies.BASIC QUALIFICATIONS- 5+ years of non-internship professional software development experience- 5+ years of programming with at least one software programming language experience- 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience as a mentor, tech lead or leading an engineering team- Experience in machine learning, data mining, information retrieval, statistics or natural language processing ...

Sr. Technical Program Manager, Amazon

We are reimagining Amazon Search by introducing an interactive conversational experience that makes finding the perfect product easier than ever. With our state-of-the-art Large Language Model (LLM) innovations, you can now ask product-related questions, compare products, receive personalized suggestions, and more—all through a fast and reliable natural language conversation. This is just the beginning of a new era in online shopping, and the future is yours to shape.We're searching for pioneers who are passionate about technology, innovation, and customer experience, and who are ready to make a lasting impact on the industry. You'll be working with talented scientists, and engineers to innovate on behalf of our customers. If you're fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey and change the world of eCommerce forever!BASIC QUALIFICATIONS- 5+ years of technical product or program management experience- 7+ years of working directly with engineering teams experience- 3+ years of software development experience- 5+ years of technical program management working directly with software engineering teams experience- Experience managing programs across cross functional teams, building processes and coordinating release schedules ...

Sr. WW Specialist SA - GenAI , Q Business

Do you want to help define the future of Go to Market (GTM) at AWS using generative AI (GenAI)? AWS Specialist Solutions Architects (SSAs) are technologists with deep domain-specific expertise, able to address advanced concepts and feature designs. As part of the AWS sales organization, SSAs work with customers who have complex challenges that require expert-level knowledge to solve. SSAs craft scalable, flexible, and resilient technical architectures that address those challenges. This might involve guiding customers as they refactor an application or designing entirely new cloud-based systems. Do you enjoy solving novel and unique technical challenges for customers? Become an AWS GenAI Specialist SA!Within the GenAI/ML Specialist organization, this position is part of the Worldwide Specialist Team, where you will lead the global GTM plan for Amazon Q Business. You are a leader for specialists, architects, partners, and account teams around the world and set direction and standards for how we solve customer problems in your domain. You partner with technical and business teams across AWS and bring the voice of the customer into our product development roadmap. The WW team sees the big picture and sets the plan so the world’s most customer obsessed technical teams can make history.Key job responsibilities* Serve as a specialist advisor for Amazon Q Business, developing scalable best practices and educating the broader community* Assist customers in building production-ready solutions, including complex integrations with existing systems* Engage with customer executives to shape technology strategy and envision innovative solutions* Drive high-level discussions across organizations, represent the company at conferences, and communicate effectively to diverse audiences* Support new service launches, incubate new business, and influence product roadmap through close collaboration with internal teams and external customersAbout the teamWhy AWSAmazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Diverse ExperiencesAmazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.Work/Life BalanceWe value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.Inclusive Team CultureHere at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.Mentorship and Career GrowthWe’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.BASIC QUALIFICATIONS- BS/MS in Computer Science, Data Science, Engineering, or related field (or equivalent experience)- 7+ years of hands-on experience building and deploying cloud solutions- Experience developing enterprise search solutions integrating multiple datasources (e.g., Sharepoint, Confluence, Salesforce)- Hands-on experience with Large Language Models, RAG-based systems, and Vector databases- Excellent communication and presentation skills for collaborating with internal and external stakeholders ...

Systems Development Engineer, Amazon

Amazon.com’s Search org is looking for an engineer to join our Palo Alto team. Search Productions Operations is a follow-the-sun team distributed over three worldwide locations and is responsible for running one of the Internet's largest search infrastructures that powers Amazon’s retail websites.The team is responsible for operational support for search front-end services and mitigating high severity events. We actively lead efforts to improve the customer experience by maximizing availability, quality, and performance.We use an Operational Excellence (OE) program to continuously improve our processes. We partner with teams across Amazon Search to achieve highly-resilient systems, share knowledge, and automate away operational burden. We are strong advocates of a healthy work-life harmony, and continually focus on ensuring happiness within our team.Key job responsibilitiesOperational Excellence: We protect the Search customer experience and eliminate operational load. We mitigate, resolve high severity events and prevent their recurrence by owning the post-incident analysis process. We have a well established OE program to identify and drive resolution of cross-service and inter-service issues, review operational metrics, and investigate Service Level Objective (SLO) breaches.Systems Development: We develop and own innovative software solutions. We automate incident response workflows, assist engineers on call with root-causing of high severity events, and present mitigation options. We constantly automate processes through our operational excellence program, pager load budgeting system, and top root causes evaluation.On-Call Responsibility: The team operates a follow the sun on-call rotation with a frequency of one week on-call in every five weeks. The rotation is daytime only with handoffs between the Tokyo, Dublin, and Palo Alto teams. The on-call represents Search during large scale events in production, leads and co-ordinates calls to quickly mitigate customer impact.Career Growth: We care about your career aspirations. We want you to grow and progress in Amazon. We will facilitate your growth through an increase in scope of the projects you work on over time, and that can also include working on projects for partner teams to experience new, and interesting challenges.BASIC QUALIFICATIONS- Experience programming with at least one modern language such as Python, Ruby, Golang, Java, C++, C#, Rust- Experience with Linux/Unix- 2+ years of administrative experience in networking, storage systems, operating systems and hands-on systems engineering experience ...

We show restricted results, but there are more jobs available in our database, use Search to see them