AWS Bedrock is at the forefront of innovation, consistently delivering new product features that set AWS apart in the industry. As part of the AWS Bedrock Core System team, you'll play a crucial role in building and enhancing our core platform experience. Your focus will be on driving Model Evaluations, comprehensive application-level evaluations, Model Distillation, Fine-tuning of models, and Regression Testing.

In this role, you'll have the opportunity to define solutions to cutting-edge problems, design scalable systems, and implement them using state-of-the-art Large Language Models (LLMs) and frameworks. To enhance the rigor and objectivity of the model selection process, you'll automate the leveraging of human evaluation inputs and cutting-edge techniques like LLMaaJ (LLM-as-a-Judge).

We're looking for highly motivated individuals who thrive in an environment where problems are open-ended. You should enjoy engaging in passionate discussions with smart people and letting the best ideas rise to the top. You see your mistakes as learning opportunities and continually look for ways to improve yourself, your team, and your products.

You understand that not all solutions come easily, and you're not afraid of hard work to reach your goals. You thrive in ambiguity, build trust, move fast, and have a persistent desire to improve how things are done. If this sounds like you, we'd love to hear from you!

BASIC QUALIFICATIONS

- 1+ years of non-internship professional software development experience
- Experience programming with at least one software programming language

PREFERRED QUALIFICATIONS

- Bachelor's degree in computer science or equivalent

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $99,500/year in our lowest geographic market up to $200,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.