Software Dev Engineer, Amazon Publisher Monetization

Do you want to solve business challenges through innovative technology? Do you enjoy working on cutting-edge, scalable services technology in a team environment? Do you like working on industry-defining projects that move the needle?At Amazon Advertising, we hire the best minds in technology to innovate and build on behalf of our customers. The focus we have on our customers is why we are one of the world’s most beloved brands – customer obsession is part of our company DNA. Our Software Development Engineers (SDEs) use cutting-edge technology to solve complex problems and get to see the impact of their work first-hand. We are reinventing the way the world does advertising.The challenges SDEs solve for at Amazon are big and influence millions of customers, sellers, and products around the world. We are looking for individuals who are passionate about creating new products, features, and services from scratch while managing ambiguity and the pace of a company where development cycles are measured in weeks, not years. If this sounds interesting to you, apply and come chart your own path at Amazon.Key job responsibilitiesAs a software engineer on the Amazon Publisher Monetization team with Amazon Advertising, you will lead the design and delivery of software services and website stacks that entail engaging creatives, cross-screen placements, targeting, optimization, relevancy and advertiser experiences. You will be building brand new distributed software applications using cloud services and amazon proprietary technologies to deliver these unique customer and advertiser experiences. You will frequently interface with teams across Amazon; discovery, retail category, traffic generation, vendor management and analytics among many others. This is a great opportunity to learn many facets of advertising and retail, and understand how they come together, equipping you with the skills to grow your career. You will have the opportunity to experiment, innovate and deliver in a fast, agile and reliable manner with high quality and low technical debt. You should be passionate about building, improving and championing the product and a strong sense of ownership is a must.This is a chance to get in on the ground floor for what is becoming a huge area of growth for Amazon’s advertising business. Join the Advertising team today, make history, and transform our experiences.BASIC QUALIFICATIONS- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience programming with at least one software programming language ...

Full-Time CXO Site Lead, Customer Experience Operations

Who are we?Interested in joining our dedicated team at Amazon that makes the return of pickup and packages convenient for our customers at our Locker+ retail locations? Curious to be at the heart of where innovation meets customer obsession? Customer Experience Operations (CXO) is an exciting organization within Amazon specializing in delighting our customers with quality service in an ever-changing environment. Our goal is to go beyond assisting with customer orders. We strive to connect personally with our customers and uplift their lives – even if for just a few moments. We operate out of designated retail locations – where it’s convenient for our customers – helping facilitate the delivery and return of customer orders.As a CXO Site Lead, you will be the face of Amazon and contribute to the vibrant culture based on customer obsession, trust, respect, integrity, continuous learning, and fun. You possess strong attention to detail, the ability to quickly prioritize tasks, the willingness to learn new things, and a commitment to delighting our customers. You will assist with customer service operations and floor leader responsibilities.Key job responsibilitiesKey Responsibilities:• Interact with customers by effectively using customer engagement strategies and model desired behavior for the rest of the team.• Provide peer-to-peer feedback on processes and standards, serving as the escalation point to assist associate peers in solving customer issues, where appropriate• Contribute to continuous improvement of the customer experience and operations by participating in the development of best practices• Help identify and communicate barriers and trends that contribute to the customer and associate experience and support the manager in building a strong site culture.• Work with a manager to maintain the physical safety and quality standards of the site• Work in a fast changing and ambiguous environment• Perform additional duties, as assigned• Work flexible hours including nights, weekends, and holidays + Tuesday - Saturday 8:45am - 5:15pm• Lift up to 49 pounds, stand and walk during shifts lasting up to 12 hours, and frequently push, pull, squat, bend, and reach, as well as continuously climb and descend stairsBASIC QUALIFICATIONS- High school or equivalent diploma- Are 18 years of age or older- Experience in training others ...

Senior Equipment Engineer, Engineering and Launch

Amazon Logistics (AMZL) is changing the way we interact with customers around the globe every single day and solving some of the biggest logistical challenges facing not just Amazon, but the entire industry. In order to meet the needs of millions of customers worldwide in an environment where speed is of the essence, we are consistently looking for the next breakthrough or innovation which will disrupt the delivery business and enable a step change in the way millions of customers get their orders. If the notion of leading engineering projects amongst the world’s brightest talent to full potential excites you; if the idea of using ground-breaking technologies to develop last mile logistics systems in the multi-national juggernaut that is Amazon has your attention, then keep reading.Are you an innovative leader that wants to design the next generation of world-class equipment for delivery stations? Do you want a high level of ownership in solving complex problems? Does the challenge of designing systems that leverage ground breaking automated material handling equipment appeal to you? If so, we have the job for you! The WW Equipment Engineering Innovation team is searching for an innovative and solutions-oriented engineer to lead the initiative of developing and delivering current and next generation equipment for our world-class delivery stations. This is a unique opportunity at a critical juncture in Amazon’s growth to drive end to end equipment development, work with vendor across the world to increase vendor’s design and manufacturing capability and drive internal and external equipment quality control mechanisms. We are looking for a hands-on leader with experience in any of the following areas; Production Part Approval Process (PPAP), Manufacturing/Mechanical Plant Engineering, First Article Inspection (FAIR). In this role, you will collaborate with internal and external teams to design high-quality, cost-effective solutions for our last mile delivery systems. To be successful in this role you will need to be able to influence and work with senior leaders across multiple organizations and geographies. You will work with organizations such as Worldwide (WW) Engineering and Design, WW Tech SME, Last Mile Delivery and Tech as well as Operations to innovate at scale and drive the development roadmap. You will manage large, complex initiatives, and advocate on behalf of the customer to develop the next generation of AMZL delivery station. You will work with a team of highly skilled and highly engaged engineers in a fast-paced and often ambiguous environment. Our team works on the medium and long term, incremental and radical innovation of process infrastructure, equipment and standards for launch and legacy delivery stations. You will be challenged; you will learn; you will work on high impact, high visibility projects; you will grow.Key job responsibilities- Act as the WW technical expert for equipment development. This includes taking a leading role in equipment testing and validation. - Lead idea generation for innovative design/equipment solutions to existing operational problems.- Create documentation for equipment solutions, such as design definitions, quality specifications, assembly instructions and equipment design standards, etc.- Generate structured plan to turn innovative equipment design solutions from ideas to assessment, pilot and finally expansion- Own and deliver against plans, providing network reporting, financial approval and leadership approval for all stages of program progression- Act as technical expert in area of ownership, providing technical expertise to other Engineering teams, alongside providing technical challenge for suppliers and partners- Build large-scale business proposals based on innovation designs for WW Ops Engineering, often with ambiguity; collaborate with WHS, Planning, Launch, Procurement, Finance, HR, external partners and product teams to ensure project completion (on time and within budget)- Ensure customer satisfaction by following through with requests and ensuring needs are met as accurately and immediately as possible- Own internal process innovations across the Engineering Org, including owning road-mapping and planning for given area of responsibility and ensuring roadmap is delivered- Coordinate with Tech/Software teams, driving the operational execution of software enhancements as well as ensuring the software supports the physical design/process innovations- Up to 50% regional and WW travel depending on business needsBASIC QUALIFICATIONS- Bachelor’s degree in Science, Engineering, Technology and Mathematics (or equivalent related experience)- 5+ years of progressively responsible experience in the specialty- Experience in any of the following areas; Production Part Approval Process (PPAP), Manufacturing/Mechanical Plant Engineering, First Article Inspection (FAIR).- Experience with introducing new vendors and vendor technical quality management. - Experience with introducing new equipment from concept all the way through validation and execution?- Experience with automated material handling equipment, and systems inclusive of robotics and high-speed manufacturing- Experience with process design based on Lean Principles- Experience in Capital project management, must involve ownership/management of engineering design project- Experience using business/technical software like MS Excel, MS Project, and CAD software ...

Senior Enablement Lead , Global AdTech Org

Program enablement lead to drive growth of video advertising and deal-based buying on ADSP self-service by working with various cross-functional teams across the globe.Key job responsibilities* Inspecting and improving existing mechanisms to find efficiencies and drive adherence to process* Inventing new mechanisms to keep Product aware of customer needs and keep Services aware of product developments* Scaling the impact of successful mechanisms through global expansion and automation* Prioritising focus areas to ensure the orgs are focused on the most critical customer needs, balancing what is most urgent and what is most important* Evangelising Amazon mental models around two-way doors, high velocity decision making* Thoughtful escalations to leadership to unblock progress. Ability to influence without authority across levels.* Work cross-functionally with Product, Sales, and Marketing to optimize workflows and unblock channels of revenue on ADSP for budgets coming in the video and deals space* Develop and launch internal workflows to surface the right data/insights to the PSC team to drive high-value actions.A day in the lifeIn this role, you will be responsible for leading large-scale initiatives focused on influencing Product and Engineering teams on the automation of customer services on Amazon’s DSP, develop the services go-to-market strategy and serviceability readiness of new DSP features and functionality. You will partner with Amazon’s Programmatic Solutions Consultants globally to gather feedback, work with subject matter experts and influence how features are brought to Amazon’s largest & most strategic advertising customers. Focus areas will be driving growth for video advertising and deal-based buying on ADSP self-service, and growing account spend for new product features in the video and deals space. As a Senior AdTech Services and Solutions Excellence Lead (Sr. ASSET Lead), you will work with a cross-functional team that specializes in creating the smoothest experience for our internal stakeholders and advertisers to scale key Amazon DSP services. You will be responsible for assessing business challenges by gathering and synthesizing relevant data. You will build shared strategy and execution plans with in-market business leaders, product and automation leads, and scaled cross-functional services teams to improve the customer experience in campaign management and optimizations effectively. You will create and track project plans to ensure accountability, establishment of clear KPIs to measure program success, drafting executive level & team presentations, data analysis, process design, recognizing and advocating for removal of systemic blockers to change, documentation of best practices and learnings for future initiatives. You will also help influence and train team members and cross-functional teams on new processes and tools as they are developed.About the teamAmazon Advertising is dedicated to driving measurable outcomes for brand advertisers, agencies, authors, and entrepreneurs. Our ad solutions - including sponsored, display, video, and custom ads - leverage Amazon’s innovations and insights to find, attract, and engage intended audiences throughout their daily journeys. With a range of flexible pricing and buying models, including self-service, managed service, and programmatic ad buying, these solutions help businesses build brand awareness, increase product sales, and more. Within Amazon Advertising, the Global AdTech Org is focused on developing strategic partnerships across advertising agencies and direct clients. At the center of our partnerships with customers are meaningful and scalable technology partnerships, of which services are a core constituent.BASIC QUALIFICATIONS- BA/BS degree required; Masters/MBA preferred- Have 8+ years of customer service & support and/or technical experience in the programmatic advertising space- Knowledge of DSP within Ad Platform architecture (bidding engines, second-price vs first-price auctions, pixeling and tag managers, viewability, etc)- Experience building and delivering large-scale strategic initiatives and tools for customer-facing teams and direct customers through systems-thinking and workflow improvements- Experience with influencing internal and external stakeholders and communicating goals and strategies across multiple leadership levels of an organization- Quantitative analytical abilities, experience with “big data” and ability to handle changing priorities and use good judgment when working in stressful situations ...

Principal Solutions Architect, FSI, WW FSI GTM Solutions Architecture Team

Amazon Web Services (AWS) is looking for an experienced and motivated technologist who possess a unique balance of financial services industry knowledge, technical depth and strong interpersonal skills. As an industry specialist, AWS Principal Solutions Architect, you will work with some of the world’s largest financial services companies, AWS Sales and several other AWS teams to craft highly scalable, flexible and resilient cloud architectures that address industry business problems and accelerate the adoption of AWS services.AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector.Financial Services Solutions Architects are viewed as experts in their domain, and support customer engagements when those engagements require deep and authoritative industry expertise, and a keen understanding of architectural and technical requirements. The Solutions Architects will influence the definition of the technical strategy for their industries by:• Identifying patterns• Defining technical trends that can affect the industry • Publishing reference architectures• Building industry quickstarts and other development kits• Collecting technical best practices in the industry• Establish credibility in sales cycles for AWS services by collaborating with field sales teams and customers to help design and build solutions that help solve customers’ business problemsThe ideal candidate will have worked as a solutions architect within a Financial Services company or an industry solution vendors or system integrators. They will have demonstrated industry solutions expertise. They also will have an understanding of various software development methodologies, including cloud DevOps.Key job responsibilities • With the broader Financial Services team, develop technical elements of the strategic plan for accelerating adoption of AWS across the industry• You will be responsible for establishing technical credibility in the sales cycle (personally or with the broader technical team) by supporting discussions across our Financial Services customers and partners • Educate customers of all sizes on the value proposition of AWS within Financial Services, and participate in deep architectural discussions to ensure solutions are designed for successful deployment in the cloud • Capture and share best-practice knowledge amongst the AWS solutions architect community • Author or otherwise contribute to AWS customer-facing publications such as whitepapers • Build deep relationships with senior technical individuals within customers to enable them to be cloud advocates• Act as a technical liaison between customers, service engineering teams and support• Serve as a technical domain expert on deploying Financial Services industry workloads and applications on AWS• Architect solutions leveraging AWS technology, including solution development and potentially demonstrate technical feasibility through mechanisms including proof-of-concepts and/or prototypes• Travel may be required for this role, up to 25%About the teamDiverse ExperiencesAWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS?Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Inclusive Team CultureHere at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.Mentorship & Career GrowthWe’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life BalanceWe value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. BASIC QUALIFICATIONS- Bachelor's degree in computer science, engineering, mathematics or equivalent- Experience communicating across technical and non-technical audiences and at C-level, including training, workshops, publications- Experience working in Financial Services organizations and implementing solutions in a regulated environment; driving technical and/or organizational change of significant complexity.- Experience working as an architect, designing and implementing large-scale solutions in the Financial Services industry.- Solid understanding of virtualization and/or cloud computing technologies. ...

Business Intelligence Engineer II, Chronicle

The Chronicle team is seeking an experienced Business Intelligence Engineer who can creatively solve complex data and metrics problems. We build global data products that proactively surface insights to help plan, grow, and optimize Amazon’s business.In this role you will be responsible for solving complex and ambiguous data and metric problems. You will influence business-critical questions across multiple organizations and geographies. You should have a track record of end-to-end ownership and successfully delivering results in a fast-paced and dynamic business environment. You should be able to work on complex initiatives, deal with ambiguity and advocate on behalf of the customers.Key job responsibilitiesA successful candidate: * Be highly data driven, resourceful, customer-obsessed and team oriented * Be able to manage multiple projects - including planning, prioritization, and task delegation * Design, develop, and implement scalable, automated processes for data extraction, processing, and evaluation * Define data driven approaches and metrics strategy to uncover new insights * Have a passion for sourcing, manipulating, and visualizing data to tell business stories * Be able to clearly communicate strategic findings and recommendations * Translate complex, technical concepts into business terms and vice versa * Work with technology and data teams to support the development of tools and dashboardsAbout the teamWe build data products that help Amazon improve the speed and accuracy of business management. Our team is split between New York and Seattle. Our team culture is based on inclusion, innovation, and respect.BASIC QUALIFICATIONS- Bachelor's degree in BI, finance, engineering, statistics, computer science, mathematics, finance or equivalent quantitative field- Experience with data visualization using Tableau, Quicksight, or similar tools- Experience with data modeling, warehousing and building ETL pipelines- Experience using SQL to pull data from a database or data warehouse and scripting experience (Python) to process data for modeling- 3+ years of professional experience in a business analyst/data analyst/statistical analyst role- 2+ years experience with SQL, ETL, Data Warehouse solutions and databases- Experience with statistical analytics and programming languages such as Python- Advanced skills in data visualization tools like Tableau or similar BI tools- Ability to effectively communicate with both business and technical teams ...

Principal Product Manager Technical, Physical Stores Advertising

Locations available are New York City and Seattle. Physical Stores Ads is a rapidly growing team within Amazon Advertising whose mission is to drive outsized advertising with Amazon’s physical stores and have our advertiser customers prefer our offerings when it comes to reaching and engaging in-store shoppers, measuring impact, and achieving their advertising goals. Our primary customers are advertisers who sell products within our stores. Advertisers not endemic to the stores are also our customers, and we can offer unique ways to reach customers out-of-home and in the context of their shopping activities.In this role, you will develop greenfield advertising solutions that help advertisers reach customers in the physical world, including Amazon's owned and operated physical stores and 3P out-of-home placements. This is a true "day one" opportunity to surprise and delight advertisers and advance the advertising industry forward.The Principal PMT will guide our technical development teams and be the all up accountable individual to make their product line a success. This role will encompass aspects of strategy, technical product development, detailed analysis and commercialization. You will build long term plans and drive execution against those plans. You will be responsible for building many of our capabilities from the ground up, navigating green field opportunities, delighting our customers, and building long lasting and growing ads business. This is a truly unique opportunity to be on one an exciting, cutting edge, and distinctive initiative with high visibility from senior leadership.The right candidate will possess strong problem-solving skills and the ability to identify and test business opportunities across a new domain. You must be able to thrive and succeed in an entrepreneurial environment, and not be hindered by ambiguity or competing priorities. This means you are not only able to develop and drive high-level strategic initiatives, but can also roll up your sleeves, dig in and get the job done.You must be able to communicate up, down, and out, to both technical and business leaders. Strong preference for domain expertise in out-of-home advertising. You must be able to successfully drive and build ad products and balance the business needs against technical constraints. You must be able to take large, complex problems and break them down into manageable components, then deliver them in a successful and timely manner. Being a self-starter, showing maturity, high judgment, negotiation skills, ability to influence, ability to partner effectively with 3P tech partners, analytical talent and leadership are essential to success in this role. This is a unique and rare opportunity to get in on the ground floor and help shape our Advertising and Physical Stores technologies, products and business.BASIC QUALIFICATIONS- Bachelor's degree- Experience owning/driving roadmap strategy and definition- Experience with feature delivery and tradeoffs of a product- Experience technical product management ...

Applied Scientist II, Personalization

Are you interested in big data, machine learning, LLM, and product recommendations? If so, Amazon's Personalization team might be the right place for you. About our organization:We are part of Amazon’s Personalization organization, a high-performing group with a huge impact on hundreds of millions of customers, innovating at the intersection of customer experience, machine learning, and large-scale distributed systems. We run global experiments and our work has revolutionized e-commerce with features such as "Compare with similar items", "Keep shopping for ...", “Customers who bought this item also bought”, and, “Frequently bought together” among others.Amazon’s internal surveys regularly recognize us as one of the best organizations to work for in the company, with visible high-impact work, low operational load, respectful work-life balance, and continuous opportunity to learn and grow.About you:You are an Applied Scientist who loves big data and passionate about improving customer shopping experience by inventing and applying state-of-art technologies (e.g., LLM, Machine Learning, NLP, and Computer Vision) to build the next-generation product recommendation engine for Amazon. You have an entrepreneurial spirit, know how to deliver, are deeply technical and highly innovative. You work closely with software engineers to put algorithms into production. You also work in partnership with teams across Amazon to create enormous benefits for our customers. You will have an opportunity to make an enormous impact on the design, architecture, and implementation of cutting edge products used every day by people you know. Key job responsibilities- Use machine learning and analytical techniques to create scalable solutions for business problems- Analyze and extract relevant information from large amounts of Amazon's historical business data to help automate and optimize key processes- Design, development and evaluation of highly innovative models for predictive learning- Work closely with software engineering teams to drive model implementations and new feature creations- Establish scalable, efficient, automated processes for large scale data analyses, model development, model validation and model implementation- Research and implement novel machine learning and statistical approaches- Mentor junior scientists; review their work and provide feedbackAbout the teamOur mission is to delight every Amazon customer with a personalized shopping experience. We achieve our mission through investments in large-scale machine learning and distributed system solutions with the purpose of delivering the future of shopping on Amazon. Our solutions help customers explore product categories, discover high quality products that meet their needs, and provide most relevant information to help customers make confident shopping decisions. We are seeking an Applied Scientist to make step function improvements in creating a delightful shopping experience.BASIC QUALIFICATIONS- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience- 3+ years of building models for business application experience- Experience programming in Java, C++, Python or related language ...

Data Engineer, Content Analysis & Strategy (CAST)

Amazon Music is an immersive audio entertainment service that deepens connections between fans, artists, and creators. From personalized music playlists to exclusive podcasts, concert livestreams to artist merch, Amazon Music is innovating at some of the most exciting intersections of music and culture. We offer experiences that serve all listeners with our different tiers of service: Prime members get access to all the music in shuffle mode, and top ad-free podcasts, included with their membership; customers can upgrade to Amazon Music Unlimited for unlimited, on-demand access to 100 million songs, including millions in HD, Ultra HD, and spatial audio; and anyone can listen for free by downloading the Amazon Music app or via Alexa-enabled devices. Join us for the opportunity to influence how Amazon Music engages fans, artists, and creators on a global scale. Learn more at https://www.amazon.com/music.Amazon Music is awash in data! To help make sense of it all, the CAST team within DISCO (Data, Insights, Science & Optimization) team accelerates and facilitates content analytics and provides independence to generate valuable insights in a fast, agile, and accurate way. This domain provides analytical support for the below topics within Amazon Music: Programming / Label Relations / PR / Stations / Livesports / Originals / Case & CAM. The CAST team enables repeatable, easy, in depth analysis of music customer behaviors. Our goal is to empower all teams at Amazon Music to make data driven decisions and effectively measure their results by providing high quality, high availability data, and democratized data access through self-service tools.If you love the challenges that come with big data and devops, then this role is for you. We collect billions of events a day, manage petabyte scale data on Redshift and S3, and develop data pipelines using Spark/Scala EMR, SQL based ETL, Airflow and Java services.We are looking for a talented, curious, enthusiastic, and detail-oriented Data Engineer, who knows how to take on big data challenges in an agile way. Duties include big data design and analysis, data modeling, and development, deployment, and operations of big data pipelines. The CAST team develops data specifically for a set of key business domains like personalization, playlist programming, merch, artists, and provides and protects a robust self-service core data experience for all internal customers. We deal in AWS technologies like Redshift, S3, EMR, EC2, DynamoDB, and Lambda. Key job responsibilities* Writing scripts, building microservices in AWS to increase team efficiency* Building and managing ETL pipelines in AWS to ingest data from external vendors* Assist the BIs on the team in managing our existing environment that consists of Redshift and SQL based pipelines. The activities around these systems will largely be well-defined via standard operation procedures (SOP) and typically involve approving data access requests, subscribing or adding new data to the environment, but there will be cases where creative problem-solving is required* SQL data pipeline management (creating or updating existing pipelines) and maintenance tasks on the Redshift cluster* Assist the team with the management of our next-generation AWS infrastructure. Tasks includes infrastructure monitoring via CloudWatch alarms, infrastructure maintenance through code changes or enhancements, and troubleshooting/root cause analysis infrastructure issues that arise, and in some cases this resource may also be asked to submit code changes based on infrastructure issues that arise.BASIC QUALIFICATIONS- 1+ years of data engineering experience- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets- Experience writing and optimizing SQL queries with large-scale, complex datasets- Experience with one or more scripting language (e.g., Python, KornShell, Scala) ...

Finance Manager, Stores Ads Monetization

Amazon seeks a world class Finance Manager to provide end-to-end financial support to our fastest growing Advertising business. The successful candidate will help drive the growth of the organization by providing financial stewardship and analytical insights into key financial and operational performance metrics. They will be a strategic partner to the business and assist in evaluating operational processes, business opportunities, and support planning / forecasting. They will have the opportunity to influence the long-term evolution of our products. This person must have a passion for detail and the ability to dive deep into the foundational building blocks of the Advertising Business.The successful candidate will have shown experiences in past roles influencing business owners and supporting decision-making in rapidly evolving environments. This role has regular interaction with executives and various business units across Amazon and therefore requires strong interpersonal and communication skills.Key job responsibilities· Partner with business leaders to drive new initiatives, products, and solutions aimed at improving ad monetization. Collaborate with teams to evaluate customer needs, develop KPIs to measure business performance, and provide actionable analytical insights.· Build cross-functional partnership with teams such as demand, auctions, publisher, and products.· Develop and automate scalable financial and business intelligence (BI) mechanisms, including weekly, monthly, and quarterly business reviews, as well as operating plans.· Maintain and enforce a strong financial controllership environment.· Author research papers to shape and influence supply strategy.BASIC QUALIFICATIONS- Bachelor's degree in finance, accounting, business, economics, or a related analytical field (e.g., engineering, math, computer science)- 5+ years of tax, finance or a related analytical field experience- 4+ years of applying key financial performance indicators (KPIs) to analyses experience- 4+ years of creating process improvements with automation and analysis experience- 4+ years of participating in continuous improvement projects in your team to scale and improve controllership with measurable results experience ...

Instock Manager II, Amazon Fresh - Grocery

The Amazon Fresh Grocery team is excited to welcome an Instock Manager to our dynamic team, based in Seattle WA, New York, Arlington VA, Nashville TN, or Chicago IL.Join us at Amazon Fresh Grocery in reshaping the future of customer experiences and supply chain excellence. Your expertise will drive innovation, efficiency, and lasting impact.As an Instock Manager (ISM) within the Amazon Fresh Grocery Category Instock team, you'll take on a critical role at the forefront of developing business plans and overseeing supply chain and inventory management initiatives. More specifically, this role focuses at the top of our supply chain funnel through optimizing the inbound performance from vendors into our network (fill rate, on-time, cost to serve). Leading cross-functional initiatives will be second nature as you drive improvements to enhance customer experience and overall cost structures. Your leadership will extend across both Online and In-Store channels. To be successful in this role, you should feel comfortable using data to influence others and building scalable systems and processes to allow us our business to grow. In joining this team, you will have the opportunity to both build and operate in an ambiguous fast-paced environment and will drive initiatives that improve sales, customer experience, and process improvement within retail and operations.Success starts by being a self-starter, highly organized, and possessing strong data extraction and analytical capabilities. In this role, we look for you to be thoughtful in the your pursuit of results and thrive in a high energy environment where tactical and strategic activities are expected to be driven in parallel.Strong candidates will have knowledge in fundamental business principles and previous retail or supply chain experience. The ideal candidate is able to lead and influence both internal and external teams in an ambiguous environment while maintaining a customer-centric philosophy.Key job responsibilitiesA successful Instock Manager will:- Manage inventory availability and inventory health including: improved instock, inventory planning, vendor operational improvement (efficiency, fill rates, lead time), forecasting, and waste reduction- Drive cross-functional strategic initiatives to improve customer experience and overall cost structure of the business- Perform complex business analysis to identify business opportunities to improve revenue and profitability- Partner with internal teams to develop tools, automation, and process improvements that affect purchasing and vendor management workflowsA day in the lifeAs an Instock Manager, you'll collaborate closely with top suppliers, internal vendors and other internal strategic partners, to enhance supply chains and under-the-roof operational excellence. Together you will be part of a professional environment that fosters growth, values insights, and empowers you to propel the future of e-commerce.About the teamOur mission is to perfect the art of grocery experience, from buying to vendor performance, optimizing DC operations, and nurturing vital relationships with key distributor partners. At the Grocery Category Instock team, we are the driving force behind Amazon Fresh Grocery's unparalleled supply chain success. Being on our team means being part of a team that orchestrates the seamless flow of goods, ensuring that our customers can find what they need when they need it.We're not just focused on perfect execution; we're involved in the long-term planning of our DC topology, sourcing strategy, and vendor partnerships. Join us, and you'll have the opportunity to influence the planning of our network, collaborate with tech to build innovative supply chain solutions, and work with top manufacturers to optimize our supply chain. If you're ready to be part of a team that defines the future of grocery supply chain, then Amazon Fresh Grocery Category Instock is the place for you. Join us, and let's build something extraordinary together.BASIC QUALIFICATIONS- Bachelor's degree- 3+ years of supply chain, inventory management or project management experience- 3+ years of with Excel experience- Experience in Retail or wholesale business- Experience with process improvement techniques such as Kaizen, Lean Manufacturing or Six Sigma ...

Front End Engineer II, Creators

The Creators organization is hiring a Front End Engineer II. In this role, you will build mobile-first websites and applications for Creator Marketing's newest, and most innovative products. Our organization owns the Amazon Associates and Influencer programs. Our mission is to become the Earth’s most desired destination for commerce creators across the world. We enable hundreds of thousands of creators to be successful at Amazon by surfacing personalized insights, recommendations and high quality educational content regardless of whether they are large publishers, individuals, new to our program or highly sophisticated affiliate marketers.You and your team will be responsible for interfaces and services that can be deployed globally, delivering an exceptional customer experience.As a front end engineer in our team you will have flexibility to drive changes to our front-end architecture, framework and work closely with product managers and UX designers.Successful candidates need to be creative, innovative, flexible, self-directed, able to design and write reliable, maintainable and high-performance code. You must be able to deal with ambiguity, make data-driven decisions, multi-task and deal with complexity. If you enjoy dealing with high ambiguity, complexity and broad scope that will be at the epicenter of Amazon's social shopping efforts, come join us!BASIC QUALIFICATIONS- 2+ years of non-internship professional front end, web or mobile software development using JavaScript, HTML and CSS experience- 1+ years of computer science fundamentals (object-oriented design, data structures, algorithm design, problem solving and complexity analysis) experience- Experience using JavaScript frameworks such as angular and react ...

Applied Scientist, Device Ad Products & Personalization

We are seeking an Applied Scientist for our Device Ad Products science team. This team addresses challenging optimization problems related to how advertisements are priced, selected, allocated and shown to customers on Amazon devices including Fire TV, Alexa and Fire Tablet. As Applied Scientist, you will be responsible for improving advertising performance and delivering innovative advertising experiences for display and video ads on Amazon Devices. This team leads initiatives to improve advertising fundamentals such as relevance, coverage, CTR, and CPSU (cost per sign up for streaming services) which in turn increase advertising revenue across Amazon's devices worldwide. You will own the scoping, implementation, and launch of science based ad solutions and experiences specifically for these entertainment focused environments. Key job responsibilities- Gain a comprehensive understanding of the customer lifecycle journey with Amazon Ads, and develop sophisticated models to optimize various conversion KPIs for enhanced marketing effectiveness.- Develop scalable data processing pipelines and architectures to ingest, transform, and enrich Customer data from various sources (Retail, Prime Video, FireTV and AppStore).- Build machine learning models, perform proof-of-concept, experiment, optimize, and deploy your models into production; work closely with product managers and engineers to launch your models to customers.- Drive innovation within your team and partner closely with other scientists, engineers and Product Managers to build science roadmaps- Establish scalable, efficient, automated processes for large-scale data analysis, machine-learning model development, model validation and serving.- Stay up-to-date with the latest advancements in machine learning, natural language processing, knowledge representation, and related fields, and identify opportunities to apply them to Advertising Use Cases.- Effectively communicate complex science problems and solutions to both technical and non-technical audiences.A day in the lifeIn this role, you will regularly work with scientists and technical leaders across the advertising organization, including other science teams, product management, and senior leadership. You will also collaborate with science leaders across Amazon Devices and Prime Video organizations to build company-wide alignment. You will manage and work closely alongside your team of applied and data scientists to guide them through high-ambiguity problems and deliver robust, scalable solutions. About the teamThis role is on Device Ads and Personalization (DAPP) team, which is under Amazon Publisher Monetization (APM). This team has a vision to create innovative Ad experiences on Amazon Devices, providing customers better convenience and more selection.BASIC QUALIFICATIONS- 3+ years of building models for business application experience- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience- Experience programming in Java, C++, Python or related language- Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing ...

Loss Prevention Specialist

The Loss Prevention Specialist (LPS) is a key hourly associate position within Amazon Operations. To keep our 24/7 operations network secure and assure operational continuity, we are looking for hands-on and detail-oriented professionals who want to join our team. The LPS leads the effort to efficiently and effectively protect people, product and data (lives, physical property, equipment, inventory, data, & intellectual property) in a designated building. The LPS reports to the Security and Loss Prevention Cluster Manager responsible for their geographical area, and aids them in supporting the Operational team, and cross functional teams throughout the organization. This position is site based however may need to support multiple business units with local travel up to 25%.Key job responsibilities* Conduct confidential investigations and prepare prompt written reports of theft, fraud, and workplace violence/critical incidents* Contribute to the identification of vulnerabilities (e.g., loss, associate experience, process improvement, data protection, physical security infrastructure) and define appropriate mitigating actions while ensuring compliance with legal and ethical standards* Serve as department liaison and security/crisis management subject matter expert for site leadership keeping them informed on key issues, strategies, and the department’s performance* Develop strategies for alarm reduction and conduct system diagnostic for problematic devices by engaging and resolving issues with internal and external partners* Work in an industrial environment that requires walking up to 5 miles a day and ability to lift up to 20 lbs, with or without reasonable accommodation. Includes flexibility in working weekends and/or overnight shifts as necessary to needs of the business* Travel up to 25% including one week in Phoenix, AZ for Global Security Operations OnboardingA day in the lifeAs a Loss Prevention Specialist, you will join a team of Security and Loss Prevention professionals providing security as a service to business customers across multiple business units within a dedicated geographical area. You perform regular physical security audits and investigate policy violations, security-related incidents, and loss events. During your investigations, you collect information by monitoring systems and tools, analyzing data reports, and conducting interviews. Your findings help to identify vulnerabilities in our processes, for which you contribute to the development of mitigating measures. You play a key role in maintaining the physical integrity of our sites by auditing and monitoring the health status of our systems with subject matter experts and external suppliers to maintain their functionality. You interact on a daily basis with our external security service providers to ensure delivery of high-quality security services and a smooth customer experience. You also act as point of contact for multiple internal and external departments (e.g., legal, HR, security service providers, local law enforcement) and subject matter expert in Security and Loss Prevention-related matters. Finally, you deliver loss prevention-related education and awareness programs to other teams and liaise with various stakeholders on policy and procedure across all management levels.About the teamWorldwide Operations Security (WWOS) is the global organization that supports field Security and Loss Prevention and is designed to support Amazon’s Worldwide Operations, as well as affiliate and retail businesses. WWOS creates and maintains a work environment that is prepared and secure through global security centers of excellence staffed by subject matter experts in people and asset protection. We accomplish this by creating policy and implementing guidelines; training leadership and staff; using technology to eliminate subjectivity, complexity, and variation; identifying, preparing for, and mitigating risk; and auditing our practices to ensure compliance.BASIC QUALIFICATIONS* High school or equivalent diploma * 1+ years of experience in the following: security service, asset protection, audit, investigations, law enforcement, military, risk management, data analytics, inventory control, quality assurance or bachelor’s degree in a related field or 2+ years Amazon Experience and/or LPQ Career Choice Graduate* 1+ years of application experience with MS Office Professional Suite, including Excel to manipulate and analyze data* Workplace incident mitigation or de-escalation and Business Continuity planning experience ...

Senior Design Technologist, Visual Innovation Team

Want to build at the cutting edge of immersive shopping experiences? The Visual Innovation Team (VIT) is at the center of all advanced visual and immersive content at Amazon. We're pioneering VR and AR shopping, CGI and GenAI. We are looking for a Design Tecnologist who will help drive innovation in this space who understands technical problems the team may face from an artistic perspective and provide creative technical solutions. This role is for if you want to be a part of:- Partnering with world-class creatives and scientists to drive innovation in content creation- Developing and expanding Amazon’s VIT Virtual Production workflow. - Building one of the largest content libraries on the planet- Driving the success and adoption of emerging experiences across AmazonKey job responsibilitiesWe are looking for a Design Technologist with a specialty in workflow automation using novel technologies like Gen-AI. You will prototype and deliver creative solutions to the technical problems related to Amazon visuals. The right person will bring an implicit understanding of the balance needed between design, technology and creative professionals — helping scale video content creation within Amazon by enabling our teams -- to work smarter, not harder.Design Technologists in this role will:- Act as a bridge between creative and engineering disciplines to solve multi-disciplinary problems- Work directly with videographers and studio production to develop semi-automated production workflows- Collaborate with other tech artists and engineers to build and maintain a centralized suite of creative workflows and tooling - Work with creative leadership to research, prototype and implement the latest industry trends that expand our production capabilities and improve efficiency A day in the lifeAs a Design Technologist a typical day will include but is not limited to coding and development of tools, workflows, and automation to improve the creative crew's experience and increase productivity. This position will be focused on in house video creation, with virtual production and Gen-Ai workflows. You'll collaborate with production teams, observing, empathizing, and prototyping novel solutions. The ideal candidate is observant, creative, curious, and empathetic, understanding that problems often have multiple approaches.BASIC QUALIFICATIONS- 6+ years of front-end technologist, engineer, or UX prototyper experience- Have coding samples in front end programming languages- Have an available online portfolio- Experience developing visually polished, engaging, and highly fluid UX prototypes- Experience collaborating with UX, Product, and technical partners ...

Associate Principal, Analytics Advisory, Analytics & Insights

Amazon Advertising exists at the intersection of marketing and ecommerce and offers advertisers a rich array of innovative advertising solutions across Amazon owned properties, as well as third party properties Amazon operates. We believe that advertising, when done well, can greatly enhance the value of the customer experience and generate a positive return on investment for our advertising partners.The Analytics & Insights (A&I) organization develops actionable insights using Amazon’s unique data to influence how advertisers promote their businesses. Our insights enhance their marketing decision-making, leading to them to be measurably more successful with Amazon. The A&I organization consists of a variety of different Practices, which are groups that focus on different approaches to create these insights. We are currently looking for an Associate Principal, Analytics Advisory to join our Advisory Practice. Members of the Advisory Practice develop brand-specific actionable insights for high investment advertisers. Our analyses measure the performance of advertising campaigns and sales performance of products. We provide recommended actions to improve future advertising campaigns and marketing decision-making. We take a consultative approach, building deep relationships with our clients marketing teams. Our account management and sales partners within Amazon help us manage relationships with these clients, allowing us to focus on analysis and delivery. Examples of commonly developed advertising insights include seasonality of search trends, multi-touch attribution, and trade up/cannibalization. Common marketing insights include brand switching, customer journey, and customer penetration.Key job responsibilitiesAn Associate Principal in the Advisory Practice will be expected to- Independently develop advanced brand-specific analyses and create templates of them for colleagues to leverage for other brands.- Conduct analyses which leverage previously untapped datasets.- Expand the breadth of marketing science topics that the Advisory Practice provides insights on.- Represent Amazon Advertising in meetings with advertisers and guide their leaders on their advertising and marketing strategies.- Develop relationships with senior marketing decision makers (e.g. senior director, c-level) and establish oneself as go-to expert in at least one advanced analytical area of advertising.- Proactively address advertisers' needs by identifying issues and opportunities before the advertiser identifies them.- Own an internal program that enhances their Practice's capabilities or A&I's capabilities.- Write documents with recommendations that influence how partners teams with Amazon Advertising operate, such as Account Management, Sales, or Product.- Master Amazon proprietary tools and metrics, which will help you solve the advertisers' business questionsBASIC QUALIFICATIONS- Bachelor's degree plus 10+ years’ experience in client-facing data analysis roles.- 5+ years of consulting experience with a major consulting firm or 5+ years of advertising experience with a top advertiser (agency or client side).- Ability to translate technical aspects of analysis and metrics into actionable insights for the advertiser and both technical and non-technical stakeholders.- Excellent data driven storytelling skills – you create and deliver compelling presentations with outstanding visuals to high level stakeholders.- Advanced in SQL - ability to write complex queries from scratch from multiple tables, creating the appropriate joins, extracting and manipulating data, formatting fields, creating new measures and metrics, etc.- Fluency with an advanced analytical tool (Python or R) – ability to run advanced statistical modelling and analysis with either Python or R. If current skill is with R, then have the ability and aptitude to attain fluency in Python for analysis and statistical modeling.- Excellent organizational, interpersonal, and communication skills (both written and verbal). ...

Principal PMT - Vendor Advertising, Amazon Stores Ads Monetization

Do you ever struggle to explain your work? How's this: "Do you shop at Amazon?” Every day, tens of millions of customers visit Amazon to discover, research, and buy products. Millions of interactions are processed each hour, as customers navigate and explore our vast selection of products, features, and services around the world. The Amazon Stores Advertising Team’s vision is to enable customers to discover products they love from brand owners around the world. Amazon Stores are the product showroom for the “everything store”, our reach and impact uniquely positions us to innovate on behalf of our customers. The Stores Advertising Team partners with organizations across Amazon to drive high-quality advertising experiences across geographies, intents, missions, products and businesses; while ensuring a cohesive, lovable shopping experience.We are looking for a motivated, entrepreneurial, high-judgement and customer obsessed Principal Technical Product Manager to evolve the shopping experience on Amazon. In this role you will lead initiatives to create delightful experiences for customers to discover advertised products from vendors in our store and to redefine the advertiser product experience and business strategy so that the best brands in the world build brand and product awareness and equity in our stores, globally. This role will innovate on current and next-generation advertisements that are dynamically tailored and integrated with multiple other Amazon systems.Key job responsibilitiesAs a Principal Technical Product Manager, you will: • Propose and implement new projects or recommend system improvements—often driving resolution to hotly debated topics—either through smart tradeoffs or inventing around constraints• Manage the P&L around the advertising experience across all Amazon Stores pages for vendors on Amazon.• Create, prioritize, communicate, manage, and execute roadmaps, project plans, and commitments• Bring innovative ideas to the table, in order to find better ways of accomplishing our customer objectives• Report progress and influence decisions with executive leadership• Work closely with designers, economists, Sr. engineers and Team Leaders to invent new experiences that customers and advertisers love. • Interface with a diverse customer base to understand requirements, priorities, and processes•Set clear, measurable quality goals for in a data-driven wayKey job responsibilitiesAs a Principal Technical Product Manager, you will: • Propose and implement new projects or recommend system improvements—often driving resolution to hotly debated topics—either through smart tradeoffs or inventing around constraints• Manage the P&L around the vendor advertising experience across all Amazon Stores.• Create, prioritize, communicate, manage, and execute roadmaps, project plans, and commitments• Bring innovative ideas to the table, in order to find better ways of accomplishing our customer objectives• Report progress and influence decisions with executive leadership• Work closely with designers, economists, Sr. engineers and Team Leaders to invent new experiences that customers and advertisers love. • Interface with a diverse customer base to understand requirements, priorities, and processes•Set clear, measurable quality goals for in a data-driven wayAbout the teamThis role is within a brand-new organization focused on delighting customers while driving long-term growth and revenue. Prospective candidates should have the desire and capability to drive results from the ’ground floor’ of an impactful and important charter. BASIC QUALIFICATIONS- 7+ years of technical product or program management experience- 7+ years of end to end product delivery experience- Bachelor's degree- Experience owning/driving roadmap strategy and definition- Experience with feature delivery and tradeoffs of a product- Experience leading engineering discussions around technology decisions and strategy related to a product ...

Associate Corporate Counsel, Worldwide Operations Legal

Amazon's Legal Department is looking for a talented attorney to support our customer-facing Worldwide Operations (WW Ops) products and programs. You will join a stellar team of lawyers supporting our rapidly growing and evolving WW Ops businesses. You will be an integral part of the business teams you support, providing counsel on new products and services, regulatory compliance matters, commercial relationships, and pre-litigation disputes and inquiries. You will help business teams develop programs and tools to continually improve customer experience, while helping clients anticipate and address legal risk. You will develop strategies for handling legal issues in creative, business-centric ways and you will build processes that provide your clients with the flexibility and freedom to innovate and scale quickly. The successful candidate will be inquisitive, enthusiastic about technology, enjoy working hard and being continually challenged, and demonstrate sound judgment even in ambiguous situations. This position may be based in New York, NY, Seattle, WA or Washington, DC. As you will be working with teams who are developing products and technology that will be leveraged globally, some travel may be required.BASIC QUALIFICATIONS- Juris Doctor and membership in one state bar or equivalent- 2+ years of legal experience- Experience in private practice or in house experience at a technology company or equivalent ...

Senior Applied Scientist, Amazon Advertising - Sponsored Products & Brands

Amazon is investing heavily in building a world class advertising business and we are responsible for defining and delivering a collection of self-service performance advertising products that drive discovery and sales. Our products are strategically important to our Retail and Marketplace businesses driving long term growth. We deliver billions of ad impressions and millions of clicks daily and are breaking fresh ground to create world-class products. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities.This position will be part of the Conversational Ad Experiences team within the Amazon Advertising organization. Our cross-functional team focuses on designing, developing and launching innovative ad experiences delivered to shoppers in conversational contexts. We utilize leading-edge engineering and science technologies in generative AI to help shoppers discover new products and brands through intuitive, conversational, multi-turn interfaces. We also empower advertisers to reach shoppers, using their own voice to explain and demonstrate how their products meet shoppers' needs. We collaborate with various teams across multiple Amazon organizations to push the boundary of what's possible in these fields.We are seeking a science leader for our team within the Sponsored Products & Brands organization. You'll be working with talented scientists, engineers, and product managers to innovate on behalf of our customers. An ideal candidate is able to navigate through ambiguous requirements, working with various partner teams, and has experience in generative AI, large language models (LLMs), information retrieval, and ads recommendation systems. Using a combination of generative AI and online experimentation, our scientists develop insights and optimizations that enable the monetization of Amazon properties while enhancing the experience of hundreds of millions of Amazon shoppers worldwide. If you're fired up about being part of a dynamic, driven team, then this is your moment to join us on this exciting journey!Key job responsibilities - Serve as a tech lead for defining the science roadmap for multiple projects in the conversational ad experiences space powered by LLMs- Build POCs, optimize and deploy models into production, run experiments, perform deep dives on experiment data to gather actionable learnings and communicate them to senior leadership- Work closely with software engineers on detailed requirements, technical designs and implementation of end-to-end solutions in production- Work closely with product managers to contribute to our mission, and proactively identify opportunities where cutting edge science can help improve customer experience - Research new machine learning approaches to drive continued scientific innovation- Be a member of the Amazon-wide machine learning community, participating in internal and external meetups, hackathons and conferences- Help attract and recruit technical talent, mentor scientists and engineers in the teamBASIC QUALIFICATIONS- 3+ years of building machine learning models for business application experience- PhD, or Master's degree and 6+ years of applied research experience- Experience programming in Java, C++, Python or related language- Experience with neural deep learning methods and machine learning ...

Finance Manager, AWS Sales Finance, AWS Sales Finance

Amazon Web Services (AWS) seeks a Finance Manager to be a key member in our AWS Industries Finance team and join one of the fastest growing divisions within Amazon. AWS Industries is committed to helping industry customers enable their digital transformation journeys. Our primary goal is to meet customers where they are in their cloud journey and work backwards from their industry specific needs to transform their business and their entire industry. As a Finance Manager, you will work closely with business leaders to develop financial models and analytical insights to assist in evaluating new business concepts, turning insights into operational measurements, and identifying paths to improve the overall planning and forecasting process. You will also provide strategy support to the business team.The successful candidate will have shown experiences in past roles influencing business owners and supporting strategic decision-making in a rapidly evolving environments. This role requires a self-starter with strong modeling skills, attention to detail, and an ability to manage multiple projects effectively. This role has regular interaction with executives and various business units across Amazon and therefore requires strong interpersonal and communication skills. As a business-facing finance partner, this role requires strong business sense and capability to independently drive partnership at all levels of the organization.Key job responsibilities - Present financial and business insights to senior management - Build financial framework and models for new business ideas - Provide strategic partnership to key business initiatives and investmentBASIC QUALIFICATIONS- 5+ years of tax, finance or a related analytical field experience- Bachelor's degree in finance, accounting, business, economics, or a related analytical field (e.g., engineering, math, computer science), or Bachelor's degree and 5+ years of quantitative role (engineering, process re-engineering, quality assurance) experience ...