Boulder

Do you want to lead the Ads industry and redefine how we measure the effectiveness of the WW Amazon Ads business? Are you passionate about causal inference, raising the science bar, and connecting leading-edge science research to Amazon-scale implementation? If so, come join Amazon Ads to lead our Advertising Incrementality Measurement science team!Key job responsibilitiesAs the leader of Advertising Incrementality Measurement (AIM) science team, you are responsible for defining and executing on our causal measurement science vision. You will lead teams of Applied Scientists, Economists, and Data Scientists to work backwards from customer needs and translate product ideas into concrete deliverables. You will be the thought leader for inventing scalable causal measurement solutions that support highly accurate and actionable causal insights--from defining and executing hundreds of thousands of RCTs, to building and scaling Deep Neural Nets and other leading ML models. You will solve hard problems, advance science at Amazon, and be the leading innovator in the causal measurement of advertising effectiveness. In this role, you will work with a team of applied scientists, economists, engineers, product managers, and UX designers to define and build the future of advertising causal measurement. You will be working with massive data, a dedicated engineering team, and industry-leading partner scientists. Your team’s work will help shape the future of Amazon Advertising.BASIC QUALIFICATIONS- 4+ years of applied research experience- 3+ years of scientists or machine learning engineers management experience- 3+ years of building machine learning models for business application experience- PhD, or Master's degree and 6+ years of applied research experience- Knowledge of ML, NLP, Information Retrieval and Analytics- Experience programming in Java, C++, Python or related language- Experience in causal inference, from RCT experiment design and analysis, to ML design and implementation ...

The Advertising Incrementality Measurement (AIM) team is looking for an Applied Scientist II with experience in causal inference, experimentation, and ML development to help us expand our causal modeling solutions for understanding advertising effectiveness. Our work is foundational to providing customer-facing experimentation tools, furthering internal research & development, and building out Amazon's new Multi-Touch Attribution (MTA) measurement offerings. Incrementality measurement is a lynchpin for the next generation of Amazon Advertising measurement solutions and this role will play a key role in the release and expansion of these offerings.Key job responsibilities* Partner with economists and senior team members to drive science improvements and implement technical solutions at the state-of-the-art of machine learning and econometrics* Partner with engineering and other science collaborators to design, implement, prototype, deploy, and maintain large-scale causal ML models.* Carry out in-depth research and analysis exploring advertising-related data sets, including large sets of real-world experimental data, to understand advertiser behavior, highlight model improvement opportunities, and understand shortcomings and limitations.* Define data quality standards for understanding typical behavior, capturing outliers, and detecting model performance issues.* Work with product stakeholders to help improve our ability to provide quality measurement of advertising effectiveness for our customers.About the teamAIM is a cross disciplinary team of engineers, product managers, economists, data scientists, and applied scientists with a charter to build scientifically-rigorous causal inference methodologies at scale. Our job is to help customers cut through the noise of the modern advertising landscape and understand what actions, behaviors, and strategies actually have a real, measurable impact on key outcomes. The data we produce becomes the effective ground truth for advertisers and partners making decisions affecting $10s to $100s of millions in advertising spend. BASIC QUALIFICATIONS- 3+ years of building models for business application experience- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience- Experience programming in Java, C++, Python or related language- Experience with ML modeling toolkits such as sklearn, PyTorch, Tensorflow, etc.- Experience with data exploration and querying technologies such as pandas, SQL, and Spark.- Very strong written communication skills. An ideal candidate needs to be able to distill complex technical details into tangible insights for leaders and stakeholders. ...

Do you want to work in a start-up environment with the resources of Amazon behind you? We’re building a new team the Boulder area, a rapidly emerging tech hot spot. Not only will you work with other smart, driven, innovative engineers, you’ll live in the beautiful foothills of the Rocky Mountains where there’s approximately 300 days of sunshine and a huge variety of activities to keep both your mind and body in great shape.We have an opening for a software engineer on the Amazon Marketing Cloud (AMC) team. AMC teams build a secure, privacy-safe, and dedicated cloud-based environment in which advertisers can easily perform analytics across multiple data sets enabling them to make more informed decisions about their cross-channel marketing investments. The role will be focused on the services that power AMC and enable it to scale.Our services ingest billions of behavioral signals every day. Speed, scale, and accuracy are critical to our success. We work in some of the most exciting computer science domains (massive scale streaming systems, machine learning, data science, cloud native development). We build front-ends in ReactJS and back-ends with Kotlin and native AWS. We are *not* looking for an expert in any one of these particular domains (although, it wouldn't hurt). We are looking for a motivated software engineer with a proven track record of solid computer science fundamentals and building production quality software systems.If you are excited about working with the latest technologies to massively scale a new product this is the right place for you. The ideal candidate will be innovative, have great problem solving, analytical and technical skills. You demonstrate exceptional customer relationships skills and love to discover the true requirements underlying feature requests. You enjoy simplifying complex problems and tackling challenges.If this sounds like a good fit, then come help us build the Amazon Marketing Cloud.About the teamAmazon Marketing Cloud (AMC) is an advanced analytics product that is secure, privacy-safe, and dedicated cloud-based environment in which advertisers can easily perform analytics across multiple, pseudonymized data sets to take actions for their Advertising Activities. We are building capabilities where customers can perform custom measurement, media planning, targeting and optimization (deterministic and machine learning model based). This is multi-year greenfield project with exposure to direct customers, building software as a solution (SAAS) on native AWS stack, building framework to perform advanced analytics including machine. Learn more from links belowAMC: https://advertising.amazon.com/solutions/products/amazon-marketing-cloudBASIC QUALIFICATIONS- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience programming with at least one software programming language ...

Are you excited about operating at Internet scale? Inventing how ads performance is measured in the online retail world? Growing and learning from the world class engineers? If so, we want to hear from you! We need software engineers with strong fundamentals and an interest in working with data. Key job responsibilitiesYou will be responsible for designing and developing software products that provide measurement data to a wide set of users across all of Amazon's advertising suite. You will be able to demonstrate a variety of architectural approaches and design patterns and have a demonstrated competence in designing maintainable and scalable software written in a high-level language. You will show your ability to adapt to changing technical environments and devise creative solutions to vexing software problems. You will encounter some of the toughest and most inspiring technical challenges of your career as you build petabyte-scale services, invent new big data paradigms, and scale for large growth.A day in the lifeWe enable advertisers to optimize ad spend and allocate budgets effectively by providing accurate, actionable and timely conversion measurement for all Amazon ad products. We produce the estimates that are fastest in the industry without compromising quality. We apply the latest AWS big data and machine learning technologies on over 50 billion new events per day, operating petabyte size clusters. This team publishes the metrics used by advertisers and systems within Amazon to analyze the performance of their investment in ads. Our charter is focused on distributing conversions estimated by a variety of techniques, to multiple systems with challenging requirements.About the teamThis team defines and produces the metrics used by advertisers to analyze the performance of their investment in ads. The charter of this team is focused on applications responsible for computing and distributing estimated conversions. We work with a variety of systems and languages: combining AWS services like EMR, Kinesis and AWS Batch, with open source technologies such as Spark, Presto.BASIC QUALIFICATIONS- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience programming with at least one software programming language- Experience using big data technologies (Spark, EMR, Presto, etc.)- Knowledge of data management fundamentals and data storage principles- Knowledge of distributed systems as it pertains to data storage and computing ...

Do you want to work in a start-up environment with the resources of Amazon behind you? Are you passionate about using Big Data to build customer trust and grow new business? Global advertisers rely on our team's performance insights to drive future investment in Amazon's Advertising Platform and improve the relevance of ads shown to customers.We’re looking for strong Software Engineers that can build upon technologies such as Elasticsearch, Spark, Hive and Presto, as well as AWS services like Elastic Map Reduce (EMR), Redshift, Kinesis and DynamoDB to build the next generation of our analytics and visualization platform. If this sounds interesting we’d love to hear from you!Amazon is well positioned to grow its share of a fast growing online advertising industry due to its unique assets - e-commerce data, service oriented architecture, and startup culture. Our services ingest billions of behavioral signals every day. Speed, scale, and accuracy are critical to our success. We work in some of the most exciting computer science domains (massive scale streaming systems, machine learning, data science, cloud native development). Be part of a team of industry leading experts that builds and operates one of the largest big data analytics platforms at Amazon. Amazon is applying the latest big data technologies available to change the way marketers purchase, track, measure, and optimize their advertising spend. We apply these technologies on terabytes of data (over 10B new events per day) and operate clusters that push scalability limits of the existing technologies. We seek to measure every possible signal indicating impact of advertising to provide the most objective result of marketing spends.This role will involve designing and developing software products that impact many areas of our business. The individual in this role will have responsibility to help define requirements, create software designs, implement code to these specifications, provide thorough unit and integration testing, and support products while deployed and used by our stakeholders.BASIC QUALIFICATIONS- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience programming with at least one software programming language ...

Do you enjoy leading teams of engineers working on high-scale, complex, international solutions? Do you enjoy end-to-end responsibility, working on business ideas as well as technology, software engineering, and operations? Then you might be a great fit to join us as a Software Development Manager in Advertising. Advertising Amazon Marketing Cloud teams build Advanced Analytics System that is secure, privacy-safe, and dedicated cloud-based environment in which advertisers can easily perform analytics across multiple data sets to generate insights to take programmatic actions. Inputs can include an advertiser’s own data sets, as well as their Amazon Advertising campaign events, such as impressions, clicks, and conversions. AMC reports can help with campaign measurement, audience refinement, supply optimization, and more, enabling advertisers to make more informed decisions about their cross-channel marketing investments. Our services ingest billions of behavioral signals every day. Speed, scale, and accuracy are critical to our success. You will lead an Agile team in our development center in Boulder, Colorado, growing new green field initiatives. You will be responsible for core engineering to build a control and operational plane for a Software As a Service ( SAAS) Product for our customers using native Amazon Web Services (AWS). Your team will have end-to-end ownership of business, technology, and operations, giving you the responsibility and autonomy to ensure success. Your systems will meet remarkably high standards of performance and reliability, and will operate at massive scale, 24x7. Successful candidates will have a background in software development, most likely with a Computer Science or related degree. You are detail- and customer-oriented and have excellent problem solving abilities. You are a confident people manager with a track record of growing high performance teams. The position offers exceptional opportunities for every candidate to grow their technical and non-technical skills. If you are selected, you have the opportunity to really make a difference to our business by inventing, enhancing and building world class systems, delivering results, and working on exciting and challenging projects. Job Responsibilities: - Earn trust across different levels and multiple groups of a large organization - Work with technology and digital media - Exceptional ability to analyze and interpret large amounts of data in order to make recommendations for improvement - Strong oral and written communication skills, as well as ability to think clearly, analyze quantitatively, solve problems, scope technical requirements and prioritize project work - Sound business judgment, proven ability to influence others, and strong analytical thinking skills - Ability to think strategically and act tactically - Have an opportunity to lead and grow a team engineers - Opportunity to grow and broaden your leadership and technical skills as you work in an environment that thrives on creativity, experimentation, and product innovation - Change the way customers use data to drive business success - Have fun and inspire team members to enjoy work, be action-oriented and stretch their imagination - Ability to get a lot done in a startup environment with a mix of ambiguity and opportunity This position starts at $122,300/yr. A sign-on bonus and restricted stock units will be provided as part of the compensation package, in addition to a range of medical, financial, and/or other benefits, dependent on the position offered. For more information regarding Amazon benefits, please visit https://www.amazon.jobs/en/benefits. Applicants should apply via Amazon’s internal or external careers site. BASIC QUALIFICATIONS- 3+ years of engineering team management experience- 7+ years of working directly within engineering teams experience- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience- 8+ years of leading the definition and development of multi tier web services experience- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations- Experience partnering with product or program management teams ...

Job summaryAmazon is investing heavily in building a world class advertising business and we are responsible for major initiatives. We are highly motivated, collaborative and fun-loving with an entrepreneurial spirit and bias for action. With a broad mandate to experiment and innovate, we are growing at an unprecedented rate with a seemingly endless range of new opportunities. As a Sr. SDM, you will be 100% focused on implementing major change throughout a complex low-latency, high throughput advertising infrastructure. The conversion measurement team is responsible for harvesting on and off Amazon conversion data. They are also responsible for building new techniques to measure conversions while preserving customer privacy. You will own an end to end product, from harvesting, processing, and reporting this critical data for our customers. These services are high scale, with peak data volumes in PB of data and millions of TPS. Your team will consist of Sr. Engineering talent solving some of the hardest big data problems at Amazon. You will also be excellent at driving results, being able to build solutions for large, multi-functional projects on-time, anticipate bottlenecks, provide escalation management, anticipate and make trade-offs, and balance business needs versus technical constraints. You are responsible for defining technical design and building world-class software that pushes boundaries. About you: You want to work on projects where you are implementing solutions to real problems that require creative solutions and deep understanding of the problem space. You challenge yourself and others to constantly come up with better and often disruptive solutions. You know how to work cross-functionally to create alignment and deliver results. You're a thought leader, but you don't just know how to solve the problem, you prove it by going and building the solution. You want to create value and impact the direction of entire industries. This role will involve driving products impacting many areas of our business. The individual in this role will have responsibility through the full product life cycle, from product strategy, prioritization and development to adoption and iteration with global sales and account management teams. You will directly build the next generation of Amazon's ad reporting systems. This role requires a deeply technical person that can work at this scale but also interface with business teams and ensure our platform meets the needs of our customers. We’re looking for experienced, motivated software engineering managers with a proven track record of building web applications and services. You’ll be responsible for owning, leading and delivering highly scalable systems that will be used by customers to build, manage and serve innovative ad solutions. Our team works across Amazon. We’re building a full-service, full-stack platform for end-users and other developers.With our team you’ll get the opportunity to own & lead major initiatives and build complex solutions. You’ll work with customers directly, to scope, design, implement and launch new features quickly and iteratively. We believe in teamwork and in delivering rock solid, customer focused solutions.The pay range for this position in Colorado is $220,100-$297,700; however, base pay offered may vary depending on job-related knowledge, skills, and experience. A sign-on bonus and restricted stock units may be provided as part of the compensation package, in addition to a full range of medical, financial, and/or other benefits, dependent on the position offered. This information is provided per the Colorado Equal Pay Act. Base pay information is based on market location. Applicants should apply via Amazon's internal or external careers site.Key job responsibilities· Collaborate with SDEs, PEs and engineering managers to develop the best technical and operational design and approach, delivering value quickly to customers without sacrificing the long-term.· Design, refine and reduce the ongoing costs of operational processes.· Report on status of platform scalability to executive management and act quickly and decisively to resolve customer-impacting issues. - Learn and deploy best OE practices at Amazon, engage with other teams in the company, evangelizing the team and your project, building relationships and helping identify existing components and technologies that can be leveraged to deliver on our goals.A day in the lifeYour day will typically be some combination of product vision/roadmap creation along with deeper technical reviews. System availability is our highest priority and Software Development Managers review their systems each week for operational efficiency. You'll be expected to hire a top performing team so you'll spend some portion of your day growing and mentoring talent. Finally, as a senior leader you'll be expected to present your strategic vision to stakeholders and customersAbout the teamMeasurement and Data Science (MADS) delivers scaled advertising campaign measurement and reporting. We support all Amazon ad programs including Sponsored Products, Sponsored Brands, Sponsored Display, Amazon DSP, 3P Paid Merchandising (HOTW), and Amazon Live. We serve advertisers by creating campaign measurement products and delivering performance reporting through our reporting API (hundreds of millions of queries per day) while enabling stakeholder teams to launch and measure new marketing tactics. In addition to developing new measurement and reporting, we develop the foundational architectures of scaled measurement including our compute infrastructure (100+ services, 25K+ nodes), data set storage (2 PB/day), and processing of ad, conversion, and identity events in near real time . Offline reports generated through UIs and APIs have seen 2X YoY increase. MADS is comprised of product managers, scientists, and software development contributors in Toronto, Boulder, HQ2, and Seattle.BASIC QUALIFICATIONS- 10+ years of engineering experience- 5+ years of engineering team management experience- 10+ years of planning, designing, developing and delivering consumer software experience- Experience partnering with product or program management teams- Experience managing multiple concurrent programs, projects and development teams in an Agile environment ...