We are hiring a Data Engineer II to help us accelerate our efforts in delighting our Advertising customers. We consider our Data Engineers owners of the data to which they can propose, own, and then deliver on new product ideas. We expect this person to build new data platform solutions as an owner end-to-end. The ideal candidate will be passionate about working with big data sets and have the expertise to utilize these datasets to answer business questions and drive growth.
To be successful in this role, you should have broad skills in Infrastructure design, be comfortable dealing with large and complex data sets, have experience building near real-time and batch processing data pipelines. Must be a self-starter, comfortable with ambiguity in a fast-paced and ever-changing environment, and able to think big while paying careful attention to detail.
Key job responsibilities
* Architect a scalable, reliable, and high-performing data processing pipeline on AWS. Leverage AWS services like EMR, Glue, Kinesis, S3, and Managed Airflow to build the data infrastructure.
* Ensure the platform can efficiently handle the ingest, processing, and storage of massive data volumes.
* Highly proficient in writing code in SQL and Python.
* Develop optimized ETL/ELT pipelines to transform raw data into analytical datasets
* Implement data partitioning, bucketing, and indexing strategies to enable high-performance queries
* Work closely with data scientists, software engineers, product managers, and BIEs
* Stay updated with the latest AWS services and data engineering best practices
About the team
The ADSP Product Analytics team is responsible for building platform that can make access to insights and metrics as easy as shopping on Amazon.com. And working backwards from this, we provide PMs access to KPIs and other insights via interactive visualization. We also enable our customers to analyze the data through self-serve query capabilities provided in an easy to use platform using Amazon’s out of box solutions. In addition to analytics, we provide data engineering support by building a scalable infrastructure in AWS that ensures data availability, security and accuracy.
BASIC QUALIFICATIONS
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.