In this role, the ideal candidate will be responsible for developing and managing big data systems using advanced data engineering knowledge in the data warehousing space and redefining best practices with a cloud-based approach to scalability and automation. Additionally, you will be responsible for scaling our existing infrastructure, incorporating new data sources, and building robust data pipelines for production level systems. In partnership with machine learning engineers, business intelligence engineers and analysts, you will work backwards from our business questions to build reliable and scalable data solutions to meet the business needs. Finally, this individual will work closely with project management teams to ensure proper guidance, use cases, and documentation is available to our Sales and Operations teams.
Responsibilities include:
- Partnering with the Anaplan dev team and owning the data pipelines going into and out of the planning tools
- Understand existing databases and warehouse structures in order best determine how to consolidate and aggregate data in an efficient and scalable way.
- Design and code all aspects of data solutions using Amazon Redshift (SQL Server) to build out an Operations data warehouse.
- Create and propose technical design documentation, which includes current and future ETL functionality, database objects affected, specifications, and flows and diagrams to detail the proposed implementation.
- Design, develop, implement, test, document, and operate large-scale, high-volume, high-performance data structures for business intelligence analytics.
- Implementing data structures using best practices in data modeling to provide on-line reporting and analysis using business intelligence tools and a logical abstraction layer against large, multi-dimensional datasets and multiple sources.
- Evaluating and making decisions around dataset implementations designed and proposed by peer data engineers. Mentor junior data engineers.
- Manage AWS resources including EC2, Redshift, S3, etc. Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency.
- Participating in the full development life cycle, end-to-end, from design, implementation and testing, to documentation, delivery, support, and maintenance to produce comprehensive, usable dataset documentation and metadata.
About the team
ABOUT AWS:
Diverse Experiences
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Why AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why flexible work hours and arrangements are part of our culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Inclusive Team Culture
Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.
Mentorship and Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
BASIC QUALIFICATIONS
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
PREFERRED QUALIFICATIONS
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $118,900/year in our lowest geographic market up to $205,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.