The EC2 Capacity Data Intelligence and Platform Team (CDIP) is looking for an experienced Software Development Engineer to join our Seattle-based team. EC2 (Elastic Cloud Compute) is a part of Amazon Web Services (AWS), the global leader in public cloud infrastructure. The CDIP team operates within the EC2 Capacity Customer Experience Organization(CCX), dedicated to ensuring optimal capacity availability for all customers globally, through meticulous planning and execution. Data plays a pivotal role in enhancing the efficiency and quality of CCX programs, enabling well-informed large scale decision making that aligns with CCX's vision of automated capacity planning. You will be surrounded by peers that are exceptionally talented, bright and driven, who believe for EC2 and specifically within CCX, data is unequivocally the driving force behind progress. The software engineer on the team will develop, maintain, and optimize our data platform. You'll collaborate closely with engineers, data scientists, and business leaders to ensure the platform's availability, security, and reliability. Given our datasets' size, complexity, and criticality, we seek a Software Engineer with a deep analytical mindset and modern distributed systems experience with prior experience working with one of big data tools - Hadoop, Glue, Spark, EMR, Apache Iceberg in a cloud environment for processing petabyte scale data We seek a dedicated problem-solver with a proven history of devising creative solutions for intricate data challenges. The ideal candidate will possess exceptional communication and teamwork skills, a knack for rapidly grasping and implementing new technologies, and a keen eye for detail. In this position, you will craft comprehensive solutions spanning from data intake to frontend development, empowering data-driven decision-making processes. You will engage with real-time streaming data at a petabyte scale to construct alert systems that operate in real time. Additionally, you will construct a highly intricate and dynamic rules engine to automate large-scale manual workflows and decision-making processes.You will package data into APIs, facilitating its interaction with software systems to enhance and standardize their access to data. Furthermore, you will have the exciting opportunity to contribute to the development of self-service, data-intelligent systems. These systems will autonomously acquire domain knowledge, understand datasets and metrics, and equip users with self-service data insights—a feat beyond the reach of traditional business intelligence teams. The ideal candidate holds an advanced degree in Computer Science, engineering, or a related field, with strong programming skills in Java, Python, or Scala. Prior experience with Big Data tools like Spark, Hive, EMR, or Presto is necessary. Experience with BI development tooling, such as DBT/Airflow, is a plus. While expertise in all these tools isn't required, a willingness to learn and apply new tools is crucial. As a new team member, you'll be expected to tackle ambiguous problems, work independently to make business and technical trade-offs in order to deliver results. But you can also expect receive support from fellow team members who will answer questions and work collaboratively to solve day-to-day problems and issues. As an experienced engineer, you will have opportunities to mentor less experienced engineers even as you rub shoulders with other senior engineers in our organization. You will be welcomed as a fully participating team member in team rituals including daily stand-ups, design review sessions, demos, code reviews, and other team gatherings. As a team, we enjoy connecting socially while respecting the balance between work and personal life. This position involves on-call responsibilities, typically one week every two months. We focus on building fault-tolerant systems to minimize being paged during off-hours, and when we do get paged, we make sure to root-cause issues and resolve them to eliminate repeat pages, fueling continual improvement. As a team, we're invested in your career growth and success. We assign projects that balance the needs of the business with what will help each team member develop into a more well-rounded engineer and enable them to take on greater responsibility and more complex tasks in the future. We're looking for someone who will enthusiastically participate in a team culture that values delivering results for our customers, consistently learning and growing, striving for excellence in operations & project deliverables. Here at AWS, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee-led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 14 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust. By delivering high-performance, low-cost computing with a few clicks and a credit card, AWS is changing the world by democratizing access to the same industry-leading on-line resources, whether you're a large enterprise our a budding entrepreneur. Come join us. 10017Diverse ExperiencesAWS values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.About AWSAmazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.Inclusive Team CultureHere at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.Work/Life BalanceWe value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.Mentorship & Career GrowthWe’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.BASIC QUALIFICATIONS- 3+ years of non-internship professional software development experience- Experience programming with at least one software programming language- 3+ years of big data technologies such as AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/Samza experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
...