Senior Data Engineer - PubTech Data, Insights & Analytics, Amazon

The Publisher Technologies (PubTech) team builds and operates extensible services that empower 1P Publishers to improve the monetization of their customer experiences, along with the experiences themselves. We bias toward standards-based and flexible designs that allow Publishers the ability to invent on top of our solutions and to interoperate well with other advertising technology providers; both internal and external.

The PubTech Data, Insights, and Analytics team enables faster data-driven decision making for Publishers and Monetization teams by providing them with near real time data, data management tools, actionable insights, and an easy-to-use reporting experience. Our data products provide Publishers and Monetization teams with the capabilities necessary to better understand the performance of their Advertising products along with supporting machine learning at scale.

As a Senior Data Engineer, you will be responsible for building a reliable and efficient data platform to support Analytics and intuitive data products. This will enable our stakeholders to easily leverage data in an efficient and self-service manner. You will work on diverse, industry-leading data technologies such as Spark, Iceberg, Kafka, and various other AWS technologies to build a scalable and robust data platform supporting Analytics and Experimentation. Additionally, you will own the creation of end-to-end data pipelines that consolidate large data sets across disparate systems and combine them into easily consumable data sets, driving actionable insights for your customers.

The ideal candidate will be highly analytical, able to work effectively in a matrix organization, and adept at synthesizing a variety of technologies and capabilities into products that advertisers love. You must engage with customers to deeply understand their current and emerging needs. Given the rapidly evolving nature of advertising, you must develop customer insight to identify solutions and innovate on behalf of your customers. We are seeking a customer-obsessed, technology-savvy individual with a passion for advertising and a well-rounded technical background, including a history of leading complex, ambiguous projects end-to-end.

Key job responsibilities
- Design, develop, and maintain our PubTech data platform's processing and analytics needs.
- Build robust, scalable, fault-tolerant data ingestion, processing, and storage solutions from the ground up using technologies such as Apache Spark, Kafka, and Amazon Web Services (AWS).
- Implement data quality processes, monitoring, and alerting mechanisms.
- Collaborate with data scientists, analysts, and product teams to understand their data requirements and translate them into efficient and reliable data pipelines.
- Contribute to the team's efforts in developing best practices, standards, and tools for data engineering.
- Mentor and guide junior data engineers, fostering their professional growth and development.