Startups

Senior Software Engineer, Streaming Infrastructure

Airbnb · United States · On-site

← All jobs
About Airbnb

Get an Airbnb for every kind of trip → 8 million vacation rentals → 2 million Guest Favorites → 220+ countries and regions worldwide. Backed by General Catalyst, Greylock and Kleiner Perkins.

About the role

Airbnb's Data Infrastructure organization builds the systems that store, move, and transform data across the company. Our Data Movement & Transformation (DMT) group is building a single, unified platform for moving data between Airbnb's storage systems, replacing dozens of one-off tools with one reliable, well-supported way to get data where it needs to go. This platform is the foundation for Data as a Service, a top-level infrastructure initiative at Airbnb. Found on 1752vc Careers, the job board for startup and VC roles.

What they're looking for

  • SpinalTap: near real-time change data capture (CDC) streaming to Kafka for every Aurora and UDS table at Airbnb
  • DBExports: periodic full-table snapshots and mutation exports
  • Be hands-on (code, design, test) and work with partner teams, internal customers, and leadership to deliver multi-month projects on time
  • Design, build, and operate large-scale CDC and batch export systems that run across every online database at Airbnb
  • Help shape the architecture of DMT's unified data movement platform while it's being built
  • Improve the reliability, performance, and efficiency of systems that critical business functions depend on
More about this role

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

Airbnb's Data Infrastructure organization builds the systems that store, move, and transform data across the company. Our Data Movement & Transformation (DMT) group is building a single, unified platform for moving data between Airbnb's storage systems, replacing dozens of one-off tools with one reliable, well-supported way to get data where it needs to go. This platform is the foundation for Data as a Service, a top-level infrastructure initiative at Airbnb.

The Ingestion team is the front door to DMT. We build and operate two managed, multi-tenant platforms that move data out of Airbnb's online databases for offline processing:

  • SpinalTap: near real-time change data capture (CDC) streaming to Kafka for every Aurora and UDS table at Airbnb.
  • DBExports: periodic full-table snapshots and mutation exports.

Teams across Airbnb...

Read the full posting on Airbnb's site ↗

Software Engineering

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.