Startups · AI

Software Engineer, Distributed Data Systems

Exa · San Francisco, California · On-site

← All jobs
About Exa

Search API for AI agents that need real-time web data, deep research, and structured content from one endpoint. Try our API for free. Backed by Lightspeed, Y Combinator and a16z.

About the role

Our ultimate goal is to build perfect search over all the world's information, far beyond Google. If you want to build massive-scale ML systems that will define the way the new AI world consumes information, this is the place for you.

What they're looking for

  • Deep understanding of lakehouse architectures (Delta Lake, Iceberg, Hudi) and when to use them
  • Experience building and operating large-scale distributed data processing pipelines
  • Hands-on experience with streaming data systems (Kafka, Flink, or similar)
  • Familiarity with Ray, Spark, or ClickHouse at production scale
  • An obsessive focus on reliability and building systems that don't page you at 3am
More about this role

Exa is an applied AI lab building a search engine unlike the world has ever seen. We build massive-scale infra to crawl the entire web, train state-of-the-art embedding models to process it, and design super high performant vector databases to retrieve over it. We now power search for Cursor, Cognition, HubSpot, and over 400,000 developers and have raised $350m from Lightspeed, Benchmark, and a16z.

Our ultimate goal is to build perfect search over all the world's information, far beyond Google. If you want to build massive-scale ML systems that will define the way the new AI world consumes information, this is the place for you.

As a Data Engineer, you'll architect and build the data infrastructure that powers everything we do—from crawling billions of pages to training our embedding models to serving real-time search. You'll have enormous autonomy in designing systems that scale to hundreds of petabytes. If you've ever wanted to build data pipelines at a scale that most companies only dream about, this is your chance.

Deep understanding of lakehouse architectures (Delta Lake, Iceberg, Hudi) and when to use them

Experience building and operating large-scale distributed data...

Read the full posting on Exa's site ↗

Engineering

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.