Startups · AI

Engineering Manager, Runtime - Storage

Baseten · San Francisco · Remote

← All jobs
About Baseten

Serve and scale open-source and custom AI models on the fastest, most reliable inference platform. Backed by Battery, Greylock and South Park Commons.

About the role

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Found on 1752vc Careers, the job board for startup and VC roles.

More about this role

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F , led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

THE ROLE

Container runtimes were designed for general-purpose software workloads. AI inference is not a general-purpose workload.

Running large models at production scale exposes cracks in every layer of the container stack: runtimes unaware of GPU memory constraints, images that take minutes to pull when a model needs to scale to thousands of replicas, and isolation mechanisms that weren’t designed for the multi-tenant serving environments that production AI requires. The tools the industry has relied on for a decade weren’t built for this, and patching around those limitations at higher layers only goes so far.

Baseten owns the...

Read the full posting on Baseten's site ↗

EPD

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.