Inferact is a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Our mission is to grow vLLM as the world. Backed by Lightspeed.
About the role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Hands-on product or application security experience on software that customers run or depend on, with a record of finding, fixing, and preventing real vulnerabilities, not only running scanners or tracking compliance
- Strong software engineering ability: you read and write production code, review pull requests, and can ship a fix and the test that proves it
- Experience threat-modeling and reviewing the design of distributed systems, APIs, and services, including authentication, authorization, multi-tenancy, data isolation, and secrets handling
- Working knowledge of cloud and container security: IAM, network boundaries, Kubernetes, and infrastructure as code
- Sound risk judgment: you can separate a real, reachable risk from a theoretical one and choose controls that fit the stage of the company
- Clear written and verbal communication with engineers, leadership, and customers' security teams, and discretion with sensitive information
More about this role
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.
We're looking for a Member of Technical Staff, Product Security to secure the Inferact product as it moves from early deployments to production use by enterprise customers. Customers trust Inferact with their models, prompts, and production traffic. You'll own the security of the systems that serve them: the inference platform and its APIs, the control plane, the cloud and Kubernetes infrastructure underneath, and the way we build and ship software.
This is a hands-on engineering role. You'll threat-model new features with the engineers who build them, review and write code, find and fix vulnerabilities, and build secure defaults, tooling, and guardrails that let a small team move fast without adding risk. You'll work closely with the inference, infrastructure, product, and forward-deployed engineering teams, and with the engineer who owns vLLM vulnerability management when an upstream issue affects our...
Browse similar: Startup jobs · San Francisco Bay Area