Cisco is a worldwide technology leader powering an inclusive future for all. Learn more about our products, services, solutions, and innovations. Backed by Sequoia and Menlo.
About the role
You'll develop software consistent with Cisco Design Thinking Principles, with simplification and user experience at its core, using secure coding practices, protecting user privacy, and following software development best practices. You'll partner with design, product management, and other engineering teams to build the right solution for our customers. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- 8 or more years of related AI systems, platform, or software engineering experience, or equivalent practical experience, including programming in Python or Go
- Production experience operating AI infrastructure and GPU workloads on Kubernetes and Linux
- Hands on experience serving models with vLLM, NVIDIA NIM, Triton, or a comparable inference runtime, including building supporting services
- Experience leading technical work, mentoring engineers, documenting systems, and supporting critical services through an on call rotation
- Strong understanding of model inference and evaluation, including batching, token throughput, memory use, quantization, benchmarking, and production release decisions
- Familiarity with distributed inference, disaggregated serving, KV cache aware routing, GPU capacity planning, and cost optimization
More about this role
The application window is expected to close on: 10/29/2026
Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received.
We run the platform that serves foundational models to Cisco IT. Our Foundational Model Service, gives engineering teams across the company access to small, large language, and embedding models. youWe serve those models on Kubernetes clusters, with Nim, Vllm and other runtimes. Beyond serving, We benchmark, evaluate, monitor, and release new models as improvements and demand warrant. Our customers depend on the platform under a 99.9% uptime SLA, and we build and operate accordingly.
As a Software Engineer on the FMS team you'll keep that platform running and make it easier to run. You'll support model onboarding and releases, take your turn on call, help automate the validation that gates every deployment, and contribute to the monitoring that shows us and our customers how the service is behaving. You'll also apply Agentic solutions to our own operations to catch problems earlier and remediate them automatically.
You'll develop software consistent with Cisco Design Thinking Principles, with simplification...
Browse similar: Startup jobs