# Staff Software Engineer, Inference Infrastructure at Cohere

- Company: Cohere
- What the company does: Backed by AI Grant.
- Company website: https://cohere.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco
- Work setup: Remote
- Pay: $190K to $325K base salary per year (USD)
- Posted: 2026-01-12
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/cohere/41f23dad-9da2-451a-bd1e-a1800437cb64
- Page: https://www.1752.vc/careers/jobs/cohere-staff-software-engineer-inference-infrastructure/

## About the role

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

## What they're looking for

- 5+ years of engineering experience running production infrastructure at a large scale
- Experience designing large, highly available distributed systems with Kubernetes, and GPU workloads on those clusters
- Experience with Kubernetes dev and production coding and support
- Experience with GCP, Azure, AWS, OCI, multi-cloud on-prem / hybrid serving
- Experience in designing, deploying, supporting, and troubleshooting in complex Linux-based computing environments
- Experience in compute/storage/network resource and cost management

Tags: Inference