# Lead Member of Technical Staff, Inference Infrastructure at Cohere

- Company: Cohere
- What the company does: Backed by AI Grant.
- Company website: https://cohere.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco
- Work setup: Remote
- Pay: $235K to $325K base salary per year (USD)
- Posted: 2026-04-28
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/cohere/5806a521-8584-4bbe-b60a-49031b919251
- Page: https://www.1752.vc/careers/jobs/cohere-lead-member-of-technical-staff-inference-infrastructure/

## About the role

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

## What they're looking for

- 8+ years of engineering experience running production infrastructure at a large scale, with a track record of technical leadership
- Demonstrated experience leading the architecture and design of large, highly available distributed systems with Kubernetes and GPU workloads on those clusters
- Deep expertise with Kubernetes dev and production coding and support, including setting team-wide standards and best practices
- Extensive experience across GCP, Azure, AWS, OCI, and multi-cloud on-prem / hybrid serving environments, with the ability to guide strategic infrastructure decisions
- Proven ability to lead the design, deployment, support, and troubleshooting of complex Linux-based computing environments at scale
- Experience owning compute/storage/network resource and cost management at an organisational level, including optimisation strategies

Tags: Inference