# Engineering Manager, GPU Infrastructure at Cohere

- Company: Cohere
- What the company does: Backed by AI Grant.
- Company website: https://cohere.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: United States
- Work setup: On-site
- Posted: 2026-09-03
- Apply by: 2026-10-18
- Apply: https://jobs.ashbyhq.com/cohere/28239d75-5dd9-41fb-ba43-cb08b491be2b
- Page: https://www.1752.vc/careers/jobs/cohere-engineering-manager-gpu-infrastructure/

## About the role

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! As an Engineering Manager, you’ll lead a team of engineers who care deeply about GPU infrastructure. You’ll set technical direction, grow people, and help the company scale a rapidly growing compute footprint.

## What they're looking for

- Experience managing engineering or SRE teams, with a focus on technical mentorship, hiring, and growth, including in remote, distributed settings
- A background running large Kubernetes compute fleets in production, including in multi-cloud environments: multi-cluster operations, scheduling, node health at scale, and familiarity with IaC and infrastructure monitoring
- You’ve gone deep in one of the layers that make a GPU training fleet work, whether that’s cluster-wide operations, GPU networking, or hardware, and you’re willing to get hands-on and learn the rest
- Experience with cost optimization and capacity planning for GPU infrastructure
- A track record of partnering with researchers or ML engineers, and of making data-informed tradeoffs across reliability, cost, and delivery

Tags: Modeling