# Forward Deployed Engineer, Inference at Cohere Technologies

- Company: Cohere Technologies
- What the company does: Cohere is the innovator of Spectrum Multiplier software for Open Radio Access Networks and existing 4G and 5G mobile networks, and the developer of the Orthogonal Time Frequency Space (OTFS) 6G wireless system. Backed by NEA.
- Company website: https://www.cohere-tech.com/
- Type: Startups (AI role)
- Level: Mid level
- Location: United States
- Work setup: On-site
- Pay: $240K to $415K base salary per year (USD)
- Posted: 2026-10-28
- Apply by: 2026-12-12
- Apply: https://jobs.ashbyhq.com/cohere/8df498e9-aba8-487f-80ba-362b492bad09?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/cohere-technologies-forward-deployed-engineer-inference/

## About the role

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- 8+ years of engineering experience running production infrastructure, designing large-scale distributed systems, or deploying enterprise software in complex environments
- Deep technical depth in production Kubernetes, including orchestration across multi-cluster and hybrid/multi-cloud ecosystems (GCP, Azure, AWS, OCI)
- Strong understanding of LLM architecture and inference dynamics, specifically how attention mechanisms, compute-bound prefill, and memory-bound decode phases dictate live performance
- Hands-on experience with modern inference engines and optimization stacks (e.g., vLLM, TensorRT-LLM, lmd, or Dynamo)
- Familiarity with distributed serving techniques, such as prefill/decode disaggregated serving, distributed KV caching, and multi-GPU workloads
- Exceptional customer-facing technical leadership, with a proven track record of scoping highly ambiguous problems and steering executive technical stakeholders

Tags: Engineering & Infra

Source: 1752vc Careers, https://www.1752.vc/careers/jobs/cohere-technologies-forward-deployed-engineer-inference/