Cohere is the innovator of Spectrum Multiplier software for Open Radio Access Networks and existing 4G and 5G mobile networks, and the developer of the Orthogonal Time Frequency Space (OTFS) 6G wireless system. Backed by NEA.
About the role
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- 8+ years of engineering experience running production infrastructure, designing large-scale distributed systems, or deploying enterprise software in complex environments
- Deep technical depth in production Kubernetes, including orchestration across multi-cluster and hybrid/multi-cloud ecosystems (GCP, Azure, AWS, OCI)
- Strong understanding of LLM architecture and inference dynamics, specifically how attention mechanisms, compute-bound prefill, and memory-bound decode phases dictate live performance
- Hands-on experience with modern inference engines and optimization stacks (e.g., vLLM, TensorRT-LLM, lmd, or Dynamo)
- Familiarity with distributed serving techniques, such as prefill/decode disaggregated serving, distributed KV caching, and multi-GPU workloads
- Exceptional customer-facing technical leadership, with a proven track record of scoping highly ambiguous problems and steering executive technical stakeholders
More about this role
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Are you energized by bridging the gap between frontier AI capability and complex customer reality? Do you want to architect high-performance, resilient machine learning systems directly inside strategic enterprise environments? We are looking for a Staff Forward Deployed Engineer (FDE) to join our team. The team is responsible for taking our large...
Browse similar: AI jobs · AI startup jobs · Startup jobs