Startups · AI

Manager, ML Solutions Architecture - Token Factory

Nebius · Remote - United States · Remote

← All jobs
About Nebius

Build and scale faster on the purpose-built AI cloud, engineered from silicon to API. Backed by Accel.

About the role

This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack.

What they're looking for

  • References from both former managers and former direct reports
  • Experience scaling a team through rapid growth (5 → 15+) without losing delivery quality
  • Prior experience in a customer-facing technical function at a cloud, inference, or AI infrastructure provider
  • Experience defining process and documentation for a team that had none
  • Hands-on background running LLMs in production and debugging inference workloads at the framework level
  • Work with multimodal AI models (vision-language, speech)
More about this role

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference...

Read the full posting on Nebius's site ↗

TF Solutions Architecture

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.