Startups · AI

Principal ML Solutions Architect - Token Factory

Nebius · United States · On-site

← All jobs
About Nebius

Build and scale faster on the purpose-built AI cloud, engineered from silicon to API. Backed by Accel.

About the role

This position sits within Nebius Token Factory , our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning ( LoRA , full FT , RFT ) backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack.

What they're looking for

  • Contributions or maintainership in major OSS inference/ML projects (vLLM, SGLang, TensorRT-LLM)
  • Published research, conference talks, or widely-read technical writing in the LLM/serving space
  • Deep work with multimodal AI models (vision-language, speech)
  • Proficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code
  • Experience building or owning internal tooling/automation for ML workflows at scale
More about this role

Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.

Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.

Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

This position sits within Nebius Token Factory , our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning ( LoRA , full FT , RFT ) backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints. Customers come to us to move from prototype to scaled production without the cost and complexity of building and...

Read the full posting on Nebius's site ↗

TF Solutions Architecture

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.