# LLM Inference Engineer at Majestic Labs

- Company: Majestic Labs
- What the company does: Backed by Lux.
- Company website: https://majestic-labs.ai
- Type: Startups (AI role)
- Level: Mid level
- Location: Los Altos, CA, United States
- Work setup: On-site
- Posted: 2026-10-25
- Apply by: 2026-12-09
- Apply: https://www.comeet.com/jobs/majesticlabs/AA.004/llm-inference-engineer/8D.C67-7F.506?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/majestic-labs-llm-inference-engineer/

## About the role

Backed by top-tier investors and led by industry veterans, we’re scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us! Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- The serving stack, end to end — bring up and adapt a modern inference framework (vLLM, SGLang, or similar) to run on Majestic hardware
- The runtime hot path — continuous batching, the scheduler, paged KV cache, and prefill/decode disaggregation
- Distributed inference at scale — tensor, pipeline, and expert parallelism across accelerators, wired into our collective communication library (CCL)
- The multi-modal pipeline — image, audio, and video preprocessing, encoder integration, and mixed-modality batching
- Inference-time techniques — speculative decoding, prefix caching, and structured decoding
- End-to-end performance — profile, benchmark, and hunt down bottlenecks across the full serving path, feeding findings back to the kernel, compiler, and hardware teams

Tags: Engineering

Source: 1752vc Careers, https://www.1752.vc/careers/jobs/majestic-labs-llm-inference-engineer/