Red Hat is the world’s leading provider of enterprise open source solutions, including high-performing Linux, cloud, container, and Kubernetes technologies. Backed by Greylock and Menlo.
About the role
The salary range for this position is $ 186,160 - $287,410 /year. Actual offer will be based on your qualifications. Found on 1752vc Careers, the job board for startup and VC roles.
What they're looking for
- Contribute to and maintain upstream open-source ML infrastructure vLLM, including reviewing pull requests, triaging issues, participating in design discussions, and supporting release readiness
More about this role
*Telecommuting permitted: work may be performed within normal commuting distance from the Red Hat, LLC office in Boston, MA.
Lead the design and implementation of high-performance Python, C++, CUDA, and Triton code for vLLM-based inference systems, GPU kernels, and numerical computing components in production-scale LLM serving environments.
- Architect, develop, and optimize advanced LLM inference algorithms, including quantization, sparsification, speculative decoding, paged attention, KV cache optimization, batching, scheduling, and memory management, to significantly improve latency, throughput, scalability, and cost efficiency.
- Drive deep performance profiling, benchmarking, and modeling on NVIDIA GPUs, using tools such as Nsight Systems, Nsight Compute, CUPTI, PyTorch Profiler, CUDA, Triton, and CUTLASS to identify bottlenecks and deliver measurable system-level improvements.
- Own the end-to-end optimization of vLLM-based inference pipelines, including kernel-level tuning, runtime optimization, distributed inference, multi-GPU serving, tensor/pipeline parallelism, and large-scale deployment performance.
- Evaluate, prototype, and integrate state-of-the-art LLM serving...
Browse similar: AI jobs · AI startup jobs · Startup jobs