# Principal Software Engineer, Inference at Hewlett Packard Enterprise

- Company: Hewlett Packard Enterprise
- Company website: https://www.hpe.com
- Type: Startups (AI role)
- Level: Principal and up
- Location: 3 Locations
- Work setup: On-site
- Posted: 2026-11-06
- Apply by: 2026-12-21
- Apply: https://hpe.wd5.myworkdayjobs.com/en-US/Jobsathpe/job/Spring-Texas-United-States-of-America/Principal-Software-Engineer--Inference_1211357-2?utm_source=1752vc&utm_medium=careers
- Page: https://www.1752.vc/careers/jobs/hewlett-packard-enterprise-principal-software-engineer-inference/

## About the role

· Define and own the technical direction of the LLM serving deployment, i ncluding engine integration, continuous batching, KV cache management and reuse, and quantized execution · Partner with inference performance engineering teams, with accountability for time-to-first-token, inter-token latency, throughput per GPU, and P95/P99 tail latency Found on 1752vc Careers, the job board for startup and VC roles.

## What they're looking for

- Production experience with LLM inference engines such as vLLM, SGLang, TensorRT-LLM, TGI, or NVIDIA NIM, including modification of engine internals
- Comprehensive understanding of inference internals, including continuous batching, paged attention, KV cache reuse and prefix caching, chunked prefill, quantization, and speculative decoding
- Tensor and pipeline parallelism, NCCL collective operations, and the GPU memory hierarchy and interconnect characteristics that govern them
- Expert level proficiency in Kubernetes platform architectures, including operators, custom resources, controllers, and scheduling
- Strong programming proficiency in Go and Python, with the ability to read, debug, and profile C++/CUDA using tools such as Nsight
- Experience with debugging/profiling multi-tier application workloads such as RAG, Agents, etc


Source: 1752vc Careers, https://www.1752.vc/careers/jobs/hewlett-packard-enterprise-principal-software-engineer-inference/