# Inference Infrastructure Engineer at Rhoda

- Company: Rhoda
- What the company does: Redefining Robotic Intelligence. Backed by Khosla.
- Company website: https://www.rhoda.ai/
- Type: Startups (AI role)
- Level: Mid level
- Location: Mountain View
- Work setup: On-site
- Pay: $175K to $280K base salary per year (USD)
- Posted: 2026-05-12
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/rhoda-ai/5e09f46e-2c0f-4fab-aa1c-9d05e0096463
- Page: https://www.1752.vc/careers/jobs/rhoda-inference-infrastructure-engineer/

## About the role

Design and operate large-scale infrastructure to run model workloads across cloud and on-prem environments Build and maintain Kubernetes-based deployment pipelines for managing distributed ML workloads

## What they're looking for

- 3+ years of experience in ML infrastructure, MLOps, or distributed systems
- Strong proficiency with Kubernetes and containerized deployment pipelines
- Experience with GPU orchestration and resource scheduling across large distributed jobs
- Experience with cloud providers (e.g., AWS, GCP) and hybrid cloud/on-prem infrastructure
- Familiarity with ML frameworks (e.g., PyTorch, JAX) and model serving tools (e.g., Triton, Ray Serve, TorchServe)
- Strong debugging instincts and ownership mentality — comfortable driving issues to resolution across the stack

Tags: Software