# Staff Software Engineer, RL Environments at Scale

- Company: Scale
- What the company does: Backed by Accel, Index and Y Combinator.
- Company website: http://www.scale.com
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco, CA; New York, NY
- Work setup: On-site
- Posted: 2026-09-02
- Apply by: 2026-10-17
- Apply: https://job-boards.greenhouse.io/scaleai/jobs/4729820005
- Page: https://www.1752.vc/careers/jobs/scale-staff-software-engineer-rl-environments/

## About the role

As a Staff Software Engineer, RL Environments, you'll own the technical foundation for how Scale builds, runs, verifies, and delivers RL environments at scale.

## What they're looking for

- 8+ years of software engineering experience with strong fundamentals in distributed systems, system design, data structures, and algorithms
- Strong Python skills and a track record of shipping production software, comfort in at least one other part of the stack (TypeScript/React, Go, Rust, or similar)
- Deep experience with containerization and sandboxed execution, including Docker, VMs, gVisor/Firecracker, Kubernetes, or equivalent
- Experience building or operating high-throughput backend systems: orchestration, job scheduling, queuing, and large-scale data pipelines
- Hands-on experience building with LLMs including agent loops, tool calling, MCP, or eval harnesses, and enough intuition about model behavior to reason about what a training signal actually teaches
- Demonstrated ability to own ambiguous, undefined problems end to end and drive them to a shipped system

Tags: Gen AI Engineering