# AI Infrastructure Systems Engineer at Together AI

- Company: Together AI
- What the company does: Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research. Backed by General Catalyst, Kleiner Perkins and NEA.
- Company website: https://www.together.ai/
- Type: Startups (AI role)
- Level: Mid level
- Location: San Francisco
- Work setup: On-site
- Pay: $190K to $270K base salary per year (USD)
- Posted: 2026-05-14
- Apply by: 2026-10-08
- Apply: https://job-boards.greenhouse.io/togetherai/jobs/5138540007
- Page: https://www.1752.vc/careers/jobs/together-ai-ai-infrastructure-systems-engineer/

## About the role

At Together AI, you’ll build and operate one of the world’s largest GPU fleets used for frontier model training and inference. This isn’t a traditional infrastructure role—we’re looking for engineers who love building systems, automating everything, and solving problems at massive scale. If you enjoy writing software more than clicking dashboards, obsess over eliminating manual work, and want to build infrastructure that manages tens of thousands of GPUs autonomously, we’d love to talk.

## What they're looking for

- 3+ years building distributed systems, infrastructure platforms, or large-scale backend software
- Strong software engineering skills in Python, Go, or Rust
- Experience building platforms, automation systems, or developer infrastructure
- Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies
- Strong systems thinking with the ability to understand problems across hardware and software
- A passion for solving complex infrastructure challenges through software

Tags: Engineering