# Senior Software Engineer — Infra Agent Systems at Together AI

- Company: Together AI
- What the company does: Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research. Backed by General Catalyst, Kleiner Perkins and NEA.
- Company website: https://www.together.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco
- Work setup: On-site
- Pay: $250K to $300K base salary per year (USD)
- Posted: 2026-09-10
- Apply by: 2026-10-25
- Apply: https://job-boards.greenhouse.io/togetherai/jobs/5233669007
- Page: https://www.1752.vc/careers/jobs/together-ai-senior-software-engineer-infra-agent-systems/

## About the role

Together AI runs one of the largest GPU fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that infrastructure. We develop production AI agents that diagnose hardware failures, investigate incidents, correlate signals across the fleet, and automate operational workflows. Alongside these agents, we build the platform they run on, including knowledge graphs, retrieval systems, orchestration frameworks, and developer tooling.

## What they're looking for

- 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
- Strong systems design skills and experience owning significant systems from design through production
- Depth in at least one of the following:
- AI agent systems, orchestration, tool use, evaluation, or grounding
- Knowledge graphs or graph data modeling
- Search, retrieval, ranking, RAG, or semantic search systems

Tags: Engineering