# Senior Software Engineer, Observability at Together AI

- Company: Together AI
- What the company does: Build what's next on the AI Native Cloud. Full-stack AI platform for inference, fine-tuning, and GPU clusters — powered by cutting-edge research. Backed by General Catalyst, Kleiner Perkins and NEA.
- Company website: https://www.together.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco
- Work setup: On-site
- Pay: $200K to $280K base salary per year (USD)
- Posted: 2025-11-08
- Apply by: 2026-10-08
- Apply: https://job-boards.greenhouse.io/togetherai/jobs/4971774007
- Page: https://www.1752.vc/careers/jobs/together-ai-senior-software-engineer-observability/

## About the role

Together AI is building the AI Acceleration Cloud, an end-to-end platform for the full generative AI lifecycle, combining the fastest LLM inference engine with state-of-the-art AI cloud infrastructure.

## What they're looking for

- Expertise in observability platforms (Prometheus, Grafana, ClickStack, OpenTelemetry) and cloud-native monitoring services (AWS, GCP, Azure)
- Strong programming skills in Go, Python, or similar languages, with proficiency in infrastructure-as-code tools (Terraform, Ansible, Helm)
- Experience designing, operating, and scaling large-scale distributed systems and pipelines for high-volume data ingestion and real-time querying
- Deep understanding of containerization (Docker) and orchestration (Kubernetes)
- Knowledge of microservices architecture, service mesh technologies, CI/CD pipelines, and GitOps workflows
- Expertise in managing databases (PostgreSQL, MongoDB, Redis) and time-series databases with high-cardinality data

Tags: Engineering