# Software Engineer - ML Infrastructure at Specter

- Company: Specter
- What the company does: Search 55M companies, 550M people and every funding or M&A event in real time—surface hidden startups, size markets and act first. Backed by Entrepreneur First.
- Company website: https://tryspecter.com
- Type: Startups (AI role)
- Level: Mid level
- Location: San Francisco
- Work setup: On-site
- Posted: 2025-10-03
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/specter/3400c31a-12a8-4e82-9f14-502ac3a35ca6
- Page: https://www.1752.vc/careers/jobs/specter-software-engineer-ml-infrastructure/

## About the role

Designing and implementing scalable ML training and inference pipelines for perception models (object detection, tracking, classification, segmentation) and VLMs. Developing continuous training and evaluation systems to improve model performance from production data feedback loops.

## What they're looking for

- Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths
- Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling
- Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load
- Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration
- Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics
- Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads

Tags: Engineering