Tech transformation, societal shifts, and environmental disruption put enormous pressure on critical industries like energy, infrastructure, real estate, and others to adapt, pursue new growth opportunities, and optimize operations. Backed by Powerhouse Ventures.
About the role
Own the LLM gateway: routing, metering, budgets, guardrail composition, and provider/backend adapters across hosted and self-hosted models. Manage the retrieval and knowledge service: connectors, chunking, hybrid search and reranking, grounded answers, and the MCP surface.
What they're looking for
- 5+ years of deep, production async Python — cancellation scopes, streaming lifecycle, and connection pooling
- Postgres as infrastructure — comfortable reasoning about MVCC, advisory locks, and vacuum discipline, with Redis/Dragonfly used (and not used) where it belongs, real distributed-systems experience, not just familiarity
- Experience shipping API surfaces other engineers build on — versioning, idempotency, error vocabularies, migration discipline, and documentation to match
- Depth in at least one of LLM gateway concern (routing, metering, guardrails, provider failover) or retrieval engineering (hybrid search, reranking, eval methodology, audit-ready RAG), with credibility on the other
- A cost accounting and evals first mindset — you've shipped a gate or harness that caught a real regression, ideally one of your own
- Production depth in some modern stack, and the aptitude to ramp quickly on unfamiliar tools
More about this role
About AZX
Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability challenges.
We’re growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen Energy), logistics (Flexe) and utilities.
We’re a public benefit corporation, founded in 2024, and have been profitable from inception.
We work on challenges in clean energy, decarbonization, climate risk, energy systems, and global economics. We’re building our company for long-term success and aim to create the ultimate place to work for those passionate about AI and making a positive impact.
About the Role
As a Backend Engineer you will build the services our products and client solutions run on. The center of gravity is LLM infrastructure: the layer that puts one governed front door over many models, hosted and self-hosted, and answers the questions enterprises actually ask — who used which model, for what, at what cost, under whose rules. The platform's first customers are our own client-facing engineers, the people delivering client outcomes with...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs