Startups · AI

Senior AI Engineer

Rohirrim · McLean, VA · On-site

← All jobs
About Rohirrim

The Opportunity At Rohirrim, we're building the AI that powers how the government buys - from billion-dollar weapons systems to the software that keeps agencies running. Backed by Bessemer and Insight.

About the role

Note: This is a Hybrid Role - 3 days per week in our office in McLean, VA

What they're looking for

  • 8+ years of software engineering experience, with at least 1 year focused on LLM applications, AI agents, or applied ML systems in production
  • Strong Python proficiency, experience building production-grade AI/ML pipelines
  • Hands-on experience with LLM orchestration frameworks (LangChain, LangGraph, AutoGen or equivalent)
  • Deep understanding of RAG architectures, vector databases (Pinecone, Weaviate, pgvector or similar), and embedding models
  • Experience integrating APIs from frontier model providers and tuning prompts for structured and reliable results
  • Strong software engineering fundamentals: clean architecture, testing, observability, and version control best practices
More about this role

Note: This is a Hybrid Role - 3 days per week in our office in McLean, VA

  • Architect and build multi-agent systems and autonomous workflows for document analysis, requirement extraction, RFP response generation, and procurement pipeline automation.
  • Design and implement agentic orchestration using frameworks such as LangGraph, AutoGen, CrewAI, or custom-built solutions tailored to Rohirrim’s platform requirements.
  • Develop tool-using, reasoning, and planning capabilities that enable agents to decompose complex acquisition problems into executable subtasks.
  • Build robust human-in-the-loop and approval gates for high-stakes decision points within automated workflows.
  • Design and optimize Retrieval-Augmented Generation (RAG) pipelines to ground agent outputs in authoritative procurement data, regulations (FAR/DFARS), past performance records, and institutional knowledge.
  • Implement advanced retrieval strategies including hybrid search, re-ranking, and context-aware chunking across large, heterogeneous document corpora.
  • Develop document parsing and structuring pipelines for RFPs, SOWs, PWS, solicitations, and other complex government acquisition artifacts.
  • Select and...

Read the full posting on Rohirrim's site ↗

Engineering

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.