Startups · AI

Software Engineer, Tokens and Prompt Structures

Anthropic · San Francisco, CA | New York City, NY · On-site

← All jobs
About Anthropic

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems. Backed by Accel, Bessemer and General Catalyst.

About the role

The Encodings Infra team maintains the libraries that engineers and researchers across Anthropic use to encode text and multimodal data into a form that Claude can consume. It also determines Claude’s prompt shape: how a user’s turn is represented to the model, how Claude calls tools and receives tool results, and so on.

What they're looking for

  • Tokenizers or other text/data encoding systems
  • Maintaining a widely-used library over a long period of time
  • Performance optimization
  • Python and/or Rust
  • Reinforcement learning or model training infrastructure
More about this role

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

The Encodings Infra team maintains the libraries that engineers and researchers across Anthropic use to encode text and multimodal data into a form that Claude can consume. It also determines Claude’s prompt shape: how a user’s turn is represented to the model, how Claude calls tools and receives tool results, and so on.

As a Software Engineer on this team, you'll own the design and maintenance of these libraries—keeping their APIs intuitive, their performance sharp, and their abstractions solid enough that most of the org never has to think about encodings or prompt structures at all. You’ll have the satisfaction of knowing that your work enabled Claude to learn new ways of understanding the world.

This role is unusually broad: your work will touch systems across the codebase, from pretraining to finetuning to the API, and you'll collaborate closely with both...

Read the full posting on Anthropic's site ↗

AI Research & Engineering

Build your edge while you search

Free tools for founders and investors, plus VC Unfiltered, our take on startups, venture and the people who build them.