# Evaluations Engineering - Member of Technical Staff at Simile

- Company: Simile
- What the company does: Backed by Index.
- Company website: http://simile.ai/
- Type: Startups (AI role)
- Level: Senior
- Location: San Francisco
- Work setup: On-site
- Pay: $200K to $400K base salary per year (USD)
- Posted: 2026-07-17
- Apply by: 2026-10-08
- Apply: https://jobs.ashbyhq.com/simile/beaa243c-233f-45f2-9e10-8d54e1eda9d1
- Page: https://www.1752.vc/careers/jobs/simile-evaluations-engineering-member-of-technical-staff/

## About the role

As a Member of Technical Staff in Evaluations Engineering, you will build the systems that enable Simile to evaluate whether our simulations of human behavior are accurate, trustworthy, and improving over time.

## What they're looking for

- Strong Engineering Fundamentals: Several years of experience building and maintaining production-quality software, with sound judgment in system design, testing, debugging, and maintainability
- Data and Systems Experience: Experience building backend services, data pipelines, automation workflows, and relational data models
- End-to-End Execution: Ability to work across data, backend, and interface layers and take ambiguous projects from technical design through deployment and adoption
- Evaluation Judgment: Strong intuition for what makes evaluation infrastructure reliable, including versioning, provenance, reproducibility, holdout integrity, noisy ground truth, and meaningful model comparisons
- ML and LLM Fluency: Familiarity with modern model-development and evaluation workflows sufficient to partner effectively with modeling and evaluation researchers
- Product and User Judgment: Ability to build clear, efficient tools for researchers, engineers, data operators, and other expert users

Tags: Engineering