# Member of Technical Staff (QA Engineer - Agentic Systems) at Solstice

- Company: Solstice
- What the company does: Connect to a local community shared solar farm that reduces your energy bill every month. Backed by Techstars.
- Company website: https://solstice.us
- Type: Startups
- Level: Senior
- Location: New York City
- Work setup: On-site
- Pay: $160K to $300K base salary per year (USD)
- Posted: 2026-06-26
- Apply by: 2026-10-12
- Apply: https://jobs.ashbyhq.com/solstice/1df5ae31-8e4f-4e22-810e-29b88771b718
- Page: https://www.1752.vc/careers/jobs/solstice-member-of-technical-staff-qa-engineer-agentic-systems/

## About the role

We're hiring our first dedicated QA lead to own quality for the AI that powers Solstice. Our platform generates regulated pharmaceutical marketing content for the brands we work with, so when the output is wrong, say an unsupported claim or a missing safety disclosure, it becomes a real compliance problem and not just a bug to file.

## What they're looking for

- This is an engineering role first. You should be comfortable building testing and evaluation tools in code, and equally comfortable rolling up your sleeves for hands-on manual testing when that's what the situation needs
- Strong Python, and real experience building test infrastructure and getting it to run automatically in CI/CD
- Strong end-to-end and UI test automation, especially with Playwright
- A genuine manual and exploratory QA discipline. You can test a feature by hand, find the edge cases, and own release sign-off
- Experience testing non-deterministic, ML, or LLM-based systems, or the appetite to build that capability from scratch
- Comfort with evaluation methods: golden datasets, LLM-as-judge (rubric, pairwise, reference-based), and calibrating those judges against human or expert labels

Tags: Engineering