Maximize your social ROI with Sprout Social, trusted by 30k+ brands. Power everything from publishing and engagement to analytics and influencer marketing. Try 30 days free. Backed by NEA.
About the role
Own the development of agents and agentic features alongside our engineering teams. Scientists define what quality means for our agents, design and calibrate the evaluations and judges that measure it, decide which models to adopt and why, identify and implement improvements to core agentic capabilities, and hold the quality bar as we scale Sprout’s agentic platform. If you are energized by the question "how do we effectively use AI to solve hard problems for our customers”, then this is the role for you.
What they're looking for
- 5+ years of applied AI/ML experience, with a strong track record in the evaluation, measurement, and quality of AI/ML or LLM systems that shipped and drove measurable impact
- Demonstrated experience designing evaluation frameworks, building and calibrating judges or automated evaluators, and establishing their reliability, for ML or LLM/agentic systems
- Strong judgment in model selection and validation: assessing whether one model or approach is genuinely better than another, and why
- Rigorous experimentation and statistical skills: A/B testing, power analysis, and sound measurement design
- Foundational ML and modeling knowledge (Python, common ML frameworks, transformers and embeddings) sufficient to reason about and evaluate the systems you assess. SQL and comfort with large datasets
- Ability to work closely with product, design, and engineering, and to translate technical quality questions into terms stakeholders can act on
More about this role
Sprout Social is looking for a Senior Applied AI/ML Scientist to join its AI, Data, and Intelligence Business Unit and drive advancements to our suite of agentic and ML capabilities that are the foundation of Sprout Intelligence.
Sprout Social empowers businesses worldwide to harness the power of social media. Processing over one billion social messages daily, our platform serves essential insights to over 30,000 brands. We are weaving AI throughout our products, and this role sits at the center of making that AI trustworthy: as we ship agents across our product suite, the hardest and most valuable problem is knowing whether an agent is actually good, and making it better. That is the work of this role.
Own the development of agents and agentic features alongside our engineering teams.
Scientists define what quality means for our agents, design and calibrate the evaluations and judges that measure it, decide which models to adopt and why, identify and implement improvements to core agentic capabilities, and hold the quality bar as we scale Sprout’s agentic platform. If you are energized by the question "how do we effectively use AI to solve hard problems for our customers”, then...
Browse similar: AI jobs · AI startup jobs · Startup jobs · Remote jobs