Explore Microsoft products and services and support for your home or business. Shop Microsoft 365, Copilot, Teams, Xbox, Windows, Azure, Surface and more. Backed by Menlo.
About the role
Collaborates with immediate team members on defining metrics and frameworks for evaluating somewhat complex AI/large language model (LLM) systems and agentic product performance. Experiments with model before selection (e.g., LLM, prompting approach) for tasks within a product or solution Diagnose basic issues and identifies opportunities to drive improvements within AI/LLM systems within domain area.
More about this role
Collaborates with immediate team members on defining metrics and frameworks for evaluating somewhat complex AI/large language model (LLM) systems and agentic product performance. Experiments with model before selection (e.g., LLM, prompting approach) for tasks within a product or solution Diagnose basic issues and identifies opportunities to drive improvements within AI/LLM systems within domain area. Prototypes and develops AI models using containerized environments (e.g., AI Azure Foundry, LangChain) to operationalize, build, and validate scalable tools/applications/solutions for use by the immediate team. Develops and deploys systems for basic retrieval-augmented generation workflows, assisting in the selection of data sources, retrieval systems, and generative models to ensure quality output. Assists senior members in assessing and refining LLM systems and models. Bachelor's Degree in Data Science, Mathematics, Statistics, Econometrics, Economics, Operations Research, Computer Science, or related field AND 2+ years data-science experience (e.g., managing structured and unstructured data, applying statistical techniques and reporting results) OR Master's Degree in Data Science,...
Browse similar: Startup jobs