原文整理页

提升模型评估(evals)能力的关键在于将熟悉的业务流程量化,并通过研究用户 Prompt 序列来定义各阶段的理想输出

来源作者:Madhu Guru (@realmadhuguru)原始来源:https://x.com/realmadhuguru/status/2089480958571331623

中文导读

提升模型评估(evals)能力的关键在于将熟悉的业务流程量化,并通过研究用户 Prompt 序列来定义各阶段的理想输出。

正文 Markdown

The best way to get good at evals is to take a workflow you know really well and figure out how to make its quality measurable. Study the actual traces - the sequence of prompts typical users have, what good responses would look like at each step and for the end to end outcome.