原文整理页

介绍构建大模型评估(Evals)的“金发姑娘原则”,强调评估应覆盖具体任务环节而非仅看最终结果

来源作者:Madhu Guru (@realmadhuguru)原始来源:https://x.com/realmadhuguru/status/2091684812012875981

中文导读

介绍构建大模型评估(Evals)的“金发姑娘原则”,强调评估应覆盖具体任务环节而非仅看最终结果。

正文 Markdown

How to build great evals - part 7. The Goldilocks principle for eval construction. Your evals should measure at the level of the various jobs to be done, not just the final answer. E.g. consider a financial analysis agent. It's ultimate output is a stock recommendation. The