原文整理页

Y Combinator 探讨了递归 AI 模型(HRM 和 TRM),这类模型仅凭 700 万参数就在 ARC Prize 等推理任务上超越了千倍规模的大模型

来源作者:Garry Tan (@garrytan)原始来源:https://x.com/garrytan/status/2050227875576733753

中文导读

Y Combinator 探讨了递归 AI 模型(HRM 和 TRM),这类模型仅凭 700 万参数就在 ARC Prize 等推理任务上超越了千倍规模的大模型。

正文 Markdown

A 7-million parameter model outperforming models a thousand times its size on tasks like ARC Prize. That's what recursive reasoning unlocks. In this episode of Decoded, YC's @agupta and @FrancoisChauba1 break down two recent papers on recursive AI models, HRMs and TRMs, that are achieving state-of-the-art results with a fraction of the parameters of today's largest models. They explain why standard LLMs hit a fundamental ceiling on certain reasoning tasks, how recursion at inference time gives small models the compute depth to break through it, and what happens when you combine these ideas with the power of large-scale foundation models. 00:35 - Model Foundations 01:15 - RNN Limits and LLM Contrast 02:36 - Reasoning Limits and Sorting Analogy 04:22 - HRM Paper Introduction 05:25 - HRM Architecture and Intuition 07:36 - HRM Results and Outer Loop 09:46 - TRM Paper Overview 11:20 - TRM Training and Fixed Point 13:30 - Detailed HRM Summary 20:46 - Comparing HRM and TRM 34:45 - Future Outlook