原文整理页

开发者 Josh 对 Prime Agent 进行了深度测评,认为其工程思路有趣但实际效果有限,核心瓶颈在于底层模型的能力

来源作者:Josh (@jjpcodes)原始来源:https://x.com/steipete/status/2086498128975528121

中文导读

开发者 Josh 对 Prime Agent 进行了深度测评,认为其工程思路有趣但实际效果有限,核心瓶颈在于底层模型的能力。

正文 Markdown

ok after a day using prime agent i'm not really convinced. they added some new stuff to pi, sure, its nice. the IPython notebook as session state sounds smart... until you realise that the models (yes even the good ones) can't write Python (they get stuck in infinite while loops a bunch). the memories feature seems clever but doesn't really work because all the memories are slop and wrong. (examples below). i have like 20 of these already and none of them make any sense or are at all useful for agents sub-agents as code is nice because it actually works well out of the box (vibing up a good SIMPLE sub-agent extension in pi is hard) native codex compaction isn't included so you have to vibe that in. /btw built-in is nice sol still loves over-engineering no matter what you do. my overall verdict: interesting idea when it comes to harness engineering. might help for some benchmarks, but in real world use, it doesn't help much over official harnesses. its not a *bad* harness by any means, i'd call it an opinionated pi install. most important limiting factor is the models....... which (as i have tweeted about extensively) are still RLfried and stupid (especially the "good" ones). unfortunately it seems like a harness can't fix that.