原文整理页

DeepSeek-V4 训练因稳定性问题遭遇延迟,数据量从 V3 的 15T 翻倍至 33T 后,现有的稳定性技巧显得不足

来源作者:Peter Steinberger 🦞 (@steipete)原始来源:https://x.com/steipete/status/2047580105078173805

中文导读

DeepSeek-V4 训练因稳定性问题遭遇延迟,数据量从 V3 的 15T 翻倍至 33T 后,现有的稳定性技巧显得不足。

正文 Markdown

so that explains the delay... deepseek could not fix training instabilities, after doubling from ~15T tokens in v3 to ~33T tokens in v4 the 10+ mentions of "stability" tricks seem to be wildly lacking if these two were the main bandages (mismatched routing + clamping) but kudos for transparency, as always!