God of Prompt (@godofprompt) “What's actually happening during the plateau? The model isn't stuck. It's reorga” — TopicDigg
God of Prompt
@godofprompt
Human + AI = Superpowers
🔑 Sharing AI Prompts, Systems, Tips & Tricks
加入 April 2023
1.2K 正在关注 262.3K 粉丝
What's actually happening during the plateau?
The model isn't stuck. It's reorganizing its internal representations.
During 10,000 "useless" epochs:
→ Circuits form and dissolve
→ Weight patterns crystallize
→ Spurious correlations get pruned
→ True structure emerges
It's like insight in humans. Slow, then sudden.
显示更多
