Alex Prompter (@alex_prompter) “What's actually happening during the plateau? The model isn't stuck. It's reorga” — TopicDigg
Alex Prompter
@alex_prompter
Human + AI = Superpowers
⚡ Sharing AI Prompts, Systems, Tips & Tricks
加入 April 2023
1.3K 正在关注 278K 粉丝
What's actually happening during the plateau?
The model isn't stuck. It's reorganizing its internal representations.
During 10,000 "useless" epochs:
→ Circuits form and dissolve
→ Weight patterns crystallize
→ Spurious correlations get pruned
→ True structure emerges
It's like insight in humans. Slow, then sudden.
显示更多
