Andrej Karpathy (@karpathy) “The non-obvious crux of the shift is an empirical finding, emergent only at scal” — TopicDigg
Andrej Karpathy
@karpathy
I like training large deep neural nets.
加入 April 2009
1.1K 正在关注 3M 粉丝
The non-obvious crux of the shift is an empirical finding, emergent only at scale, and well-articulated in the GPT-3 paper ( Basically, Transformers demonstrate the ability of "in-context" learning. At run-time, in the activations. No weight updates.
显示更多
