Ant Ling (@AntLingAGI) “We recently released a paper showing that UFP4, our uniform-grid FP4 training re” — TopicDigg
Ant Ling
@AntLingAGI
加入 April 2025
0 正在关注 0 粉丝
We recently released a paper showing that UFP4, our uniform-grid FP4 training recipe, stays closer to BF16 than strong E2M1 baselines across Dense 1.5B, MoE 7.9B, and MoE 124B long-run pretraining.
The key insight: FP4 training quality is not only about bit width, but also grid geometry.
显示更多
