Jun Song (@jun_song) “Chinese AI models have one massive advantage: Their training data is mostly in C” — TopicDigg
Jun Song
@jun_song
加入 September 2024
0 正在关注 0 粉丝
Chinese AI models have one massive advantage:
Their training data is mostly in Chinese, and a single Chinese character packs significantly more meaning than an English letter.
This means they can compress a lot more data per token.
It gives them up to a 4x token compression efficiency—an inherent advantage that English-based US models simply cannot replicate.
This is exactly why GLM, a mere 750B model, can compete with 2T-level frontier models.
显示更多
