Alvaro Cintas (@dr_cintas) “You can now run a 2.78 trillion parameter model on a CPU with 8.24 GB of RAM 🤯” — TopicDigg
Alvaro Cintas
@dr_cintas
加入 July 2019
0 正在关注 0 粉丝
You can now run a 2.78 trillion parameter model on a CPU with 8.24 GB of RAM 🤯
kimi-k3-in-c is a 176KB pure C99 engine that streams Kimi K3’s experts from disk instead of loading them into memory.
no GPU. no CUDA. no framework.
100% Open Source.
显示更多
