Wild rumor coming out of China this morning on DeepSeek V5:
DeepSeek is reportedly already pretraining V5 as a ~2 Trillion parameter ultra-sparse MoE model.
And instead of training on NVIDIA GPUs, they are reportedly running the V5 pretraining run on Huawei's new Ascend 950 / 950DT chips with a team of Huawei kernel engineers physically working inside DeepSeek's offices to keep the cluster humming.
If DeepSeek pulls off a 2-trillion-parameter frontier run natively on Ascend 950 silicon, that changes the entire AI hardware story.
显示更多