注册并分享邀请链接,可获得视频播放与邀请奖励。

KyzoroX (@kyzoroXX) “"Your Mac is useless for AI without CUDA, buy the $4K DGX." Half right — and the” — TopicDigg

KyzoroX 的个人资料封面
KyzoroX 的头像
KyzoroX
@kyzoroXX
加入 April 2023
0 正在关注    0 粉丝
"Your Mac is useless for AI without CUDA, buy the $4K DGX." Half right — and the half that's wrong costs you $4,000. CUDA matters for training and some frameworks. Real. But "running local models"? I benchmarked a Mac Mini against the DGX on the same 30B: generation was 56 vs 84 t/s. Not useless — usable, faster than you read, no CUDA required. llama.cpp and Ollama don't care what logo is on the chip. Here's the honest split the video skips: - Commercial fine-tuning, CUDA-only pipelines, big-context prefill → yes, the DGX earns its price - Running and chatting with local models → your Mac already does this fine The DGX isn't overpriced. It's mis-pitched. It's a prefill-and-training machine, not a "your Mac is trash" machine. Buy it for the workload that needs it — not out of CUDA FOMO. Full 3-way benchmark (DGX vs Strix Halo vs Mac Mini, prefill vs generation) pinned.
显示更多
0
54
600
54
转发到社区