注册并分享邀请链接,可获得视频播放与邀请奖励。

Sethian (@theSethian) “NVIDIA's $4,600 personal AI supercomputer loses the speed round to four used RTX” — TopicDigg

Sethian 的个人资料封面
Sethian 的头像
Sethian
@theSethian
加入 March 2011
0 正在关注    0 粉丝
NVIDIA's $4,600 personal AI supercomputer loses the speed round to four used RTX 3090s. Tech2WiLD owns both setups and has been running them for nearly two months. At 00:31, he compares the cost. One DGX Spark sells for roughly $4,000 to $4,600. He paid about $3,500 for three used RTX 3090s and already owned the fourth, plus a compatible motherboard. Two of those 3090s run Qwen 3.6 35B-A3B at up to 150 tokens per second on one stream. The full rig has 96GB of VRAM. One Spark has 128GB of unified memory. The 3090 rig is faster for local models that fit. Spark's extra 32GB leaves more room for context, parallel agents, or another model, but one Spark still runs roughly the same class of models. At 04:52, the 3090 build hits its limit. His consumer motherboard is already full at four GPUs. Moving to a Threadripper-class platform can cost another $4,000 to $5,000 before buying the next GPU. A second Spark adds another 128GB and opens larger models such as DeepSeek V4 Flash and MiniMax M3 without rebuilding the whole machine. His verdict at 10:28 the 3090 rig for speed right now, the Spark if the setup is going to keep growing. The article below takes the other side. It compares Spark's 273 GB/s memory bandwidth with 936 GB/s on one RTX 3090, then ranks 19 GPUs by bandwidth. For one box, the 3090s win. Spark starts making sense when the next box is already part of the plan.
显示更多