注册并分享邀请链接,可获得视频播放与邀请奖励。

NO1ennn (@N01ennn) “he spent $1,999 once. saved $21,000 in a year. NVIDIA DGX Spark on his desk was” — TopicDigg

NO1ennn 的个人资料封面
NO1ennn 的头像
NO1ennn
@N01ennn
Everything is going as usual
加入 February 2024
561 正在关注    3.1K 粉丝
he spent $1,999 once. saved $21,000 in a year. NVIDIA DGX Spark on his desk was paying $180/month for cloud GPUs. every experiment had a price tag. every overnight run cost money. then he bought the machine 128GB unified memory. 1 petaflop at FP4. runs Qwen, Llama, Mistral locally. nothing leaves the machine. ever stack: Ollama. PyTorch. HuggingFace. vLLM. all compatible out of the box cloud cost per year: $2,160+. DGX Spark: $1,999 once. electricity after that: basically zero Jensen Huang hand-delivered the first units to Elon Musk at Starbase. fits next to a monitor. no rack. no server room. no cooling setup the math only works once. after that every inference run is free
显示更多
0
11
45
4
转发到社区