注册并分享邀请链接,可获得视频播放与邀请奖励。

Sprytix (@Sprytixl) “THIS AMERICAN STUDENT BUILT A 4 MAC MINI RACK IN HIS ROOM AND RUNS KIMI K2.6 ON” — TopicDigg

Sprytix 的个人资料封面
Sprytix 的头像
Sprytix
@Sprytixl
AI WRITER
加入 May 2023
277 正在关注    4.2K 粉丝
THIS AMERICAN STUDENT BUILT A 4 MAC MINI RACK IN HIS ROOM AND RUNS KIMI K2.6 ON TOP - $0.50 PER MILLION TOKENS, 300 AGENTS, ZERO TUITION DEBT STRESS 4 Mac Minis mounted in a custom metal rack with a network switch at the bottom - not a dorm room setup, a production AI cluster that happens to be in a dorm room connected through EXO they work as one machine - enough unified memory to run 70B+ models locally while Kimi K2.6 handles the agent layer on top 300 parallel agents pulling research, writing reports, analyzing markets - what used to take a team of 10 two weeks now comes out in 2 hours at $0.50 per million tokens while his classmates are applying for internships at $20/hour he's running client research pipelines that bill at $3,000 per project the rack cost $2,400 in hardware - Kimi costs cents per run - electricity is $20/month - everything else is margin 4 boxes in a metal frame and a model that costs less than a textbook per month - and he's already making more than most people will after graduation
显示更多