注册并分享邀请链接,可获得视频播放与邀请奖励。

regent0x 的个人资料封面
regent0x 的头像

regent0x (@regent0x_)

@regent0x_
sharing alpha what works, what breaks, and what prints
176 正在关注    2.4K 粉丝
his “AI server” is 4 mac minis stacked next to the toaster linked by free software into one machine that runs 235B models no single computer could load regulated clients pay him $3,500/month each to use it he has 6 of them that’s $21k/month from a tower of silver boxes in his kitchen the stack runs exo - open-source, $0, turns four separate minis into one pool of memory. the monitor shows all four nodes firing together, one model spread across the whole cluster the thing nobody tells you about local AI: a model either fits in your machine’s memory or it doesn’t run. that’s the wall everyone hits. it’s why people assume serious AI means a $40k server exo walks straight through that wall. it splits one massive model across every box in the chain. four minis at $599 each suddenly run what a single high-end machine can’t touch and the people who need this aren’t chasing the newest model they’re the ones the cloud locked out: → a law firm with privileged case files → a medical practice under HIPAA → an accounting firm holding client financials they need AI nowhere near a third-party server. a stack they can point to during an audit ends every objection their models run on his cluster. the data never leaves equipment he controls the breakdown: → 4 mac minis: $2,400 total → exo software: $0 → electricity: ~$25/month → what he charges per client: $3,500/month → 6 active clients the kitchen stack paid for itself in the first 3 weeks month 1: 2 clients, $7k month 3: 4 clients, $14k month 6: 6 clients, $21k he’s not running a startup with an office and a logo he’s running four silver boxes between the coffee machine and a bowl of fruit, clearing $21k/month from hardware that cost $2,400 clients picture racks and cooling fans reality is four minis humming next to where he makes breakfast the cloud companies charge a fortune for compute and access to your own he charges $3,500 a month for the one thing they can’t sell - a machine that never phones home
显示更多
0
38
602
47
转发到社区