EVERYONE BUYING A $2,000 MAC MINI M4 PRO FOR LOCAL AI MISSED THAT A SERVER RESELLER IS UNLOADING DEAD HP PROLIANT DL380 GEN 10 BOXES WITH 5 YEAR WARRANTY, A $250 USED TESLA P40 BOLTED IN RUNS LLAMA 3.3 70B AT HOME
00:19 he stands behind a pallet, "these 10 HP Proliant DL380 Gen 10 servers, they're a few generations older, you guys will be surprised who these servers are going to"
a DL380 Gen 10 with dual Xeon Gold 6248 and 256GB of DDR4 ECC sells refurbished for $380-500 in 2026, the same chassis cost $14,000 new in 2018 and got written off the books by every fortune 500 by 2024
drop a $250 used Tesla P40 with 24GB VRAM into one PCIe slot, total bill $650, llama 3.3 70B quantized to 4 bit runs at 9 tokens per second locally, the article calls $2,000 mac mini m4 pro the sweet spot, this stack hits it for a third
the seller in the video gives a 5 year warranty on hardware that hyperscalers threw away, the same companies the article warns will jack subscription prices are selling you the rack they used to charge $200 a month to access
a 2018 enterprise chassis pulls 280 watts at idle and screams at 65 decibels, the mac mini pulls 10 watts and runs silent, the tradeoff is real but $1,350 cheaper buys a lot of electricity and earplugs over 4 years
bookmark this and read the article below
显示更多