A used RTX 3090 Ti under a desk in a spare bedroom saves its owner $23,000 a year.
He bought it for $680 on Facebook Marketplace. The seller was a gamer upgrading to a 5090. The box still smelled like cigarettes.
Before the card, his AI bill ran $1,970 a month.
Transcription for client videos. Image generation for thumbnails. Embeddings for a search tool. A chatbot answering the same 40 questions. All of it API calls. All of it metered. Every request a few cents, times 60,000 a month.
He did the math on a napkin at 1 AM.
24GB of VRAM covers all of it. Whisper for transcription. An open image model for thumbnails. A 32B model for the chatbot good enough, because the questions never change.
Setup took 2 weekends. Electricity costs him $31 a month. The card idles at 9 watts between jobs.
New bill: $118 a month only the hard 6% of tasks still go to the frontier models.
$1,970 down to $149.
That's $21,852 a year back, plus the card paid for itself in 11 days.
The gamer who sold it wanted more frames in Cyberpunk.
The buyer wanted his margin back.
Same card. One of them plays on it. The other one retired his biggest expense.
显示更多