npub15u…x05rq on Nostr: 36 GB, but has 32 core GPU. Anything bigger goes closer to $5k. I got it around ...
36 GB, but has 32 core GPU. Anything bigger goes closer to $5k. I got it around $2,300. Tradeoffs. Can run 20B parameter models. It’s an intro to local ai until I can afford a bigger machine.