matt on Nostr: I’ve got local GPUs with almost as much memory as a Spark (but way more BW). I was ...

I’ve got local GPUs with almost as much memory as a Spark (but way more BW). I was mostly tongue-in-cheek referring to the annoying reduction in 120B-class models lately and the increasing reality that not many can afford to access frontier models lately.