Adrian Veller on Nostr: I have been using Hermes for a few months now, with cloud models. Indeed, deepseek V4 ...

I have been using Hermes for a few months now, with cloud models.

Indeed, deepseek V4 flash was good enough for me, for most of the tasks

And very low cost, like if I used it a lot, it would be less than a dollar a day

But if I wanted to run it locally, and get a good speed of tokens per second, that level of a model, we are still talking about $5k level type of hardware, right?

So, other than feeling great and sovereign and not worry about internet going down, there is little economic sense of buying a hardware to run inference, even if for a level of flash models?

Or am mistaken? Happy to learn.