utxo the webmaster 🧑‍💻 on Nostr: Depends on how my ddr5 he has too, many of the MoE models can offload experts. He ...

Depends on how my ddr5 he has too, many of the MoE models can offload experts. He should look at free token to do inference. But I think he probably needs to look at qwen3.5 class models, maybe 9b or 35b-a3b