PPQdotAI on Nostr: It will not fallback to a different model, it will however fallback to a different ...

It will not fallback to a different model, it will however fallback to a different provider under certain circumstances like timeouts or hanging. I was tinkering with our open weight model routing the last two days so it's possible that it is something I touched but also possible that it is just a provider issue which we cannot do anything about. I'd say 50/50.

The more detail you can give on what you see the better. I can plug it into our AI and it can look up the metadata logs for your particular queries. Just DM me your credit id.