u/akshunj

Venice on Hermes as 1st class citizen

Not sure how many here are using the Venice API on Hermes, but I promise it's a sublime experience. The only niggle is that it's a "custom" OpenAI-compatible provider. So, models don't report their capabilities properly and you need to add some custom settings. It doesn't see all the models available, nor the context size parameters and stuff like that. There's an "official" open PR to elevate Venice to 1st class status, but I don't see that Venice devs are pushing for it. Any insight from the mods here on this?

reddit.com
u/akshunj — 2 days ago