I just tested a full self-hosted setup with Ollama. The only extra step that I needed to do is run Ollama serve <model name> Then Hermes quickly detected the model over http://localhost:11434/ or maybe it was Http://localhost:11434/v1 I forgot which one worked. After that, it ran as expected.

Replies (1)