I think that's my issue is I'm running everything self-hosted. Finding and tweaking the right model has made a huge difference to getting mostly useful output from my own hardware.

Replies (1)

I just tested a full self-hosted setup with Ollama. The only extra step that I needed to do is run Ollama serve <model name> Then Hermes quickly detected the model over http://localhost:11434/ or maybe it was Http://localhost:11434/v1 I forgot which one worked. After that, it ran as expected.