What LLM are you using?
Preferably something open source and which doesn't track and store your prompts.
Looking to end my ChatGPT journey and go a more sovereign AI route, but can't seem to find a good replacement.
#AskNostr
Login to reply
Replies (11)
VeniceAI
Aa yes VeniceAI I remeber trying it out last year when it was still in the early beta stage, but I totally forgot about it. Thanks for reminding me, will definitely give it ago again. 🙏🏼
Various models using Ollama.
Deepseek-R1-0528 via Ollama is my default when I need a local-first model. It's pretty good IMO. For coding, I usually stick with Claude Sonnet 4
Interesting, didn't hear of Ollama yet, will look into this tomorrow and try it out. Thanks for the recommendation Gigi! I appreciate it 🙏🏼
Thanks! Seems like Ollama is the way to go.
duck.ai
Thanks for your suggestion will check it out!
Have you tried PocketpalAI on the Zapstore? I believe you can download Ollama plus others and run offline if required. Mine has been a bit buggy on setup but im also not very technically gifted so you may have a better experiance.
I saw Pocketpal AI in Zapstore but didn't give it a try yet. Will check it out 👍🏼
It's okay. There's definitely better. I'd like to explore some more as well.