#Bitcoin #LN nodes just got much more interesting! View quoted note →

Can't wait to try it out!

Can I run it on windows?

Nice! Can't wait to try out.

Props to the maintainers for this!

Umbrel is designed for Linux. You could use a VM if you are on Windows.

It may just be taking a long while to download (since the app’s ~5.5GB). Also, can you confirm if you have at least 6GB of total RAM on your system?

Currently it uses the Nous Hermes Llama 2 (7B). If you’re technical, you can customize the Dockerfile to run a different Llama model:

GitHub

llama-gpt/api/Dockerfile at c76225a6fc26a000fc07b074223a69b0d65b7bcf · getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumb...

The performance depends on the hardware you use. If you have access to more powerful hardware, you can run 13B and 70B models by following the instructions here:

GitHub

GitHub - getumbrel/llama-gpt: A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumb...

You can run almost anything inside of a virtual machine like virtualbox. And there are many others. You could also duel boot Linux Mint and run it that way..🙂💎

going to start fresh and try again

@Umbrel ☂️ ufff, I have 2tb nvme ssd, 24gb of ram (18 used atm) and an i7 10510U and it's reaaaly slow (less than 1 word/s). Any tweaks to improve this?

Dangit! I have a 4GB Pi. Maybe I'll upgrade someday so I can run it myself.

Whoa! @Umbrel ☂️ stepping up their game with new addition of LLM AiChat bot. View quoted note →

Too much for bitcoin full node

Doesn't work for me on Umbrel Home.

I'll be spinning up this docker container later today to play with it. Thank you!

Umbrel ha sacado LlamaGPT, una IA que puedes descargar a tu ordenador y usar de manera privada y personal, tu información no sale de tu ordenador. Estas son las iniciativas que me hacen creer en un mejor futuro para la tecnología e internet ✨😎 View quoted note →

Great idea, I was eagerly waiting for it. I installed it overnight on my Pi 8 GB, but was very disappointed when I started it this morning. It was VERY slow and could not answer my first two questions (first was relating historic exchange rates and second regarding stoic philosophy). Llama via nostrnet.work from @iefan 🕊️ answered both questions quickly. Also, the other apps on my Pi became slower. So I deinstalled the app ... No offence to @Umbrel ☂️, you did a great job in offering this one click install app, but anyone has to be realistic ... You cannot run a fully functional and competitive LLama on a Raspi Pi ...

Ai chatbot powered by Llama 2 running on your device . View quoted note →

Had a flashback with that name: "Winamp: It really whips the llama's ass" 🦙