Rationing is starting. The signs are not good.

More #pigstr content would be most welcome. View quoted note →

If you don't run at least one LLM in verbose mode to see what's cooking under the hood, you're retarded, and not in a good way. #terribleopinions #llm #ai #llms #randomthoughts

I just paid $10/GB for a GPU with 16GB of VRAM. The next step after that is doubling up, for a surprisingly cheap solution. No idea if it is going to work yet, but we'll see. I haven't mucked about with hardware like this in near 30 years. It's kinda fun. #gpu #ai #llm #selfhosting #ollama #DIY