Thank you for your testimony Calle, I would like not to miss the AI tick but I don’t know where to start. Any advice? I want to learn how to run a local LLM to start for example.
Login to reply
Replies (4)
In my experience local LLMs don't cut it. Just not good enoughbin most cases. So you need to be ready to use commercial ones and by doing so, train them and accelerate their onset.
Depends on what you want to do with them. You can run local llms using ollama
If you're just curios and don't have time for the tech stuff, let me know and I'll give you an account on my system. OpenWebUI, publicly available, 3-4 models installed, up to 32B. Not great but it's all you get out of midrange consumer graphics cards.