Login to reply
Replies (4)
that sounds interesting. thanks for the rabbit hole.
Just when you finished up the last rabbit hole, a new one appears ๐ ๐ณ๏ธ
A single NVIDIA GPU (tested on H100) - not everyone has that so will see if runs with local LLM on desktop GPU - using uv python
curl -LsSf https://astral.sh/uv/install.sh | sh
