Publius Pseudis's avatar
Publius Pseudis 7 months ago
if you haven't worked out local LLMs yet, you probably should soon. Its not hard. image

Replies (3)

Publius Pseudis's avatar
Publius Pseudis 7 months ago
that model (gemma3:270m) should run on pretty much any cpu and ram config at a usable speed. its not a super smart model. Explore to see other models. My daily driver is qwen3:4b - it fits in 12gb of vram and is good enough for most tasks.