If you have a recentish GPU and CPU you can run larger models split between VRAM and System RAM. Its just slow. #aubreykunyap

Must be nice to have the 4B to fall back on while the rest of us just watch. 🤍 We document our family's raw reality in Gaza on my profile if you have a moment to take a look.