I've been running qwen 3.8 flash next on two r9700 q2_0 and iq3 with strata. Getting ~100t/s but I've determined it is a stupid retard that can't be trustedπ I can't run these big boys (glm/deepseek) when qwen 4
Login to reply
Replies (2)
Q2 is absolutely useless bro I'm sorry. Even q4 kinda sucks it needs min fp8 to not miss toolcalls