Yeah I got so angry at IQ3_S huge degradation. I got 27b chooching now at FP8 things looking up in that pocket. Generally around 70t/s
Login to reply
Replies (1)
ista mentioned that the models are noticeably worse at lower reasoning effort levels, because they neglected those during quantization. I don’t know if that is still true for IQ3_S. In my experience on highest reasoning effort it’s smarter than 8bit qwen3.8 27b quants.