🎶 WHERE'S YOUR BITCHAT??? 🎶 View quoted note →

Qwen3-Code Q4_K_XL full context @ 6 tokens/s 1x Nvidia 3090 (2020, $800) 1x Nvidia P40 (2017, $300) 2x EPYC Milan, 8 of 256 threads in use (2021, 2x$800) DDR4 LRDIMM PC4-21300, 600 GB of 1TB in use ($1,250) GIGABYTE MZ72-HB2 ($1,000) `~/llama.cpp/build/bin/llama-cli --model /mnt/ollama/models/hf/Qwen3-Coder/UD-Q4_K_XL/Qwen3-Coder-480B-A35B-Instruct-UD-Q4_K_XL-00001-of-00006.gguf --threads 16 --ctx-size 262144 --n-gpu-layers 58 -ot "\.(6|7|8|9|[0-9][0-9]|[0-9][0-9][0-9])\.ffn_(gate|up|down)_exps.=CPU" --numa numactl -fa --cache-type-k q4_0 --cache-type-v q4_0`

"that disease is the disease of thinking that a really great idea is 90% of the work. and if you just tell all these other people "here's this great idea", then of course they can go off and make it happen. and the problem with that is, is that there's just a tremendous amount of craftsmanship in between a great idea and a great product. and as you evolve that great idea, it changes and grows. it never comes out like it starts, because you learn a lot more as you get into the subtleties of it. and you also find there's tremendous trade-offs that you have to make. [...] as you get into all these things, designing a product is keeping 5,000 things in your brain. these concepts, and fitting them all together and kind of continuing to push to fit them together in new and different ways to get what you want. and every day you discover something new that is a new problem or a new opportunity to fit these things together a little differently. and it's that process that is the magic" - Steve Jobs, The Lost Interview

"what's so interesting is that we were young and what we learned was that we could build something ourselves that could control billions of dollars worth of infrastructure in the world that was what we learned was that us two (we didn’t know much) we could build a little thing that could control a giant thing and that was an incredible lesson I don't think there ever would have been an Apple Computer had there not been blue boxing" – Steve Jobs

@jack books?