Replies (13)

jb55 _@jb55.com 6 months ago

wat is kimi k2

1 replies ↓

SuiGenerisJohn johnlaw@getalby.com 6 months ago

How’s Diablo 2 look on’em?

Tekkadan, ゲロゲロ! 🐸 6 months ago

What are you poor?

ynniv ynniv@ynniv.com 6 months ago

Is there an ollama file yet? Waiting to see CPU perf on 1TB RAM

2 replies ↓

Alex Gleason alex@gleasonator.dev 6 months ago

It's available here:

moonshotai/Kimi-K2-Instruct at main

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

1 replies ↓

ImaginaryEvent 6 months ago

Or 20 dgx spark at 4k each, so "only" 80k

beans beansonlinux@nostriches.club 6 months ago

A new open source llm from moonshotai. It requires about 1TB of vram.

1 replies ↓

jb55 _@jb55.com 6 months ago

is it really open source at that point 😅

1 replies ↓

beans beansonlinux@nostriches.club 6 months ago

Well it’s open weights but totally agree. Still better than “OpenAI”.

someone 6 months ago

unsloth has GGUFs and llama.cpp fork that could run it in smaller GPUs

unsloth/Kimi-K2-Instruct-GGUF · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

GitHub

GitHub - unslothai/llama.cpp: LLM inference in C/C++

LLM inference in C/C++. Contribute to unslothai/llama.cpp development by creating an account on GitHub.

ynniv ynniv@ynniv.com 6 months ago

Grabbed that day-of, but there wasn't an ollama model file for it yet

1 replies ↓

Owner_of_donky 6 months ago

Or you can run it on a bunch of 128gb framework desktops for 3k a pop to get a total price of ~50k. It'd be much slower but still pretty usable

ynniv ynniv@ynniv.com 6 months ago

There are some necessary code changes that are in-flight:

GitHub

kimi k2 support · Issue #11382 · ollama/ollama

https://huggingface.co/moonshotai/Kimi-K2-Instruct Best opensource model available yet