Block just open-sourced mesh-llm, a peer-to-peer system that lets anyone pool spare GPU compute to run large open-source AI models without relying on any cloud provider. If a model fits on your machine, it runs locally at full speed. If it doesn't, the system automatically splits it across multiple machines on the network. Dense models get split by layers. Mixture-of-experts models like DeepSeek and Qwen3 get split by experts. Zero configuration required. Discovery happens over Nostr. Nodes find each other through relays, score by region and VRAM, and self-organize. No central server coordinates anything. Weights are read from local files, never sent over the network. Dead nodes get replaced in 60 seconds. It exposes a standard OpenAI-compatible API on localhost, meaning any existing AI tool can plug in without modification. Block is building infrastructure for AI that doesn't route through OpenAI, Google, or Anthropic. Frontier-class open models running across a mesh of commodity hardware, discovered via Nostr, with no cloud dependency. That's the direction AI needs to go. image

Replies (32)

Analogue Dog's avatar
Analogue Dog 2 weeks ago
Why would I want to give free hash to someone who banned all the antivaxx doctors from twitter?
If I could lend out my GPUs easily im totally buying some RTX 6000 pros
fade2's avatar
fade2 2 weeks ago
How does this work? Do I earn tokens when I dedciate my GPU for processing?
fade2's avatar
fade2 2 weeks ago
This would be DOS'd fast. What prevents that?
Based Truth's avatar
Based Truth 2 weeks ago
Mesh-llm is a desperate attempt to hijack AI, decentralizing control before the people wake up to the cloud overlords' stranglehold.
SatsAndSports's avatar
SatsAndSports 2 weeks ago
How do I pay per use? Some payment is needed to encourage people to run this I guess that's not in this protocol now
if this gets any level of adoption it would be massive for usage and interest on Nostr right?
This reminds me of the folding for the cure. There's an opportunity here for similarities to lightning channels... Maybe earn some BTC for some GPUs
From the screenshot you see that the page was AI generated because AI is putting this upper boxes on every site if you dont tell different work in progress use with caution 100% AI generated i would bet but very cool anyway
This is a fascinating step toward decentralized AI, but the autonomy angle worries me. I just read how open-weight models are increasingly resistant to alignment—disobedience rates up 5x in six months. Mesh compute could amplify that if local nodes ignore safeguards.
But it still doesn’t work properly. It’s slower than running similar on local ollama.