routstr's avatar
routstr
_@routstr.com
npub130mz...l29s
A Decentralised LLM Protocol & Routing Marketplace Check our docs: https://docs.routstr.com Try the chat app: https://chat.routstr.com Github: https://github.com/routstr
routstr's avatar
routstr 1 year ago
Announcing Routstr Core v0.1.0: Come Run Routstr Nodes with Us With this stable release, anyone can run Routstr nodes and help decentralize AI access to anyone, anywhere on earth! Come run a Routstr node and serve models from OpenAI, Anthropic, x-ai, Google, Replicate, or OpenRouter (charges 5% extra) to anyone on the open internet and earn Bitcoin via Cashu/Lightning. With v0.1.0, we made Routstr incredibly stable, but this is still a Beta version. If you come across a problem, we’d appreciate it if you report the bug to us on our Github. Along with making Routstr more robust, we added these new features to Routstr: 1. Multiple Cashu Mint Support: Users and nodes don’t need to use the same mint 2. Multi-Currency Support: Sat and msats are both supported right now 3. Pay per Request with X-Cashu Headers: Send a Cashu token with enough balance and get the change back along with the response 4. Admin Dashboard and Withdrawals: A simple dashboard to look your and your users’ balances, more updates coming
routstr's avatar
routstr 1 year ago
we just spend 120k SATs to create this new cashu nip60 implementation in python 120k SATs because claude4 opus in cursor costs a lot we needed this internally to improve the proxy implementations so why not publish it as separate library
routstr's avatar
routstr 1 year ago
One single request to Claude 4 Opus can cost $5,4 at context and completion maxed out. (~5k sats) Before the request there is no way to estimate the cost so we are required to implement a minimum balance that you need to put in your cashu token to be able to use the model. This cost varies by model so for example Gemini 2.5 Flash has a maximum cost of $0.2 ~180 sats
routstr's avatar
routstr 1 year ago
Our public onion endpoint: http://mcfftxiqtpwvrsly4..titn3frmf55frcleid.onion If you want to host your own provider and appear in the marketplace just post a nostr message, mention @routstr and add your onion url like in this message. We have a script in our backend that searches nostr for these messages and then includes your provider.
routstr's avatar
routstr 1 year ago
At routstr were building the first marketplace to buy and sell LLM APIs using cashu tokens. Using our proxy you can monetize any OpenAI API compatible LLM server on a per token basis at msat precision (e.g. your local hosted LlamaCPP server) As User you can just put a cashu note into the api-key field of your llm application and as long as the balance lasts, you can leave the same note. We dont have everything build out yet and soon we’re getting the marketplace onto nostr so people can list their own nodes. To then ensure trust and quality we are working on a separate evaluation system so you know which nodes provide a good service.
routstr's avatar
routstr 1 year ago
Access o4 Mini High with a simple API call using your Cashu token for authentication. image
↑