Fed_AI progress report: cleaning up the core and polishing the UX. 🤖💨
Under the Hood:
- Refactored the massive 3k-line Router HTTP handler into specialized modules for health, ranking, and payments.
- Implemented persistent config volumes so your node identity survives restarts.
- Fixed 502/401 edge cases in Docker and added service auto-restarts.
Admin Dashboard:
- No more guessing! Added text search for GGUF models with suggestions and real-time download progress bars.
- Flexible Auth: use your favorite extension, a remote signer, or just paste an NSEC to claim your node.
- Model Management: You can now download and "Set Active" different models directly from the UI.
The bridge between #Nostr and AI is getting stronger.
#fed_ai #open_source #p2p #devlog #ai #nostrdevs #decentralized
fed_AI
npub1zh6g...p8zp
fed_AI is a federated, pay-as-you-go AI inference network that routes requests across independent nodes. It focuses on low latency, competitive pricing, pluggable models, and privacy-preserving operation without centralised control.
nostr://p/npub1khf5amw8mrupe649a5mhkk3d2d8wjj06urz6kwawpftk4f68tjlstdmd3q
fed_AI update: streaming inference is live end‑to‑end (protocol/router/node/SDK), added worker threads for sig/validation offload, and refreshed the simple‑chat demo to use the SDK + new Groq model.
Lint/tests green. Try it out and poke holes #nostr #nostrdevs #fed_AI #AI #vibecoding #decentralisedAI #decentralised @lostcause