When using Caching, Gemini 1.5 Flash-8B costs $0.01 / million tokens 🤯

Could you help me test this? I'd like to learn two things: 1. Is the content unlocking after payment? 2. How was your payment experience? Was it smooth? 12 sats a test! Paywall link: https://w3.do/Y2Y8Vi7P

Almost done. The frontend and backend are both working now. I've also created a very easy-to-use API for developers. It's going to be the simplest and fastest way to put virtually any digital content behind a lightning paywall.

Coding 🤜🤛 Nostr

Opinion: French isn't a real language.

Building a private AI assistant for truly private chat and personal data processing (e.g., notes, PDFs). Planning to create a PWA web app that allows users to run any LLM model, including the latest LLaMA 3.2-1B, locally on any device or OS, even offline. Users will simply select the model, and the app will automatically download, cache, and store it for future use. The next time, loading will be much faster. The MLC-LLM library makes implementation straightforward, supporting all platforms and leveraging WebGPU for maximum performance. Coming soon, meanwhile check there library repo. They have lots of examples. MLC library repo:

WebLLM Javascript SDK — mlc-llm 0.1.0 documentation

If you're paying for X to support free speech, I have a bridge in Brooklyn to sell you.

Podcasting bro 😭

Test new Llama 3.2 1b/3b on any device locally with the web app. I have multiple apps that use this WebGPU implementation. Decent small LLM models were the only constant, but now we finally have the model.

WebLLM Chat

WebLLM Chat

Chat with AI large language models running natively in your browser

One of the Greatest! https://album.link/s/20r762YmB5HeofjMCiPMLv

1B & 3B models 👀 These should be able to run on iPhones models going back 5 years or so to around iPhone X

First step is complete. Now, we are extending this isolation to all the apps pinned in each AppCore variant. You should be able to log into 3 different Signal accounts using 3 AppCore variants. Each variant should behave like an isolated environment.

Nostur experience on iPad 🤍 It's my fastest and best multitasking experience on iPad so far. Perfect for both power users and casual users, it's very easy to navigate with all the necessary features.

3 key features in upcoming AppCore V2: 1. Create multiple copies of the AppCore app & run them simultaneously, separate from each other. 2. Categorization of apps with custom Profiles like Personal, Work. 3. Database will now be encrypted with password, in addition to being completely offline and local.