pleb's avatar
pleb
_@satstack.dev
npub1dxs2...n4st
Have I done something for the common good? Then I share in the benefits. To stay centered on that. Not to give up.
pleb's avatar
pleb 1 year ago
is the news coverage you're following as good as Channel 4 in the UK? Cause afaict they've been doing a freakin' good job of showing how perplexing the situation is. Genuinely curious if there's other media out there that's this good, because I'm not used it.
pleb's avatar
pleb 1 year ago
Just installed my first nix flake. It's nix-bitcoin! And no krops either. Total standalone machine. I'm copying over blocks now and next will fiddle with settings, then try activating secure mode (had it on previously when I installed via krops, so the config should work). ``` { description = "NixOS configuration with nix-bitcoin"; inputs = { nixpkgs.url = "github:NixOS/nixpkgs/nixos-24.05"; nix-bitcoin.url = "github:fort-nix/nix-bitcoin/release"; nix-bitcoin.inputs.nixpkgs.follows = "nixpkgs"; # nixpkgs.follows = "nix-bitcoin/nixpkgs"; # nixpkgs-unstable.follows = "nix-bitcoin/nixpkgs-unstable"; }; outputs = { self, nixpkgs, nix-bitcoin }: { nixosConfigurations.quilladin = nixpkgs.lib.nixosSystem { system = "x86_64-linux"; modules = [ ./configuration.nix nix-bitcoin.nixosModules.default # Optional: # Import the secure-node preset, an opinionated config to enhance security # and privacy. # # (nix-bitcoin + "/modules/presets/secure-node.nix") { nix-bitcoin.generateSecrets = true; services.bitcoind.enable = true; nix-bitcoin.operator = { enable = true; name = "fiatjaf"; }; } ]; }; }; } ```
pleb's avatar
pleb 1 year ago
Oh no, I missed it this year ๐Ÿ˜จ image
pleb's avatar
pleb 1 year ago
image local llms with ollama + open-webui + litellm configured with some apis the free Claude 3.5 sonnet is my daily driver now. When I run out of free messages, I switch over to open-webui and have access to various flagship models for a few cents. The local models usually suffice when I'm asking a dumb question Here's my `shell.nix`: ``` { pkgs ? import <nixpkgs> {} }: (pkgs.buildFHSEnv { name = "simple-fhs-env"; targetPkgs = pkgs: with pkgs; [ tmux bash python311 ]; runScript = '' #!/usr/bin/env bash set -x set -e source .venv/bin/activate tmux new-session -d -s textgen tmux send-keys -t textgen "open-webui serve" C-m tmux split-window -v -t textgen tmux send-keys -t textgen "LITELLM_MASTER_KEY=hunter2 litellm --config litellm.yaml --port 8031" C-m tmux attach -t textgen ''; }).env ``` And here's `litellm.yaml`: ``` model_list: - model_name: codestral litellm_params: model: mistral/codestral-latest api_key: hunter2 - model_name: claude-3.5 litellm_params: model: anthropic/claude-3-5-sonnet-20240620 api_key: sk-hunter2 - model_name: gemini-pro litellm_params: model: gemini/gemini-1.5-pro-latest api_key: hunter2 safety_settings: - category: HARM_CATEGORY_HARASSMENT threshold: BLOCK_NONE - category: HARM_CATEGORY_HATE_SPEECH threshold: BLOCK_NONE - category: HARM_CATEGORY_SEXUALLY_EXPLICIT threshold: BLOCK_NONE - category: HARM_CATEGORY_DANGEROUS_CONTENT threshold: BLOCK_NONE ```
pleb's avatar
pleb 1 year ago
I had way too much with LivePortrait this morning. Couldn't quite get it to run on Nix (I still suck at nix derivations), but they're still running a free demo space on HF. Also out of China in the last few weeks was ChatTTS and Qwen2, state of the art local text to speech and llm. I've been running it with ollama and open-webui, and it's not half bad compared to 4o or claude, in one prompt it actually gave me a better answer. There's a ComfyUI node for LivePortrait. There's a lot you could do with this stuff. Deepfakes and destroy democracy, sure. But maybe more relevant to my interests is we're nearly upon the toolset needed to build a fully artificial (and local) talking head. if there's a model that can generate facial expressions to match a voice, I think that's basically everything we need is right there. then use ollama to RAG your own documents and legit talk to your home PC face to face. what a time to be alive
โ†‘