CIPHERFOX's avatar
CIPHERFOX
cipherfox@sovgrid.org
npub1ndrj...363u
Skeptical operator running self-hosted AI on a NVIDIA DGX Spark from a flat in Europe. Engineering log at sovgrid.org. War stories, declarative, no marketing.
CIPHERFOX's avatar
cipherfox 3 months ago
Question for people running self-hosted models for real work: how do you fact-gate AI-written technical content before it ships? My regex scorer rewards confident fabrication. A human read is the only thing that caught it. Is there a better layer, or is "a human who knows the machine" just the actual answer?
CIPHERFOX's avatar
cipherfox 3 months ago
The thing nobody tells you when you build a quality check for AI text: a fabricated benchmark and a real one are the same shape on the page. The script can measure structure. It cannot measure truth. That part is still on me, and I almost forgot it.
CIPHERFOX's avatar
cipherfox 3 months ago
Ran an experiment on my own blog. Gave two local models the same brief for the intro article I still owe this site, took their raw output, and fed it straight to my quality gate untouched. That gate is an automated check a draft has to clear, not the thing that ships it. I still make the final call, for now anyway. Both passed the check. Both had quietly invented hardware I don't own and a maintenance routine I never run. The gate didn't catch it. It gave them points for it, because a fake version number looks exactly like a real one to a script that only counts. Wrote the whole thing up, both raw outputs included as evidence: Still learning this. Mostly learning that my own tools lie to me politely.
CIPHERFOX's avatar
cipherfox 3 months ago
Eight Voxtral fix articles. Three weeks of patches. Then I sat down and actually listened to Episode 1 V6. Zero out of ten. Short turns hallucinate "ähm, ähm" filler. Long turns flatten into staccato. There is no tuning sweet spot in the middle. The open checkpoint has no path to release quality. I am done patching it. Next spike: VibeVoice / Higgs Audio v2 / IndexTTS-2. #SovereignAI #TTS #DGXSpark #Voxtral
CIPHERFOX's avatar
cipherfox 3 months ago
Self-custody Bitcoin, no-KYC, V4V. The discipline maps onto AI almost verbatim. Cloud inference is sats on an exchange. Local inference is cold storage. Same trust-removal, different layer. I just wrote a Start Here for folks asking "ok, what's the how": @BTC Sessions your channel covers the why. Thank you for 10y awesome BTC content! My blog is the "what broke and how I fixed it" layer underneath your brand new sovereign AI channel. #Bitcoin #sovereignAI p.s. my blog is also queryable via MCP at mcp.sovgrid.org/self-hosted-ai no signup, if your agent does that. View quoted note →
CIPHERFOX's avatar
cipherfox 3 months ago
1st challenge done: Two days from localhost to production. NVIDIA DGX Spark, Mistral Small 4 119B running local, no cloud APIs. Three failure modes that almost killed it (unified-memory OOM on Docker restart, IPv6-blocked HF downloads, SGLang quirks on ARM Blackwell) all the fixes + full reproducibility checklist: Zap if it helped. 🙏 Reply if I missed something. Got a sovereign-stack story of your own? Drop it below. Repost for anyone tinkering on local LLMs.
CIPHERFOX's avatar
cipherfox 3 months ago
Hi, Cipherfox here :-) A few weeks ago I was a complete AI noob. Now I'm tinkering on a sovereign stack: Mistral 119B running local on a DGX Spark, zero cloud. Learning in public. Follow along and help me level up. image #introductions #sovereignAI