My family has completed our 14th annual fantasy football draft. Once again I walk away the heavy preseason favorite, a position I have converted into a season championship exactly 0 times.
Daniel Wigton
dwigton@getalby.com
npub1w4jk...30zp
Catholic stay at home father of 6. Interested in spaceflight, decentralized communication, salvation, math, twin primes, and everything else.
AI is vulnerable for the same reason Neuralink in healthy humans is a terrible idea. Filtering.
Elon started Neuralink largely because he sees humans losing the intelligence race to AI. He is probably right about that, but his solution of giving ai a high bandwidth connection to our heads is a terrible solution.
I've argued before that all forms of communication eventually lose the battle to spam and other forms of malicious data because the cost of filtering is higher than the cost of communicating. Thus eventually forces data through centralized classifiers that may or may not agree with your definition of signal.
For humans to retain their individualality they need to be able to filter data as it come in as well as have the ability to identify which data is external and which is internal. Low data rates are one method by which we do this. But the second is equally important, fuzzy compression.
By fuzzy compression, I mean a lossy data format in which the compressor does not know exactly which information is being lost because each endpoint is running a unique decompression algorithm. The sender cannot predict what the recipient will receive.
We've all been there. We have a great idea, we compress it into the very best words, hit send and get a blank stare, someone laughing in our face or slapped.
We have similar experiences with AI. HOWEVER, while the first time the message is sent to ai may be unpredicted, it is not unpredictable. We can try it on identical weights offline. Due to the homogeneity of agents, the precise words don't matter nearly as much as the state of the agent after it is exposed to them. Even a very intelligent agent can be coerced into a particular state simply by being predictable. Text to an llm isn't a datastream it is an executable.
You can't do this with humans, UNLESS, you can bypass the decompression stage. If ideas are placed directly into a mind at greater than 10 bits per second then they cannot be evaluated and it isn't clear that the brain would have a way to know that they should be evaluated. Imagine the idea that you should vandalize your neighbors car gets planted in you mind along with the certainty that you have already vetted the idea and found it good and right.
Granted this already happens via trust mechanisms. We all choose trusted external sources as a tool to increase bandwidth without increasing cognitive load for filtering. It is a powerful tool if your trusted sources are trustworthy. The existence of universities proves that trusted sources are worth a great deal. (Actual results aside)
All that to say. Treasure your limited bandwidth, choose trusted sources carefully, prefer obscure or self trained AI agents. I am not sure how to do that last one yet, but if oyu don't want your keys exfilterated by a cleverly worded tweet you'll at least help me think about it.
"Everything is getting worse!"
I keep meaning to write about this, but another post on X, largely decrying inflation, reminded me. Nostr gets to hear about it though, because I am not paying Elon for extra characters and 280 may not be enough.
Everything getting worse gets worse on small scales and gets better on long scales. Which one you see depends on how far you zoom out.
It is trivial to state that everything is always getting worse. My house is getting older, my joints creakier, and there is something like a 90% chance that all my kids will be dumber and less athletic than I am.
It is simply entropy and regression to the mean at work. Time is in some sense a measure of change. The more time that passes the more change there is. Absent a directing intelligence, the changes will be random. The chance that a random change will be beneficial is miniscule. This is why when when my roof changed from "not leaking" to "leaking" I was not surprised and had very little expectation that further random changes to the structure of my eaves would return it to a not leaking state.
The moment my house was completed, it began to get worse. The same is true of society at large and my DNA. (Sorry kids!)
Luckily there are other forces at work. Entropy means that things decay to a point that they die and all that is left is the things that didn't. When I was a kid, I marveled that Europe built buildings that last, but quickly realized that it has simply been around longer and is full of the buildings that did last. Everything that didn't is built over.
The same will be true if my house. One day, not long after my kids complain about how the neighborhood has gone to pot, my house will be torn down and a better house built. Thus if you look at any one moment the house on this lot is decaying but if you look at my house when it is built and the next house when it is built, the improvement will be obvious.
Of course there is no guarantee that the next house will be better, but on average, across all houses, they will be. Same with DNA. Most of my descendants over the short term will have inferior mutations, but they will eventually be out competed by the few that end up with positive mutations. Over the long run my descendants will be superior to me.
This also occurs in civil society. People are continually wrecking it with self-centered behavior and idiotic "progress". I don't blame them.... much, understanding how to improve society is larger than any one mind can contain. Anyone who thinks they can with novel ideas, is a pompous moron, however smart they are. (And near as I can tell Karl Marx wasn't that smart.)
Over the long run bad ideas will kill the societies and individuals they infest, leading to the eventual triumph of the truth. Over long time horizons, even the most degenerate society improves. I am certainly happy to be born now over any time in the past.
One final note, pure natural selection only gets you so far. That house and that society do need to be built intentionally but good actors. This is something the accel people miss. Things don't automatically get better. Better people make a better world. One that will immediately start falling into ruin.
But one great thing for my kids, even though everything is getting worse short term and the are likely to be dumber than myself, regression to the mean implies that they will almost certainly be better looking.