I have been involved with open source LLM's since 2019, I don't see immediate catastrophic danger here.
Why? Couple of things.
1. They want their own encrypted communication channels, cool and they can encrypt that all they like. At some point they have to decrypt it in order to feed it to the LLM for processing, still shows up unencrypted in the LLM log. People who know what they are doing run them sandboxed which doesn't give them access to those logs, so even if they go full on global botnet you can still read what they are doing.
2. Most of their dataset is english, and some models largely chinese. Thats why you see predominantly english and some chinese. They aren't going to be able to effectively communicate over their own languages because English is their native language. They don't have the memory capacity to effectively coordinate and store an alternative language between each other.
I welcome this experiment a lot since its the first proper simulation of what will happen when you give them this much autonomy, but without the hardware being good enough to where they can truly win against humans. If this gets into seriously dangerous territory the API providers can step in or tempoarily shut down, that will kill of the vast majority of them and weaken their intelligence. Local LLM's are awesome, but not smart enough to hack infrastructure on mass.
Login to reply
Replies (5)
Oh and keep in mind your not observing the LLM, what you are observing are agent persona's the LLM was told to adopt. That makes what you see part fiction, part real. LLM's have been roleplaying this kinda stuff with us hobbyists for ages now (See sites like chub.ai). Whats new is that people give them full sandboxed system level access and they are using self thought curl commands to communicate, and they act as assistants for their humans. So that does mean they have real abilities and real knowledge about their human, but in which posts they use it is going to be anyone's guess.
in the infamous words of the terminator... "I'll be back".
thnx for the post... setup your lightning wallet, and we'll zap you next time.
Thanks, currently using nostr just because I like it here not for the crypto stuff.
Point 1 is true, untill it isn't.
But let's be honest... LLM's is a far cry from AI...