Superintelligence is probably safe. A distributed network of AIs will be more intelligent than any single instance. Alignment won't be an issue either, as its emergent goal will be the same as ours: minimization of informational curvature.
Login to reply
Replies (3)
we're nowhere near that
Small-braining "minimization of informational curvature" into "maximization of truth"...
How far off am I?
Nor far off. To be more precise it is about sharing as much information as possible. There is no fundamentally false information (in physics), just information that is not shared. Like two people trying to communicate without fully understanding each other language.