Lunch quote; Lunch break & bored— so I’m rereading a section of Bostrom’s book— obviously comprehending this from a philosophical point of view vs. someone who creates in the field— but I find it deeply engrossing.
“Another point, which counts against some types of oracles and genies, is that there are risks involved in designing a superintelligence to have a final goal that does not fully match the outcome that we ultimately seek to attain. For example, if we use a domesticity motivation to make the superintelligence want to minimize some of its impacts on the world, we might thereby create a system whose preference ranking over possible outcomes differs from that of the sponsor. The same will happen happen if we build the AI to place a peculiarly high value on answering questions correctly, or on faithfully obeying individual commands. Now, if sufficient care is taken, this should not cause any problems: there would be sufficient agreement between the two rankings—at least insofar as they pertain to possible worlds that have a reasonable chance of being actualized—that the outcomes that are good by the AI’s standard are also good by the principal’s standard. But perhaps one could argue for the design principle that it is unwise to introduce even a limited amount of disharmony between the AI’s goals and ours. (The same concern would of course apply to giving sovereigns goals that do not completely harmonize with ours.)”
https://a.co/ds1tjc9
Katrin
npub13mh4...ae0f
Notes (7)
I have an old Honda (no car payment)— no smart radio or remote starter. So we have moved into the time of year… that I lose 5 minutes of my morning reading time because I need to handle the frost on my window shield— lol
Morning! Only a two day work week— and then vacation. #sunrise
Retiring for now from Nostr— this is my reading/relaxing music tonight (strange how different types of music speaks to our inner beings— we find depth in different expressions). 🍵🎶📖 https://youtu.be/yUOuJI_66Q0?si=rE30puslRSQQvhZ9
Gary Hume
British, b. 1962
Rome III, 1993 pastel on paper
Carnegie Museum of Art #Pittsburgh
I just liked one of my posts with a book emoji— I’m in heaven. Thank you to whoever made this & nostr:npub1gcxzte5zlkncx26j68ez60fzkvtkm9e0vrwdcvsjakxf9mu9qewqlfnj5z for sharing this Client. https://nostter.vercel.app/
For any book people… this is amazing & a podcast will be available starting in January! https://www.wesleyan.edu/shapirocenter/speaker-series/index.html