Artificial intelligence will not be built like humans (or the bird-aliens) that enjoy preferences or prime numbers. While humans consider “What is the right thing to do?” (93), machine intelligence’s ultimate goal is to be efficient and maximize output. AI can be trained to consider human’s “moral sentiments” (83), but as it becomes superintelligent it will develop beyond human psychology. Yudkowsky and Soares consider if an “alien mind would be good for humanity” and their answer is a resounding “No.” (83). Alien superintelligence machines would not benefit from human existence and they would end our population. Yudkowsky and Soares compare […]
Continue reading Dineen – If Anyone Builds It, Everyone Dies (Chapters 5 & 6) »