Å·±¦ÓéÀÖ

If the AI's intelligence is to the human's as the human's is to a beetle, how can the human design the AI so that they can be sure of being able to control not only that particular AI, but all the successor AIs it might create? <spoiler>Oddly enough, the problem seems rather difficult to solve.</spoiler>

Getting the Manhattan Project started required an extraordinary effort by several visionary physicists, including especially Mark Oliphant and Leó Szilárd: the latter persuaded Eugene Wigner to persuade Albert Einstein to put his name on a letter to persuade Franklin D. Roosevelt to look into the matter. Even after the project reach its full scale, Roosevelt remained skeptical of its workability and significance.

We do not need to plug a fiber-optic cable into our brain in order to access the Internet. Not only can the human retina transmit information at an impressive rate of nearly 10 million bits per second, but it comes pre-packaged with a massive amount of dedicated wetware, the visual cortex, that is highly adapted to extracting information from this information torrent and to interfacing with other brain areas.

Chess-playing expertise turned out to be achievable by means of a surprisingly simple algorithm. It is tempting to speculate that other capabilities - such as general reasoning ability, or some key ability involved in programming - might likewise be achievable through some surprisingly simple algorithm.