The Singularitian movement. The only problem is that academics don't seem interested. Call me when you have running code. Alon Halevy, a faculty member in the University of Washington's computer science department and an editor at the Journal of Artificial Intelligence Research , said he's not worried about friendliness. The challenges we face are so enormous to even get to the point where we can call a system reasonably intelligent, that whether they are friendly or not will be an issue that is relatively easy to solve.
Rules limiting smart computers to human-approved limits, of course, are nothing new.
The most famous example is the Laws of Robotics, written by Isaac Asimov, one of the fathers of science fiction. A robot must protect its own existence as long as such protection does not conflict with the First or Second Laws. Send it . Use this version. E-mail this to a friend.