Before revision: Experiments A number of experiments have been performed to develop self-improving agent architectures Potential risks Emergence of secondary goals In the pursuit of its primary goal, such as "self-improve your capabilities , " an AGI system might inadvertently develop secondary goals that it deems necessary for achieving its primary objective.
After revision: Experiments A number of experiments have been performed to develop self-improving agent architectures Potential risks Emergence of instrumental goals In the pursuit of its primary goal, such as "self-improve your capabilities , " an AGI system might inadvertently develop instrumental, goals that it deems necessary for achieving its primary objective.