Machine ethics and robot rights are quickly becoming hot topics in artificial intelligence and robotics communities. We will argue that attempts to attribute moral agency and assign rights to all intelligent machines are misguided, whether applied to infrahuman or superhuman AIs, as are proposals to limit the negative effects of AIs by constraining their behavior. As an alternative, we propose a new science of safety engineering for intelligent artificial agents based on maximizing for what humans value. In particular, we challenge the scientific community to develop intelligent systems that have human-friendly values that they provably retain, even under recursive self-improvement.
Instead of an ethical approach, Yampolskiy proposes a safety engineering approach, able to provide proofs that developed A.I. systems will remain safe, even under recursive self-improvement REF .
Safety Engineering for Artificial General Intelligence
Topoi
Psychology