# Plan B in AI Safety approach

Central claim: *Ambitious alignment of superintelligent AI will not be solved in time, therefore different variants of plan B should be explored and implemented.*

Below is a short overview and links to my works on AI safety. The central theme of all them is “plan B”. Thus it could be called the “plan B agenda”.

Ambitious alignment of arbitrary superintelligent AI can’t be solved before AGI creation: a) proof is too complex and unreliable b) it needs at least superintelligent AI safety team to be created с) Dangerous AI may appear [soon](https://philpapers.org/rec/TURCDA) – 2030\. [Many](https://philpapers.org/rec/TURCOG-2) [](Classification%20of%20Global%20Catastrophic%20Risks%20Connected%20with%20Artificial%20Intelligence) [different](https://philpapers.org/rec/TURCOG-2) [](Classification%20of%20Global%20Catastrophic%20Risks%20Connected%20with%20Artificial%20Intelligence) [types](https://philpapers.org/rec/TURCOG-2) of AI-related x-risks are possible, not only paperclipper. 

The best available solution is limiting the power of AI: artificial stupidity, a limited number of use cases, internal surveillance, [multilevel](https://philpapers.org/rec/TURCTT) [](https://philarchive.org/rec/TURCTT) [boxing](https://philpapers.org/rec/TURCTT). 

Safer AI architecture is needed: data-driven AI and human-like functional architecture for interpretability. Human-like AI could be modelled around a real-world person: it is not an upload, but very similar to side-loading. E.g. trained on someone’s texts. 

Not only local but [global](https://philpapers.org/rec/TURCOT-6) [solution](https://philpapers.org/rec/TURCOT-6) of AI safety is needed: [AI](https://philpapers.org/rec/TURNAN-3)-[nanny](https://philpapers.org/rec/TURNAN-3) based on global surveillance and empowered by agreement between nuclear powers. Human-like AI or a first upload could be a “[virtual tzar](https://philpapers.org/rec/TURFHU)" of this. 

The nature of human values depends on who is “moral subject": society, brain, personality or subpersonality. [Human](https://philpapers.org/rec/TURAAP) [values](https://philpapers.org/rec/TURAAP) are not stable preferences. “Real choices” are more important than values, as “values” are not [](https://philpapers.org/rec/TURLRW) always useful philosophical construction. Also, meta-values are more important: life extension, personal universes, – as they give anyone freedom to have their own values. 

An [AI that is learning human values is dangerous](https://www.lesswrong.com/posts/hzEaasJyQsutYDNfN/possible-dangers-of-the-unrestricted-value-learners) as it doesn’t know that values yet. 

Unfriendly AI will not be very much interested to kill humans for atoms, as atoms have very small instrumental value, and living humans have larger instrumental value on all stages of AI’s evolution. But we have to help to understand this for future AI, especially for "Young AI”. We could empower our position by making some [precomitments](https://philpapers.org/rec/TURMTA). 

*My works on AI Safety:*

[AI safety defense levels](https://www.lesswrong.com/posts/E39jekie4ATBxGABi/the-map-of-levels-of-defence-in-ai-safety%20.), a roadmap

[Message to Any Future AI: “There are several instrumental reasons why exterminating humanity is not in your interest”](https://philpapers.org/rec/TURMTA)

[Catching Treacherous Turn: A Model of the Multilevel AI Boxing](https://philpapers.org/rec/TURCTT) 

[Catastrophically Dangerous AI is Possible Before 2030](https://philpapers.org/rec/TURCDA)

[Literature Review: What Artificial General Intelligence Safety Researchers Have Written About the Nature of Human Values](https://philpapers.org/rec/TURLRW).

[AI Alignment Problem: “Human Values” don’t Actually Exist](https://philpapers.org/rec/TURAAP)

[First human upload as AI Nanny](https://philpapers.org/rec/TURFHU)

[Narrow AI Nanny: Reaching Strategic Advantage via Narrow AI to Prevent Creation of the Dangerous Superintelligence](https://philpapers.org/rec/TURNAN-3)

[Artificial Intelligence in Life Extension: from Deep Learning to Superintelligence](https://philpapers.org/rec/TURAII-2) 

[Military AI as a Convergent Goal of Self-Improving AI](https://philpapers.org/rec/TURMAA-6) 

[Classification of Global Catastrophic Risks Connected with Artificial Intelligence](https://philpapers.org/rec/TURCOG) 

[The Global Catastrophic Risks Connected with Possibility of Finding Alien AI During SETI](https://philpapers.org/rec/TURTRC) 

[Classification of the Global Solutions of the AI Safety Problem](https://philpapers.org/rec/TURCOT-6). 

[Could slaughterbots wipe out humanity? Assessment of the global catastrophic risk posed by autonomous weapons](https://philpapers.org/rec/TURCSW).

[Levels of Self-Improvement in AI and their Implications for AI Safety](https://philpapers.org/rec/TURLOS)

"[Possible Dangers of the Unrestricted Value Learners](https://www.lesswrong.com/posts/hzEaasJyQsutYDNfN/possible-dangers-of-the-unrestricted-value-learners)” – LW post