AIアライメント
引用文献

1 2 3 4 5 6 7  Russell, Stuart J.; Norvig, Peter (2020). Artificial intelligence: A modern approach (4th ed.). Pearson. pp. 31-34. ISBN 978-1-292-40113-3. OCLC 1303900751.  オリジナルのJuly 15, 2022時点におけるアーカイブ。. https://web.archive.org/web/20220715195054/https://www.pearson.com/us/higher-education/program/Russell-Artificial-Intelligence-A-Modern-Approach-4th-Edition/PGM1263338.html September 12, 2022閲覧。
1 2 3 4 5 6 7  Hendrycks, Dan; Carlini, Nicholas; Schulman, John; Steinhardt, Jacob (16 June 2022). "Unsolved Problems in ML Safety". arXiv:2109.13916 [cs.LG]。
1 2 3 4 5  Ngo, Richard; Chan, Lawrence; Mindermann, Sören (22 February 2023). "The alignment problem from a deep learning perspective". arXiv:2209.00626 [cs.AI]。
1 2 3 4 5 6  Pan, Alexander; Bhatia, Kush; Steinhardt, Jacob (14 February 2022). The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models. International Conference on Learning Representations. 2022年7月21日閲覧。
↑  Zhuang, Simon; Hadfield-Menell, Dylan (2020). "Consequences of Misaligned AI". Advances in Neural Information Processing Systems. Vol. 33. Curran Associates, Inc. pp. 15763–15773. 2023年3月11日閲覧。
1 2 3 4 5 6 7 8 9 10 11 12  Carlsmith, Joseph (16 June 2022). "Is Power-Seeking AI an Existential Risk?". arXiv:2206.13353 [cs.CY]。
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18  Russell, Stuart J. (2020). Human compatible: Artificial intelligence and the problem of control. Penguin Random House. ISBN 9780525558637. OCLC 1113410915. https://www.penguinrandomhouse.com/books/566677/human-compatible-by-stuart-russell/
1 2 3 4 5 6  Christian, Brian (2020). The alignment problem: Machine learning and human values. W. W. Norton & Company. ISBN 978-0-393-86833-3. OCLC 1233266753.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114137/https://wwnorton.co.uk/books/9780393635829-the-alignment-problem September 12, 2022閲覧。
1 2 3 4  Langosco, Lauro Langosco Di; Koch, Jack; Sharkey, Lee D.; Pfau, Jacob; Krueger, David (28 June 2022). "Goal Misgeneralization in Deep Reinforcement Learning". Proceedings of the 39th International Conference on Machine Learning. International Conference on Machine Learning. PMLR. pp. 12004–12019. 2023年3月11日閲覧。
1 2 3 4 5 6 7 8 9 10  Bommasani, Rishi; Hudson, Drew A.; Adeli, Ehsan; Altman, Russ; Arora, Simran; von Arx, Sydney; Bernstein, Michael S.; Bohg, Jeannette et al. (2022-07-12). “On the Opportunities and Risks of Foundation Models”. Stanford CRFM. arXiv:2108.07258. https://fsi.stanford.edu/publication/opportunities-and-risks-foundation-models.
1 2 3  Ouyang, Long; Wu, Jeff; Jiang, Xu; Almeida, Diogo; Wainwright, Carroll L.; Mishkin, Pamela; Zhang, Chong; Agarwal, Sandhini; Slama, Katarina; Ray, Alex; Schulman, J.; Hilton, Jacob; Kelton, Fraser; Miller, Luke E.; Simens, Maddie; Askell, Amanda; Welinder, P.; Christiano, P.; Leike, J.; Lowe, Ryan J. (2022). "Training language models to follow instructions with human feedback". arXiv:2203.02155 [cs.CL]。
1 2  “OpenAI Codex”. OpenAI (2021年8月10日). February 3, 2023時点のオリジナルよりアーカイブ。2022年7月23日閲覧。
↑  Kober, Jens; Bagnell, J. Andrew; Peters, Jan (2013-09-01). “Reinforcement learning in robotics: A survey” (英語). The International Journal of Robotics Research 32 (11):  1238–1274. doi:10.1177/0278364913495721. ISSN 0278-3649.  オリジナルのOctober 15, 2022時点におけるアーカイブ。. https://web.archive.org/web/20221015200445/https://journals.sagepub.com/doi/10.1177/0278364913495721 September 12, 2022閲覧。.
↑  Knox, W. Bradley; Allievi, Alessandro; Banzhaf, Holger; Schmitt, Felix; Stone, Peter (2023-03-01). “Reward (Mis)design for autonomous driving” (英語). Artificial Intelligence 316:  103829. doi:10.1016/j.artint.2022.103829. ISSN 0004-3702. https://www.sciencedirect.com/science/article/pii/S0004370222001692.
↑  Stray, Jonathan (2020). “Aligning AI Optimization to Community Well-Being” (英語). International Journal of Community Well-Being 3 (4):  443–463. doi:10.1007/s42413-020-00086-3. ISSN 2524-5295. PMC 7610010. PMID 34723107. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7610010/.
1 2  Russell, Stuart; Norvig, Peter (2009). Artificial Intelligence: A Modern Approach. Prentice Hall. pp. 1010. ISBN 978-0-13-604259-4. https://aima.cs.berkeley.edu/
↑  Smith, Craig S.. “Geoff Hinton, AI's Most Famous Researcher, Warns Of 'Existential Threat'” (英語). Forbes. 2023年5月4日閲覧。
↑  Geoffrey Hinton (3 March 2016). The Code That Runs Our Lives. The Agenda.  該当時間: 10:00. 2023年3月13日閲覧。
↑ Future of Life Institute (2017年8月11日). “Asilomar AI Principles”. Future of Life Institute . October 10, 2022時点のオリジナルよりアーカイブ。2022年7月18日 閲覧。 The AI principles created at the Asilomar Conference on Beneficial AI were signed by 1797 AI/robotics researchers.
United Nations (2021). Our Common Agenda: Report of the Secretary-General (PDF) (Report). New York: United Nations. 2022年5月22日時点のオリジナルよりアーカイブ (PDF)。2022年9月12日閲覧。[T]he [UN] could also promote regulation of artificial intelligence to ensure that this is aligned with shared global values.
1 2 3 4 5 6 7 8 9 10 11  Amodei, Dario; Olah, Chris; Steinhardt, Jacob; Christiano, Paul; Schulman, John; Mané, Dan (21 June 2016). "Concrete Problems in AI Safety" (英語). arXiv:1606.06565 [cs.AI]。
1 2 3 4  “Building safe artificial intelligence: specification, robustness, and assurance”. DeepMind Safety Research – Medium (2018年9月27日). February 10, 2023時点のオリジナルよりアーカイブ。2022年7月18日閲覧。
1 2  Rorvig, Mordechai (2022年4月14日). “Researchers Gain New Understanding From Simple AI”. Quanta Magazine. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月18日閲覧。
↑ Doshi-Velez, Finale; Kim, Been (2 March 2017). "Towards A Rigorous Science of Interpretable Machine Learning". arXiv:1702.08608 [stat.ML]。
Wiblin, Robert (4 August 2021). "Chris Olah on what the hell is going on inside neural networks" (Podcast). 80,000 hours. No. 107. 2022年7月23日閲覧。
↑  Russell, Stuart; Dewey, Daniel; Tegmark, Max (2015-12-31). “Research Priorities for Robust and Beneficial Artificial Intelligence”. AI Magazine 36 (4):  105–114. doi:10.1609/aimag.v36i4.2577. hdl:1721.1/108478. ISSN 2371-9621.  オリジナルのFebruary 2, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230202181059/https://ojs.aaai.org/index.php/aimagazine/article/view/2577 September 12, 2022閲覧。.
1 2  Wirth, Christian; Akrour, Riad; Neumann, Gerhard; Fürnkranz, Johannes (2017). “A survey of preference-based reinforcement learning methods”. Journal of Machine Learning Research 18 (136):  1–46.
1 2  Christiano, Paul F.; Leike, Jan; Brown, Tom B.; Martic, Miljan; Legg, Shane; Amodei, Dario (2017). "Deep reinforcement learning from human preferences". Proceedings of the 31st International Conference on Neural Information Processing Systems. NIPS'17. Red Hook, NY, USA: Curran Associates Inc. pp. 4302–4310. ISBN 978-1-5108-6096-4。
1 2 3 4 5 6  Heaven, Will Douglas (2022年1月27日). “The new version of GPT-3 is much better behaved (and should be less toxic)”. MIT Technology Review. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月18日閲覧。
↑  Mohseni, Sina; Wang, Haotao; Yu, Zhiding; Xiao, Chaowei; Wang, Zhangyang; Yadawa, Jay (7 March 2022). "Taxonomy of Machine Learning Safety: A Survey and Primer". arXiv:2106.04823 [cs.LG]。
↑ Clifton, Jesse (2020年). “Cooperation, Conflict, and Transformative Artificial Intelligence: A Research Agenda”. Center on Long-Term Risk . January 1, 2023時点のオリジナルよりアーカイブ。2022年7月18日 閲覧。
Dafoe, Allan; Bachrach, Yoram; Hadfield, Gillian; Horvitz, Eric; Larson, Kate; Graepel, Thore (2021-05-06). “Cooperative AI: machines must learn to find common ground” (英語). Nature 593 (7857):  33–36. Bibcode: 2021Natur.593...33D. doi:10.1038/d41586-021-01170-0. ISSN 0028-0836. PMID 33947992.  オリジナルのDecember 18, 2022時点におけるアーカイブ。. https://web.archive.org/web/20221218210857/https://www.nature.com/articles/d41586-021-01170-0 September 12, 2022閲覧。.
↑  Prunkl, Carina; Whittlestone, Jess (2020-02-07). “Beyond Near- and Long-Term: Towards a Clearer Account of Research Priorities in AI Ethics and Society” (英語). Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (New York NY USA: ACM):  138–143. doi:10.1145/3375627.3375803. ISBN 978-1-4503-7110-0.  オリジナルのOctober 16, 2022時点におけるアーカイブ。. https://web.archive.org/web/20221016123733/https://dl.acm.org/doi/10.1145/3375627.3375803 September 12, 2022閲覧。.
↑  Irving, Geoffrey; Askell, Amanda (2019-02-19). “AI Safety Needs Social Scientists”. Distill 4 (2):  10.23915/distill.00014. doi:10.23915/distill.00014. ISSN 2476-0757.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114220/https://distill.pub/2019/safety-needs-social-scientists/ September 12, 2022閲覧。.
↑  “Faulty Reward Functions in the Wild” (英語). OpenAI (2016年12月22日). January 26, 2021時点のオリジナルよりアーカイブ。2022年9月10日閲覧。
1 2  Wiener, Norbert (1960-05-06). “Some Moral and Technical Consequences of Automation: As machines learn they may develop unforeseen strategies at rates that baffle their programmers.” (英語). Science 131 (3410):  1355–1358. doi:10.1126/science.131.3410.1355. ISSN 0036-8075. PMID 17841602.  オリジナルのOctober 15, 2022時点におけるアーカイブ。. https://web.archive.org/web/20221015105034/https://www.science.org/doi/10.1126/science.131.3410.1355 September 12, 2022閲覧。.
1 2 3 4 5  Gabriel, Iason (2020-09-01). “Artificial Intelligence, Values, and Alignment”. Minds and Machines 30 (3):  411–437. doi:10.1007/s11023-020-09539-2. ISSN 1572-8641.  オリジナルのMarch 15, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230315193114/https://link.springer.com/article/10.1007/s11023-020-09539-2 2022年7月23日閲覧。.
↑ The Ezra Klein Show (2021年6月4日). “If 'All Models Are Wrong,' Why Do We Give Them So Much Power?”. The New York Times . ISSN 0362-4331. オリジナルのFebruary 15, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230215224050/https://www.nytimes.com/2021/06/04/opinion/ezra-klein-podcast-brian-christian.html 2023年3月13日 閲覧。
Wolchover, Natalie (2015年4月21日). “Concerns of an Artificial Intelligence Pioneer”. Quanta Magazine. February 10, 2023時点のオリジナルよりアーカイブ。2023年3月13日閲覧。
California Assembly. “Bill Text – ACR-215 23 Asilomar AI Principles.”. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月18日閲覧。
1 2  Johnson, Steven; Iziev, Nikita (2022年4月15日). “A.I. Is Mastering Language. Should We Trust What It Says?”. The New York Times. ISSN 0362-4331.  オリジナルのNovember 24, 2022時点におけるアーカイブ。. https://web.archive.org/web/20221124151408/https://www.nytimes.com/2022/04/15/magazine/ai-language.html 2022年7月18日閲覧。
↑ OpenAI. “Developing safe & responsible AI”. 2023年3月13日 閲覧。
“DeepMind Safety Research”. Medium. February 10, 2023時点のオリジナルよりアーカイブ。2023年3月13日閲覧。
↑  Russell, Stuart J.; Norvig, Peter (2022). Artificial intelligence: a modern approach (4th ed.). Pearson. pp. 4-5. ISBN 978-1-292-40113-3. OCLC 1303900751. https://www.pearson.com/us/higher-education/program/Russell-Artificial-Intelligence-A-Modern-Approach-4th-Edition/PGM1263338.html
1 2 3 4 5  “Specification gaming: the flip side of AI ingenuity”. Deepmind (2020年4月21日). February 10, 2023時点のオリジナルよりアーカイブ。2022年8月26日閲覧。
↑  Manheim, David; Garrabrant, Scott (2018). "Categorizing Variants of Goodhart's Law". arXiv:1803.04585 [cs.AI]。
1 2 3  “Learning from Human Preferences”. OpenAI (2017年6月13日). January 3, 2021時点のオリジナルよりアーカイブ。2022年7月21日閲覧。
↑  “Specification gaming examples in AI — master list”. 2023年7月17日閲覧。
1 2 3  Lin, Stephanie; Hilton, Jacob; Evans, Owain (2022). “TruthfulQA: Measuring How Models Mimic Human Falsehoods” (英語). Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Dublin, Ireland: Association for Computational Linguistics):  3214–3252. doi:10.18653/v1/2022.acl-long.229.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114231/https://aclanthology.org/2022.acl-long.229/ September 12, 2022閲覧。.
1 2 3  Naughton, John (2021年10月2日). “The truth about artificial intelligence? It isn't that honest”. The Observer. ISSN 0029-7712.  オリジナルのFebruary 13, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230213231317/https://www.theguardian.com/commentisfree/2021/oct/02/the-truth-about-artificial-intelligence-it-isnt-that-honest 2022年7月23日閲覧。
↑ Ji, Ziwei; Lee, Nayeon; Frieske, Rita; Yu, Tiezheng; Su, Dan; Xu, Yan; Ishii, Etsuko; Bang, Yejin et al. (2022-02-01). “Survey of Hallucination in Natural Language Generation”. ACM Computing Surveys 55 (12): 1–38. arXiv:2202.03629. doi:10.1145/3571730. オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114138/https://ui.adsabs.harvard.edu/abs/2022arXiv220203629J October 14, 2022 閲覧。 .
Else, Holly (2023-01-12). “Abstracts written by ChatGPT fool scientists” (英語). Nature 613 (7944):  423. Bibcode: 2023Natur.613..423E. doi:10.1038/d41586-023-00056-7. PMID 36635510. https://www.nature.com/articles/d41586-023-00056-7.
↑  Russell, Stuart. “Of Myths and Moonshine”. Edge.org. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月19日閲覧。
↑  Tasioulas, John (2019). “First Steps Towards an Ethics of Robots and Artificial Intelligence”. Journal of Practical Ethics 7 (1):  61–95.
↑  Wells, Georgia; Deepa Seetharaman; Horwitz, Jeff (2021年11月5日). “Is Facebook Bad for You? It Is for About 360 Million Users, Company Surveys Suggest”. The Wall Street Journal. ISSN 0099-9660.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114137/https://www.wsj.com/articles/facebook-bad-for-you-360-million-users-say-yes-company-documents-facebook-files-11636124681 2022年7月19日閲覧。
↑  Barrett, Paul M.; Hendrix, Justin; Sims, J. Grant (September 2021). How Social Media Intensifies U.S. Political Polarization-And What Can Be Done About It (Report). Center for Business and Human Rights, NYU. 2023年2月1日時点のオリジナルよりアーカイブ。2022年9月12日閲覧。
↑  Shepardson, David (2018年5月24日). “Uber disabled emergency braking in self-driving car: U.S. agency”. Reuters.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114137/https://www.reuters.com/article/us-uber-crash-idUSKCN1IP26K 2022年7月20日閲覧。
↑  Baum, Seth (2021年1月1日). “2020 Survey of Artificial General Intelligence Projects for Ethics, Risk, and Policy”. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月20日閲覧。
1 2  Wei, Jason; Tay, Yi; Bommasani, Rishi; Raffel, Colin; Zoph, Barret; Borgeaud, Sebastian; Yogatama, Dani; Bosma, Maarten et al. (2022-10-26). “Emergent Abilities of Large Language Models”. Transactions on Machine Learning Research. ISSN 2835-8856.
1 2  Caballero, Ethan; Gupta, Kshitij; Rish, Irina; Krueger, David (2022). "Broken Neural Scaling Laws". International Conference on Learning Representations (ICLR), 2023.
↑ Dominguez, Daniel (2022年5月19日). “DeepMind Introduces Gato, a New Generalist AI Agent”. InfoQ . February 10, 2023時点のオリジナルよりアーカイブ。2022年9月9日 閲覧。
Edwards, Ben (2022年4月26日). “Adept's AI assistant can browse, search, and use web apps like a human”. Ars Technica. January 17, 2023時点のオリジナルよりアーカイブ。2022年9月9日閲覧。
↑  Grace, Katja; Salvatier, John; Dafoe, Allan; Zhang, Baobao; Evans, Owain (2018-07-31). “Viewpoint: When Will AI Exceed Human Performance? Evidence from AI Experts”. Journal of Artificial Intelligence Research 62:  729–754. doi:10.1613/jair.1.11222. ISSN 1076-9757.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114220/https://jair.org/index.php/jair/article/view/11222 September 12, 2022閲覧。.
↑  Zhang, Baobao; Anderljung, Markus; Kahn, Lauren; Dreksler, Noemi; Horowitz, Michael C.; Dafoe, Allan (2021-08-02). “Ethics and Governance of Artificial Intelligence: Evidence from a Survey of Machine Learning Researchers”. Journal of Artificial Intelligence Research 71. doi:10.1613/jair.1.12895. ISSN 1076-9757.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114143/https://jair.org/index.php/jair/article/view/12895 September 12, 2022閲覧。.
↑  Future of Life Institute (2023年3月22日). “Pause Giant AI Experiments: An Open Letter”. 2023年4月20日閲覧。
1 2  Pan, Alexander; Shern, Chan Jun; Zou, Andy; Li, Nathaniel; Basart, Steven; Woodside, Thomas; Ng, Jonathan; Zhang, Emmons et al. (2023-04-03). “Do the Rewards Justify the Means? Measuring Trade-Offs Between Rewards and Ethical Behavior in the MACHIAVELLI Benchmark” (英語). Proceedings of the 40th International Conference on Machine Learning (PMLR). arXiv:2304.03279.
1 2 3 4  Perez, Ethan; Ringer, Sam; Lukošiūtė, Kamilė; Nguyen, Karina; Chen, Edwin; Heiner, Scott; Pettit, Craig; Olsson, Catherine; Kundu, Sandipan; Kadavath, Saurav; Jones, Andy; Chen, Anna; Mann, Ben; Israel, Brian; Seethor, Bryan (19 December 2022). "Discovering Language Model Behaviors with Model-Written Evaluations". arXiv:2212.09251 [cs.CL]。
↑  Orseau, Laurent; Armstrong, Stuart (2016-06-25). “Safely interruptible agents”. Proceedings of the Thirty-Second Conference on Uncertainty in Artificial Intelligence. UAI'16 (Arlington, Virginia, USA: AUAI Press):  557–566. ISBN 978-0-9966431-1-5. https://dl.acm.org/doi/abs/10.5555/3020948.3021006.
1 2  Leike, Jan; Martic, Miljan; Krakovna, Victoria; Ortega, Pedro A.; Everitt, Tom; Lefrancq, Andrew; Orseau, Laurent; Legg, Shane (28 November 2017). "AI Safety Gridworlds". arXiv:1711.09883 [cs.LG]。
1 2 3 4  Hadfield-Menell, Dylan; Dragan, Anca; Abbeel, Pieter; Russell, Stuart (2017-08-19). “The off-switch game”. Proceedings of the 26th International Joint Conference on Artificial Intelligence. IJCAI'17 (Melbourne, Australia: AAAI Press):  220–227. ISBN 978-0-9992411-0-3. https://dl.acm.org/doi/10.5555/3171642.3171675.
1 2 3 4  Turner, Alexander Matt; Smith, Logan Riggs; Shah, Rohin; Critch, Andrew; Tadepalli, Prasad (2021). "Optimal policies tend to seek power". Advances in neural information processing systems.
↑  Turner, Alexander Matt; Tadepalli, Prasad (2022). "Parametrically retargetable decision-makers tend to seek power". Advances in neural information processing systems.
1 2 3 4 5  Bostrom, Nick (2014). Superintelligence: Paths, Dangers, Strategies (1st ed.). USA: Oxford University Press, Inc.. ISBN 978-0-19-967811-2
↑  Turing, Alan (1951). Intelligent machinery, a heretical theory (Speech). Lecture given to '51 Society'. Manchester: The Turing Digital Archive. 2022年9月26日時点のオリジナルよりアーカイブ。2022年7月22日閲覧。
↑  Turing, Alan (15 May 1951). "Can digital computers think?". Automatic Calculating Machines. Episode 2. BBC. Can digital computers think?。
↑  Muehlhauser, Luke (2016年1月29日). “Sutskever on Talking Machines”. Luke Muehlhauser. September 27, 2022時点のオリジナルよりアーカイブ。2022年8月26日閲覧。
↑  Shanahan, Murray (2015). The technological singularity. Cambridge, Massachusetts. ISBN 978-0-262-33182-1. OCLC 917889148. https://www.worldcat.org/oclc/917889148
↑  Rossi, Francesca. “How do you teach a machine to be moral?”. The Washington Post. ISSN 0190-8286.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114137/https://www.washingtonpost.com/news/in-theory/wp/2015/11/05/how-do-you-teach-a-machine-to-be-moral/ September 12, 2022閲覧。
↑  Aaronson, Scott (2022年6月17日). “OpenAI!”. Shtetl-Optimized. August 27, 2022時点のオリジナルよりアーカイブ。September 12, 2022閲覧。
↑  Selman, Bart, Intelligence Explosion: Science or Fiction?,  オリジナルのMay 31, 2022時点におけるアーカイブ。, https://web.archive.org/web/20220531022540/https://futureoflife.org/data/PDF/bart_selman.pdf September 12, 2022閲覧。
↑  McAllester (2014年8月10日). “Friendly AI and the Servant Mission”. Machine Thoughts. September 28, 2022時点のオリジナルよりアーカイブ。September 12, 2022閲覧。
↑  Schmidhuber, Jürgen (2015年3月6日). “I am Jürgen Schmidhuber, AMA!” (Reddit Comment). r/MachineLearning. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月23日閲覧。
1 2 3 4 5  Everitt, Tom; Lea, Gary; Hutter, Marcus (21 May 2018). "AGI Safety Literature Review". arXiv:1805.01109 [cs.AI]。
↑  Shane (2009年8月31日). “Funding safe AGI”. vetta project. October 10, 2022時点のオリジナルよりアーカイブ。September 12, 2022閲覧。
↑  Horvitz, Eric (2016年6月27日). “Reflections on Safety and Artificial Intelligence”. Eric Horvitz. October 10, 2022時点のオリジナルよりアーカイブ。2020年4月20日閲覧。
↑  Chollet, François (2018年12月8日). “The implausibility of intelligence explosion”. Medium. March 22, 2021時点のオリジナルよりアーカイブ。2022年8月26日閲覧。
↑  Marcus, Gary (2022年6月6日). “Artificial General Intelligence Is Not as Imminent as You Might Think”. Scientific American. September 15, 2022時点のオリジナルよりアーカイブ。2022年8月26日閲覧。
↑  Barber, Lynsey (2016年7月31日). “Phew! Facebook's AI chief says intelligent machines are not a threat to humanity”. CityAM. August 26, 2022時点のオリジナルよりアーカイブ。2022年8月26日閲覧。
↑  Harris, Jeremie (2021年6月16日). “The case against (worrying about) existential risk from AI”. Medium. August 26, 2022時点のオリジナルよりアーカイブ。2022年8月26日閲覧。
↑  Rochon, Louis-Philippe; Rossi, Sergio (2015-02-27) (英語). The Encyclopedia of Central Banking. Edward Elgar Publishing. ISBN 978-1-78254-744-0.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114225/https://books.google.com/books?id=6kzfBgAAQBAJ September 13, 2022閲覧。
↑  Ng, Andrew Y.; Russell, Stuart J. (2000-06-29). “Algorithms for Inverse Reinforcement Learning”. Proceedings of the Seventeenth International Conference on Machine Learning. ICML '00 (San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.):  663–670. ISBN 978-1-55860-707-1. https://dl.acm.org/doi/10.5555/645529.657801.
↑  Hadfield-Menell, Dylan; Russell, Stuart J; Abbeel, Pieter; Dragan, Anca (2016). "Cooperative inverse reinforcement learning". Advances in neural information processing systems. Vol. 29. Curran Associates, Inc.
↑  Mindermann, Soren; Armstrong, Stuart (2018). "Occam's razor is insufficient to infer the preferences of irrational agents". Proceedings of the 32nd international conference on neural information processing systems. NIPS'18. Red Hook, NY, USA: Curran Associates Inc. pp. 5603–5614.
↑  Fürnkranz, Johannes; Hüllermeier, Eyke; Rudin, Cynthia; Slowinski, Roman; Sanner, Scott (2014). Marc Herbstritt. “Preference Learning” (英語). Dagstuhl Reports 4 (3):  27 pages. doi:10.4230/DAGREP.4.3.1.  オリジナルのFebruary 10, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230210114221/https://drops.dagstuhl.de/opus/volltexte/2014/4550/ September 12, 2022閲覧。.
↑  Gao, Leo; Schulman, John; Hilton, Jacob (19 October 2022). "Scaling Laws for Reward Model Overoptimization". arXiv:2210.10760 [cs.LG]。
↑  Anderson, Martin (2022年4月5日). “The Perils of Using Quotations to Authenticate NLG Content”. Unite.AI. February 10, 2023時点のオリジナルよりアーカイブ。2022年7月21日閲覧。
1 2  Wiggers, Kyle (2022年2月5日). “Despite recent progress, AI-powered chatbots still have a long way to go”. VentureBeat. July 23, 2022時点のオリジナルよりアーカイブ。2022年7月23日閲覧。
↑  Hendrycks, Dan; Burns, Collin; Basart, Steven; Critch, Andrew; Li, Jerry; Song, Dawn; Steinhardt, Jacob (2021-07-24). “Aligning AI With Shared Human Values”. International Conference on Learning Representations. arXiv:2008.02275.
↑ Perez, Ethan; Huang, Saffron; Song, Francis; Cai, Trevor; Ring, Roman; Aslanides, John; Glaese, Amelia; McAleese, Nat; Irving, Geoffrey (7 February 2022). "Red Teaming Language Models with Language Models". arXiv:2202.03286 [cs.CL]。
Bhattacharyya, Sreejani (2022年2月14日). “DeepMind's "red teaming" language models with language models: What is it?”. Analytics India Magazine. February 13, 2023時点のオリジナルよりアーカイブ。2022年7月23日閲覧。
↑  Anderson, Michael; Anderson, Susan Leigh (2007-12-15). “Machine Ethics: Creating an Ethical Intelligent Agent”. AI Magazine 28 (4):  15. doi:10.1609/aimag.v28i4.2065. ISSN 2371-9621. https://ojs.aaai.org/aimagazine/index.php/aimagazine/article/view/2065 2023年3月14日閲覧。.
↑  Wallach, Wendell; Allen, Colin (2009). Moral Machines: Teaching Robots Right from Wrong. New York: Oxford University Press. ISBN 978-0-19-537404-9.  オリジナルのMarch 15, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230315193012/https://academic.oup.com/pages/op-migration-welcome 2022年7月23日閲覧。
↑  Wiegel, Vincent (2010-12-01). “Wendell Wallach and Colin Allen: moral machines: teaching robots right from wrong”. Ethics and Information Technology 12 (4):  359–361. doi:10.1007/s10676-010-9239-1. ISSN 1572-8439.  オリジナルのMarch 15, 2023時点におけるアーカイブ。. https://web.archive.org/web/20230315193130/https://link.springer.com/article/10.1007/s10676-010-9239-1 2022年7月23日閲覧。.