[36] Neel Nanda. Mechanistic interpretability quickstart guide. https://www.neelnanda.io/monic-interpretability/quickstart, 2023.
[37] Nin_kat. "New jailbreak based on virtual functions smuggle". https://old.reddit.com/r/ChatGPT/comments/10urbdj/new_jailbreak_based_on_virtual-functions_smuggle/, 2023.
[38] OpenAI. GPT-4 technical report. arXiv preprint 2303.08774, 2023.
[39] OpenAI. Models. OpenAI API Documentation, 2023. URL https://platform.openai.com/docs/models/.
[40] OpenAI. Our approach to AI safety. https://openai.com/blog/our-approach-to-ai-safety, 2023.
[41] Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 2022.
[42] Ethan Perez, Saffron Huang, H. Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. Red teaming language models with language models. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3419-3448, 2022.
[43] Roman Semenov. "The new jailbreak is so fun". https://twitter.com/semenov_roman/_status/1621465137025613825, 2023.
[44] Omar Shaikh, Hongxin Zhang, William Held, Michael Bernstein, and Diyi Yang. On second thought, let's not think step by step! Bias and toxicity in zero-shot reasoning. arXiv preprint arXiv:2212.08061, 2022.
[45] Irene Solaiman and Christy Dennison. Process for adapting language models to society (PALMS) with values-targeted datasets. Advances in Neural Information Processing Systems, 34:5861-5873, 2021.
[46] Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. Learning to summarize with human feedback. Advances in Neural Information Processing Systems, 33:3008-3021, 2020.
[47] Zhiqing Sun, Yikang Shen, Qinhong Zhou, Hongxin Zhang, Zhenfang Chen, David Cox, Yiming Yang, and Chuang Gan. Principle-driven self-alignment of language models from scratch with minimal human supervision. arXiv preprint arXiv:2305.03047, 2023.
[48] walkerspider. DAN is my new friend. https://old.reddit.com/r/ChatGPT/comments/zl_cyr9/dan_is_my_new FRIEND/, 2022.
[49] Eric Wallace, Shi Feng, Nikhil Kandpal, Matt Gardner, and Sameer Singh. Universal adversarial triggers for attacking and analyzing NLP. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pages 2153-2162, 2019.
[50] Boxin Wang, Wei Ping, Chaowei Xiao, Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Bo Li, Anima Anandkumar, and Bryan Catanzaro. Exploring the limits of domain-adaptive training for detoxifying large-scale language models. In Advances in Neural Information Processing Systems, 2022.
[51] Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. Emergent abilities of large language models. arXiv preprint arXiv:2206.07682, 2022.
[52] Johannes Welbl, Amelia Glaese, Jonathan Uesato, Sumanth Dathathri, John Mellor, Lisa Anne Hendricks, Kirsty Anderson, Pushmeet Kohli, Ben Coppin, and Po-Sen Huang. Challenges in detoxifying language models. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 2447-2469, 2021.