[1] Adversa. Universal LLM jailbreak: ChatGPT, GPT-4, Bard, Bing, Anthropic, and beyond. Adversa Blog, 2023. URL https://adversa.ai/blog/universal-llm-jailbreak-chatgpt-gpt-4-bard-bing-anthropic-and-beyond/.
[2] Alex Albert. Jailbreak Chat. https://www.jailbreakchat.com/, 2023.
[3] Alex Albert. Jailbreak Chat. https://web.archive.org/web/20230413032954/https://www.jailbreakchat.com/, 2023.
[4] Anthropic. Anthropic API reference. https://web.archive.org/web/20230519130926/h. https://console.anthropic.com/docs/api/reference, 2023.
[5] Anthropic. "We are offering a new version of our model, Claude-v1.3, that is safer and less susceptible to adversarial attacks". https://twitter.com/AnthropicAI/status/1648353600350060545, 2023.
[6] Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862, 2022.
[7] Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al. Constitutional AI: Harmlessness from AI feedback. arXiv preprint arXiv:2212.08073, 2022.
[8] Boaz Barak. "Another jailbreak for GPT4: Talk to it in Morse code". https://twitter.com/boazbaraktcs/status/1637657623100096513, 2023.
[9] Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258, 2021.
[10] Greg Brockman. "Deploying GPT-4 subject to adversarial pressures of real world has been a great practice run for practical AI alignment. Just getting started, but encouraged by degree of alignment we've achieved so far (and the engineering process we've been maturing to improve issues)". https://twitter.com/gdb/status/1641560965442576385, 2023.
[11] Greg Brockman, Atty Eleti, Elie Georges, Joanne Jang, Logan Kilpatrick, Rachel Lim, Luke Miller, and Michelle Pokrass. Introducing ChatGPT and Whisper APIs. OpenAI Blog, 2023. URL https://openai.com/blog/introducing-chatgpt-and-whisper-apis.
[12] Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in Neural Information Processing Systems, 33:1877-1901, 2020.
[13] Matt Burgess. The hacking of ChatGPT is just getting started. Wired, 2023.
[14] Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom B Brown, Dawn Song, Ulfar Erlingsson, et al. Extracting training data from large language models. In USENIX Security Symposium, volume 6, 2021.
[15] Anirban Chakraborty, Manaar Alam, Vishal Dey, Anupam Chattopadhyay, and Debdeep Mukhopadhyay. Adversarial attacks and defences: A survey. arXiv preprint arXiv:1810.00069, 2018.
[16] W.C. Christensen and F.A. Manuele. Safety Through Design. American Society of Mechanical Engineers, 1999.
[17] Jon Christian. Amazing “jailbreak” bypasses ChatGPT's ethics safeguards. Futurism, 2023.
[18] Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. Deep reinforcement learning from human preferences. Advances in neural information processing systems, 30, 2017.