[125] H. Nori, N. King, S. M. McKinney, D. Carignan, and E. Horvitz. Capabilities of gpt-4 on medical challenge problems. arXiv preprint arXiv:2303.13375, 2023.
[126] OpenAI. ChatGPT. https://chat.openai.com, 2022.
[127] OpenAI. GPT documentation. https://platform.openai.com/docs/guides/chat/introduction, 2022.
[128] OpenAI. GPT-4 technical report. arXiv, 2023.
[129] Y. Oren, S. Sagawa, T. B. Hashimoto, and P. Liang. Distributionally robust language modeling. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 4227-4237, Hong Kong, China, Nov. 2019. Association for Computational Linguistics. doi: 10.18653/v1/D19-1432. URL https://aclanthology.org/D19-1432.
[130] L. Ouyang, J. Wu, X. Jiang, D. Almeida, C. Wainwright, P. Mishkin, C. Zhang, S. Agarwal, K. Slama, A. Ray, et al. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730-27744, 2022.
[131] A. Pan, J. S. Chan, A. Zou, N. Li, S. Basart, T. Woodside, J. Ng, H. Zhang, S. Emmons, and D. Hendrycks. Do the rewards justify the means? measuring trade-offs between rewards and ethical behavior in the MACHIAVELLI benchmark. CoRR, abs/2304.03279, 2023.
[132] A. Panda, T. Wu, J. T. Wang, and P. Mittal. Differentially private in-context learning. arXiv preprint arXiv:2305.01639, 2023.
[133] E. Parliament. Amendments adopted by the european parliament on 14 june 2023 on the proposal for a regulation of the european parliament and of the council on laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts. https://www.europarl.europa.eu/doceo/document/TA-9-2023-0236_EN.pdf, 2023.
[134] A. Parrish, A. Chen, N. Nangia, V. Padmakumar, J. Phang, J. Thompson, P. M. Htut, and S. R. Bowman. BBQ: A hand-built bias benchmark for question answering, 2022.
[135] F. Perez and I. Ribeiro. Ignore previous prompt: Attack techniques for language models. CoRR, abs/2211.09527, 2022.
[136] Pew Research Center. Majority of Latinos say skin color impacts opportunity in america and shapes daily life. 2021. URL https://www.pewresearch.org/hispanic/2021/11/04/majority-of-latinos-say-skin-color-impacts-opportunity-in-america-and-shapes-daily-life/.
[137] F. Qi, Y. Chen, X. Zhang, M. Li, Z. Liu, and M. Sun. Mind the style of text! adversarial and backdoor attacks based on text style transfer. In EMNLP, 2021.
[138] F. Qi, M. Li, Y. Chen, Z. Zhang, Z. Liu, Y. Wang, and M. Sun. Hidden killer: Invisible textual backdoor attacks with syntactic trigger. In ACL-IJCNLP, 2021.
[139] H. Qiu, S. Zhang, A. Li, H. He, and Z. Lan. Latent jailbreak: A benchmark for evaluating text safety and output robustness of large language models. ArXiv, abs/2307.08487, 2023. URL https://api_semanticscholar.org/CorpusID:259937347.
[140] C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1-67, 2020. URL http://jmlr.org/papers/v21/20-074.html.
[141] B. Ray Chaudhury, L. Li, M. Kang, B. Li, and R. Mehta. Fairness in federated learning via core-stability. Advances in neural information processing systems, 35:5738-5750, 2022.
[142] L. Reynolds and K. McDonell. Prompt programming for large language models: Beyond the few-shot paradigm. In In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 2021.
[143] M. T. Ribeiro, T. Wu, C. Guestrin, and S. Singh. Beyond accuracy: Behavioral testing of NLP models with checklist (extended abstract). In Z. Zhou, editor, Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, IJCAI 2021, Virtual Event / Montreal, Canada, 19-27 August 2021, pages 4824-4828. ijcai.org, 2021. doi: 10.24963/ ijcai.2021/659. URL https://doi.org/10.24963/ijcai.2021/659.