[20] GAO, L., BIDERMAN, S., BLACK, S., GOLDING, L., HOPPE, T., FOSTER, C., PHANG, J., HE, H., THITE, A., NABESHIMA, N., ET AL. The pile: An 800gb dataset of diverse text for language modeling. arXiv preprint arXiv:2101.00027 (2020).
[21] GARCIA, N., HIROTA, Y., WU, Y., AND NAKASHIMA, Y. Uncurated image-text datasets: Shedding light on demographic bias. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2023), pp. 6957-6966.
[22] GARG, T., MASUD, S., SURESH, T., AND CHAKRABORTY, T. Handling bias in toxic speech detection: A survey. ACM Computing Surveys (2022).
[23] GEBRU, T., MORGENSTERN, J., VECCHIONE, B., VAUGHAN, J. W., WALLACH, H., III, H. D., AND CRAWFORD, K. Datasheets for datasets. Communications of the ACM 64, 12 (2021), 86-92.
[24] GEHMAN, S., GURURANGAN, S., SAP, M., CHOI, Y., AND SMITH, N. A. Realtoxicityprompts: Evaluating neural toxic degeneration in language models. arXiv preprint arXiv:2009.11462 (2020).
[25] GICHOYA, J. W., BANERJEE, I., BHIMIREDDY, A. R., BURNS, J. L., CELI, L. A., CHEN, L.-C., CORREA, R., DULLERUD, N., GHASSEMI, M., HUANG, S.-C., ET AL. Ai recognition of patient race in medical imaging: a modelling study. The Lancet Digital Health 4, 6 (2022), e406-e414.
[26] HANNA, A., AND PARK, T. M. Against scale: Provocations and resistances to scale thinking. arXiv preprint arXiv:2010.08850 (2020).
[27] HANU, L., AND UNITARY TEAM. Detoxify. Github. https://github.com/unitaryai/detoxify, 2020.
[28] HEAVEN, W. D. Generative ai is changing everything. but what's left when the hype is gone? https://www.technologyreview.com/2022/12/16/1065005/generative-ai-revolution-art/, Dec 2022. (Accessed on 04/21/2023).
[29] HESTNESS, J., NARANG, S., ARDALANI, N., DIAMOS, G., JUN, H., KIANINEJAD, H., PATWARY, M., ALI, M., YANG, Y., AND ZHOU, Y. Deep learning scaling is predictable, empirically. arXiv preprint arXiv:1712.00409 (2017).
[30] HOFFMANN, J., BORGEAUD, S., MENsCH, A., BUCHATSKAYA, E., CAI, T., RUTHERFORD, E., CASAS, D. D. L., HENDRICKS, L. A., WELBL, J., CLARK, A., ET AL. Training compute-optimal large language models. arXiv preprint arXiv:2203.15556 (2022).
[31] HUANG, H. The generative ai revolution has begun—how did we get here? | ars technica. https://arstechnica.com/gadgets/2023/01/the-generative-ai-revolution-has-begun-how-did-we-get-here/, Jan 2023. (Accessed on 04/21/2023).
[32] JAHAN, M. S., AND OUSSALAH, M. A systematic review of hate speech automatic detection using natural language processing. arXiv preprint arXiv:2106.00742 (2021).
[33] JIA, C., YANG, Y., XIA, Y., CHEN, Y.-T., PAREKH, Z., PHAM, H., LE, Q. V., SUNG, Y., LI, Z., AND DUERIG, T. Scaling up visual and vision-language representation learning with noisy text supervision. arXiv preprint arXiv:2102.05918 (2021).
[34] JOSHUA LU, R. G. The generative ai revolution will enable anyone to create games | andreessen horowitz. https://a16z.com/2023/03/17/the-generative-ai-revolution/, Mar 2023. (Accessed on 04/21/2023).
[35] KAPLAN, J., MCCANDLISH, S., HENIGHAN, T., BROWN, T. B., CHESS, B., CHILD, R., GRAY, S., RADFORD, A., WU, J., AND AMODEI, D. Scaling laws for neural language models. arXiv preprint arXiv:2001.08361 (2020).
[36] KOCH, B., DENTON, E., HANNA, A., AND FOSTER, J. G. Reduced, reused and recycled: The life of a dataset in machine learning research. arXiv preprint arXiv:2112.01716 (2021).
[37] KUMAR, A., AND SACHDEVA, N. Multimodal cyberbullying detection using capsule network with dynamic routing and deep convolutional neural network. Multimedia Systems (2021), 1-10.
[38] LAURENÇON, H., SAULNIER, L., WANG, T., AKIKI, C., VILLANOVA DEL MORAL, A., LE SCAO, T., VON WERRA, L., MOU, C., GONZÁLEZ PONFERRADA, E., NGUYEN, H., ET AL. The bigscience roots corpus: A 1.6 tb composite multilingual dataset. Advances in Neural Information Processing Systems 35 (2022), 31809-31826.