大型语言模型列表
参考资料

↑  . openai.com. June 11, 2018  [2023-03-18]. （原始内容存档于2023-03-18）.
↑  . GitHub.   [2 January 2024]. （原始内容存档于19 May 2023）.
1 2  Devlin, Jacob; Chang, Ming-Wei; Lee, Kenton; Toutanova, Kristina. . 11 October 2018. arXiv:1810.04805v2  [cs.CL].
↑  Prickett, Nicole Hemsoth. . The Next Platform. 2021-08-24  [2023-06-20]. （原始内容存档于2023-06-20）.
↑  . March 13, 2023  [March 13, 2023]. （原始内容存档于January 13, 2021） –GitHub.
↑  Manning, Christopher D. . Daedalus. 2022, 151 (2): 127–138  [2023-03-09]. S2CID 248377870. doi:10.1162/daed_a_01905 . （原始内容存档于2023-11-17）.
↑  Patel, Ajay; Li, Bryan; Rasooli, Mohammad Sadegh; Constant, Noah; Raffel, Colin; Callison-Burch, Chris. . 2022. arXiv:2209.14500  [cs.LG].
↑  Devlin, Jacob; Chang, Ming-Wei; Lee, Kenton; Toutanova, Kristina. . 11 October 2018. arXiv:1810.04805v2  [cs.CL].
1 2  Raffel, Colin; Shazeer, Noam; Roberts, Adam; Lee, Katherine; Narang, Sharan; Matena, Michael; Zhou, Yanqi; Li, Wei; Liu, Peter J. . Journal of Machine Learning Research. 2020, 21 (140): 1–67. ISSN 1533-7928. arXiv:1910.10683 .
↑  , Google Research, 2024-04-02  [2024-04-04], （原始内容存档于2024-03-29）
↑  . imagen.research.google.   [2024-04-04]. （原始内容存档于2024-03-27）.
↑  . huggingface.co.   [2024-08-05]. （原始内容存档于2024-08-05）.
↑  . GitHub.   [2 January 2024]. （原始内容存档于2 January 2024）.
↑  Yang, Zhilin; Dai, Zihang; Yang, Yiming; Carbonell, Jaime; Salakhutdinov, Ruslan; Le, Quoc V. . 2 January 2020. arXiv:1906.08237  [cs.CL].
↑  . OpenAI. 2019-11-05  [2019-11-14]. （原始内容存档于2019-11-14） （英语）.
↑  . openai.com.   [2023-03-13]. （原始内容存档于2023-03-16）.
1 2  . lambdalabs.com. 3 June 2020  [13 March 2023]. （原始内容存档于27 March 2023）.
1 2  . huggingface.co.   [2024-07-24]. （原始内容存档于2024-07-24）.
↑  . GitHub.   [13 March 2023]. （原始内容存档于11 March 2023）.
↑  Wiggers, Kyle. . TechCrunch. 28 April 2022  [9 March 2023]. （原始内容存档于16 March 2023）.
↑  Table D.1 in Brown, Tom B.; Mann, Benjamin; Ryder, Nick; Subbiah, Melanie; Kaplan, Jared; Dhariwal, Prafulla; Neelakantan, Arvind; Shyam, Pranav; Sastry, Girish; Askell, Amanda; Agarwal, Sandhini; Herbert-Voss, Ariel; Krueger, Gretchen; Henighan, Tom; Child, Rewon; Ramesh, Aditya; Ziegler, Daniel M.; Wu, Jeffrey; Winter, Clemens; Hesse, Christopher; Chen, Mark; Sigler, Eric; Litwin, Mateusz; Gray, Scott; Chess, Benjamin; Clark, Jack; Berner, Christopher; McCandlish, Sam; Radford, Alec; Sutskever, Ilya; Amodei, Dario. . May 28, 2020. arXiv:2005.14165v4  [cs.CL].
↑  . OpenAI. 2022-11-30  [2023-01-13]. （原始内容存档于2022-11-30）.
↑  . March 15, 2023  [March 12, 2023]. （原始内容存档于March 12, 2023） –GitHub.
1 2 3  Gao, Leo; Biderman, Stella; Black, Sid; Golding, Laurence; Hoppe, Travis; Foster, Charles; Phang, Jason; He, Horace; Thite, Anish; Nabeshima, Noa; Presser, Shawn; Leahy, Connor. . 31 December 2020. arXiv:2101.00027  [cs.CL].
1 2  Iyer, Abhishek. . VentureBeat. 15 May 2021  [13 March 2023]. （原始内容存档于9 March 2023）.
↑  . www.forefront.ai.   [2023-02-28]. （原始内容存档于2023-03-09）.
1 2 3 4  Dey, Nolan; Gosal, Gurpreet; Zhiming; Chen; Khachane, Hemant; Marshall, William; Pathria, Ribhu; Tom, Marvin; Hestness, Joel. . 2023-04-01. arXiv:2304.03208  [cs.LG].
↑  Alvi, Ali; Kharya, Paresh. . Microsoft Research. 11 October 2021  [13 March 2023]. （原始内容存档于13 March 2023）.
1 2  Smith, Shaden; Patwary, Mostofa; Norick, Brandon; LeGresley, Patrick; Rajbhandari, Samyam; Casper, Jared; Liu, Zhun; Prabhumoye, Shrimai; Zerveas, George; Korthikanti, Vijay; Zhang, Elton; Child, Rewon; Aminabadi, Reza Yazdani; Bernauer, Julie; Song, Xia. . 2022-02-04. arXiv:2201.11990  [cs.CL].
1 2  Rajbhandari, Samyam; Li, Conglong; Yao, Zhewei; Zhang, Minjia; Aminabadi, Reza Yazdani; Awan, Ammar Ahmad; Rasley, Jeff; He, Yuxiong, , 2022-07-21, arXiv:2201.05596
↑  Wang, Shuohuan; Sun, Yu; Xiang, Yang; Wu, Zhihua; Ding, Siyu; Gong, Weibao; Feng, Shikun; Shang, Junyuan; Zhao, Yanbin; Pang, Chao; Liu, Jiaxiang; Chen, Xuyi; Lu, Yuxiang; Liu, Weixin; Wang, Xi; Bai, Yangfan; Chen, Qiuliang; Zhao, Li; Li, Shiyong; Sun, Peng; Yu, Dianhai; Ma, Yanjun; Tian, Hao; Wu, Hua; Wu, Tian; Zeng, Wei; Li, Ge; Gao, Wen; Wang, Haifeng. . December 23, 2021. arXiv:2112.12731  [cs.CL].
↑  . Anthropic.   [14 March 2023]. （原始内容存档于16 March 2023）.
1 2  Askell, Amanda; Bai, Yuntao; Chen, Anna;  et al. . 9 December 2021. arXiv:2112.00861  [cs.CL].
↑  Bai, Yuntao; Kadavath, Saurav; Kundu, Sandipan;  et al. . 15 December 2022. arXiv:2212.08073  [cs.CL].
1 2 3  Dai, Andrew M; Du, Nan. . ai.googleblog.com. December 9, 2021  [2023-03-09]. （原始内容存档于2023-03-12）.
↑  . www.deepmind.com. 8 December 2021  [20 March 2023]. （原始内容存档于20 March 2023）.
1 2 3  Hoffmann, Jordan; Borgeaud, Sebastian; Mensch, Arthur;  et al. . 29 March 2022. arXiv:2203.15556  [cs.CL].
1 2 3 4  Table 20 and page 66 of PaLM: Scaling Language Modeling with Pathways 的存檔，存档日期2023-06-10.
1 2  Cheng, Heng-Tze; Thoppilan, Romal. . ai.googleblog.com. January 21, 2022  [2023-03-09]. （原始内容存档于2022-03-25）.
↑  Thoppilan, Romal; De Freitas, Daniel; Hall, Jamie; Shazeer, Noam; Kulshreshtha, Apoorv; Cheng, Heng-Tze; Jin, Alicia; Bos, Taylor; Baker, Leslie; Du, Yu; Li, YaGuang; Lee, Hongrae; Zheng, Huaixiu Steven; Ghafouri, Amin; Menegali, Marcelo. . 2022-01-01. arXiv:2201.08239  [cs.CL].
↑  Black, Sidney; Biderman, Stella; Hallahan, Eric;  et al. . Proceedings of BigScience Episode #5 – Workshop on Challenges & Perspectives in Creating Large Language Models. Proceedings of BigScience Episode #5 – Workshop on Challenges & Perspectives in Creating Large Language Models: 95–136. 2022-05-01  [2022-12-19]. （原始内容存档于2022-12-10）.
1 2 3  Hoffmann, Jordan; Borgeaud, Sebastian; Mensch, Arthur; Sifre, Laurent. . Deepmind Blog. 12 April 2022  [9 March 2023]. （原始内容存档于13 April 2022）.
↑  Narang, Sharan; Chowdhery, Aakanksha. . ai.googleblog.com. April 4, 2022  [2023-03-09]. （原始内容存档于2022-04-04） （英语）.
↑  Susan Zhang; Mona Diab; Luke Zettlemoyer. . ai.facebook.com.   [2023-03-12]. （原始内容存档于2023-03-12）.
↑  Zhang, Susan; Roller, Stephen; Goyal, Naman; Artetxe, Mikel; Chen, Moya; Chen, Shuohui; Dewan, Christopher; Diab, Mona; Li, Xian; Lin, Xi Victoria; Mihaylov, Todor; Ott, Myle; Shleifer, Sam; Shuster, Kurt; Simig, Daniel; Koura, Punit Singh; Sridhar, Anjali; Wang, Tianlu; Zettlemoyer, Luke. . 21 June 2022. arXiv:2205.01068  [cs.CL].
↑  . GitHub.   [2024-10-18] （英语）.
1 2  Khrushchev, Mikhail; Vasilev, Ruslan; Petrov, Alexey; Zinov, Nikolay, , 2022-06-22  [2023-03-18], （原始内容存档于2023-06-16）
1 2  Lewkowycz, Aitor; Andreassen, Anders; Dohan, David; Dyer, Ethan; Michalewski, Henryk; Ramasesh, Vinay; Slone, Ambrose; Anil, Cem; Schlag, Imanol; Gutman-Solo, Theo; Wu, Yuhuai; Neyshabur, Behnam; Gur-Ari, Guy; Misra, Vedant. . 30 June 2022. arXiv:2206.14858  [cs.CL].
↑  . ai.googleblog.com. 30 June 2022  [20 March 2023].
↑  Ananthaswamy, Anil. . Nature. 8 March 2023, 615 (7951): 202–205  [9 March 2023]. Bibcode:2023Natur.615..202A. PMID 36890378. S2CID 257380916. doi:10.1038/d41586-023-00641-w. （原始内容存档于16 March 2023）.
↑  . huggingface.co.   [2023-03-13]. （原始内容存档于2023-04-12）.
↑  Taylor, Ross; Kardas, Marcin; Cucurull, Guillem; Scialom, Thomas; Hartshorn, Anthony; Saravia, Elvis; Poulton, Andrew; Kerkez, Viktor; Stojnic, Robert. . 16 November 2022. arXiv:2211.09085  [cs.CL].
↑  . Amazon Science. 2 August 2022  [12 March 2023]. （原始内容存档于15 March 2023）.
↑  Soltan, Saleh; Ananthakrishnan, Shankar; FitzGerald, Jack;  et al. . 3 August 2022. arXiv:2208.01448  [cs.CL].
↑  . aws.amazon.com. 17 November 2022  [13 March 2023]. （原始内容存档于13 March 2023）.
1 2 3  . Meta AI. 24 February 2023  [9 March 2023]. （原始内容存档于3 March 2023）.
1 2 3  . huggingface.co.   [2023-06-20]. （原始内容存档于2023-06-20）.
↑   (PDF). OpenAI. 2023  [March 14, 2023]. （原始内容存档 (PDF)于March 14, 2023）.
↑  Schreiner, Maximilian. . THE DECODER. 2023-07-11  [2024-07-26]. （原始内容存档于2023-07-12） （美国英语）.
↑  Dickson, Ben. . VentureBeat. 22 May 2024.
↑  Dey, Nolan. . Cerebras. March 28, 2023  [March 28, 2023]. （原始内容存档于March 28, 2023）.
↑  . tii.ae.   [2023-04-03]. （原始内容存档于2023-04-03）.
↑  Penedo, Guilherme; Malartic, Quentin; Hesslow, Daniel; Cojocaru, Ruxandra; Cappelli, Alessandro; Alobeidli, Hamza; Pannier, Baptiste; Almazrouei, Ebtesam; Launay, Julien. . 2023-06-01. arXiv:2306.01116  [cs.CL].
↑  . huggingface.co. 2023-06-09  [2023-06-20].
↑  UAE's Falcon 40B, World's Top-Ranked AI Model from Technology Innovation Institute, is Now Royalty-Free 的存檔，存档日期2024-02-08., 31 May 2023
↑  Wu, Shijie; Irsoy, Ozan; Lu, Steven; Dabravolski, Vadim; Dredze, Mark; Gehrmann, Sebastian; Kambadur, Prabhanjan; Rosenberg, David; Mann, Gideon. . March 30, 2023. arXiv:2303.17564  [cs.LG].
↑  Ren, Xiaozhe; Zhou, Pingyi; Meng, Xinfan; Huang, Xinjing; Wang, Yadao; Wang, Weichao; Li, Pengfei; Zhang, Xiaoda; Podolskiy, Alexander; Arshinov, Grigory; Bout, Andrey; Piontkovskaya, Irina; Wei, Jiansheng; Jiang, Xin; Su, Teng; Liu, Qun; Yao, Jun. . March 19, 2023. arXiv:2303.10845  [cs.CL].
↑  Köpf, Andreas; Kilcher, Yannic; von Rütte, Dimitri; Anagnostidis, Sotiris; Tam, Zhi-Rui; Stevens, Keith; Barhoum, Abdullah; Duc, Nguyen Minh; Stanley, Oliver; Nagyfi, Richárd; ES, Shahul; Suri, Sameer; Glushkov, David; Dantuluri, Arnav; Maguire, Andrew. . 2023-04-14. arXiv:2304.07327  [cs.CL].
↑  Wrobel, Sharon. . www.timesofisrael.com.   [2023-07-24]. （原始内容存档于2023-07-24）.
↑  Wiggers, Kyle. . TechCrunch. 2023-04-13  [2023-07-24]. （原始内容存档于2023-07-24）.
1 2  Elias, Jennifer. . CNBC. 16 May 2023  [18 May 2023]. （原始内容存档于16 May 2023）.
↑  . Google. May 10, 2023  [May 18, 2023]. （原始内容存档于May 18, 2023）.
1 2  . Meta AI. 2023  [2023-07-19]. （原始内容存档于2024-01-05）.
↑  . GitHub.   [2024-05-28]. （原始内容存档于2024-05-28）.
↑  . anthropic.com.   [12 December 2023]. （原始内容存档于15 December 2023）.
↑  Nirmal, Dinesh. . IBM Blog. 2023-09-07  [2024-08-11]. （原始内容存档于2024-07-22） （美国英语）.
↑  . Mistral. 2023  [2023-10-06]. （原始内容存档于2024-01-06）.
↑  . anthropic.com.   [12 December 2023]. （原始内容存档于15 December 2023）.
↑  , xai-org, 2024-03-19  [2024-03-19], （原始内容存档于2024-05-28）
↑  . x.ai.   [12 December 2023].
↑  . deepmind.google.   [12 December 2023]. （原始内容存档于8 December 2023）.
↑  Franzen, Carl. . VentureBeat. 11 December 2023  [12 December 2023]. （原始内容存档于11 December 2023）.
↑  . mistral.ai. 11 December 2023  [12 December 2023]. （原始内容存档于13 February 2024）.
↑  AI, Mistral. . mistral.ai. 2024-04-17  [2024-05-05]. （原始内容存档于2024-05-05）.
1 2  DeepSeek-AI; Bi, Xiao; Chen, Deli; Chen, Guanting; Chen, Shanhuang; Dai, Damai; Deng, Chengqi; Ding, Honghui; Dong, Kai, , 2024-01-05, arXiv:2401.02954
1 2  Hughes, Alyssa. . Microsoft Research. 12 December 2023  [13 December 2023]. （原始内容存档于12 December 2023）.
↑  . Google. 15 February 2024  [16 February 2024]. （原始内容存档于16 February 2024）. This means 1.5 Pro can process vast amounts of information in one go — including 1 hour of video, 11 hours of audio, codebases with over 30,000 lines of code or over 700,000 words. In our research, we’ve also successfully tested up to 10 million tokens.
↑   –GitHub.
↑  . www.anthropic.com.   [2024-03-04]. （原始内容存档于2024-03-04）.
↑  . huggingface.co.   [2024-05-17]. （原始内容存档于2024-05-17）.
↑  . azure.microsoft.com. 23 April 2024  [2024-04-28]. （原始内容存档于2024-04-27）.
↑  . huggingface.co.   [2024-04-28]. （原始内容存档于2024-05-13）.
↑  . GitHub.   [2024-06-17]. （原始内容存档于2024-06-17）.
↑  DeepSeek-AI; Liu, Aixin; Feng, Bei; Wang, Bin; Wang, Bingxuan; Liu, Bo; Zhao, Chenggang; Dengr, Chengqi; Ruan, Chong, , 2024-06-19, arXiv:2405.04434
↑  . huggingface.co. 2024-06-14  [2024-06-15]. （原始内容存档于2024-06-15）.
↑  . research.nvidia.com.   [2024-06-15]. （原始内容存档于2024-06-15）.
↑  "The Llama 3 Herd of Models" (July 23, 2024) Llama Team, AI @ Meta
↑  . GitHub.   [2024-07-23]. （原始内容存档于2024-07-23） （英语）.
↑  , DeepSeek, 2024-12-26  [2024-12-26]
↑  , Amazon, 2024-12-27  [2024-12-27]
↑  , DeepSeek, 2025-01-21  [2025-01-21]
↑  DeepSeek-AI; Guo, Daya; Yang, Dejian; Zhang, Haowei; Song, Junxiao; Zhang, Ruoyu; Xu, Runxin; Zhu, Qihao; Ma, Shirong, , 2025-01-22, arXiv:2501.12948
↑  Qwen; Yang, An; Yang, Baosong; Zhang, Beichen; Hui, Binyuan; Zheng, Bo; Yu, Bowen; Li, Chengyuan; Liu, Dayiheng, , 2025-01-03, arXiv:2412.15115
1 2  MiniMax; Li, Aonian; Gong, Bangwei; Yang, Bo; Shan, Boji; Liu, Chang; Zhu, Cheng; Zhang, Chunhao; Guo, Congchao, , 2025-01-14  [2025-01-26], arXiv:2501.08313
↑  , MiniMax, 2025-01-26  [2025-01-26]
↑  Kavukcuoglu, Koray. . Google.   [6 February 2025].
↑  . Google for Developers.   [6 February 2025].
↑  Franzen, Carl. . VentureBeat. 5 February 2025  [6 February 2025].
|  论 编自然语言处理 |
| --- | --- |
一般术语:  语料库  口语语料库  停用词  词袋  完全人工智慧（英语：）  n元语法（双字母组、三元语法（英语：）） 
文本挖掘:  文本分割  词性标注（英语：）  拆句处理（英语：）  复合词处理（英语：）  搭配提取（英语：）  词干提取  词形还原  命名实体识别  指代  文本情感分析  概念挖掘（英语：）  语法分析  词义消歧  术语提取（英语：）  真实大小写处理（英语：） 
自动摘要（英语：）:  多文档摘要（英语：）  句子抽取（英语：）  文本简化（英语：） 
分佈語義（英语：）模型:  潜在语义学  Seq2Seq模型  Word2vec  語言模型 大型语言模型 基础模型  LLaMA  ChatGPT  GPT-4  文心一言  词嵌入 
机器翻译:  電腦輔助翻譯  基于实例（英语：）  基于规则（英语：） 
自动识别与数据采集:  语音识别  语音合成  光学字符识别  自然语言生成  提示工程 
主题模型:  弹珠分布（英语：）  隐含狄利克雷分布  潜在语义索引 
计算机辅助审查（英语：）:  自动作文评分（英语：）  语料库检索工具（英语：）  文法检查器（英语：）  预测文本（英语：）  拼寫檢查  语法猜测（英语：） 
自然语言用户界面（英语：）:  自动在线助手  聊天機器人  文字冒险游戏  問答系統