RakutenAI-7B: Extending Large Language Models for Japanese
Authors: name: Rakuten Group; name: Aaron Levine; name: Connie Huang; name: Chenguang Wang; name: Eduardo Batista; name: Ewa Szymanska; name: Hongyi Ding; name: Hou Wei Chou; name: Jean-François Pessiot; name: Johanes Effendi; name: Justin Chiu; name: Kai Torben Ohlhus; name: Karan Chopra; name: Keiji Shinzato; name: Koji Murakami; name: Lee Xiong; name: Lei Chen; name: Maki Kubota; name: Maksim Tkachenko; name: Miroku Lee; name: Naoki Takahashi; name: Prathyusha Jwalapuram; name: Ryutaro Tatsushima; name: Saurabh Jain; name: Sunil Kumar Yadav; name: Ting Cai; name: Wei-Te Chen; name: Yandi Xia; name: Yuki Nakayama; name: Yutaka Higashiyama
Published: 2024-03-21 06:56:07

Abstract: We introduce RakutenAI-7B, a suite of Japanese-oriented large language models
that achieve the best performance on the Japanese LM Harness benchmarks among
the open 7B models. Along with the foundation model, we release instruction-
and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat
respectively, under the Apache 2.0 license.