RakutenAI-7B: Extending Large Language Models for Japanese
Authors: name: Rakuten Group, name: Aaron Levine, name: Connie Huang, name: Chenguang Wang, name: Eduardo Batista, name: Ewa Szymanska, name: Hongyi Ding, name: Hou Wei Chou, name: Jean-François Pessiot, name: Johanes Effendi, name: Justin Chiu, name: Kai Torben Ohlhus, name: Karan Chopra, name: Keiji Shinzato, name: Koji Murakami, name: Lee Xiong, name: Lei Chen, name: Maki Kubota, name: Maksim Tkachenko, name: Miroku Lee, name: Naoki Takahashi, name: Prathyusha Jwalapuram, name: Ryutaro Tatsushima, name: Saurabh Jain, name: Sunil Kumar Yadav, name: Ting Cai, name: Wei-Te Chen, name: Yandi Xia, name: Yuki Nakayama, name: Yutaka Higashiyama

We introduce RakutenAI-7B, a suite of Japanese-oriented large language models
that achieve the best performance on the Japanese LM Harness benchmarks among
the open 7B models. Along with the foundation model, we release instruction-
and chat-tuned models, RakutenAI-7B-instruct and RakutenAI-7B-chat
respectively, under the Apache 2.0 license.