LLM-jp

The LLM Study Group LLM-jp consists of over 1000 participants including researchers and engineers in natural language processing and computer systems from universities and corporations organized under the auspices of the National Institute of Informatics (NII) in Tokyo, Japan.

The main goals are to collaboratively work on building open-source LLMs that are proficient in Japanese, to share information on LLM research and development, to promote cross-organizational collaborations among researchers, to release models, tools, and technical materials to the public.

For more details, please refer to the website https://llm-jp.nii.ac.jp/

Checkpoints format: transformers (Megatron-DeepSpeed format available here)