π The leaderboard is available in both Japanese and English π Based on the evaluation tool, llm-jp-eval with more than 20 datasets for Japanese LLMs π The leaderboard showcases all the metrics for NLP experts, plus averages for NLP beginners π» For the comfort of users, we chose a horizontal UI, and implemented it in a light and dark theme on Gradio π¬ The radar chart provides a very interesting visualization of metrics! π± We are using the Japanese research platform, MDX, so please be patient! β‘ LLMs bigger than +70B will be evaluated soonβ¦
How do you say βGPUs Go Brrrβ in Japanese - > GPUγγγ³γγ³ο½! (To pronounce "GPU ga bunbun!") π₯