Paperswithcode
š
59
Mirror of paperswithcode.co served as a Hugging Face Space.
Chioma Nwabasa
chidchick
Ā·
AI & ML interests
None yet
Recent Activity
liked a Space 5 days ago
huggingface/paperswithcode liked a dataset 5 days ago
huggingface/DEH-image-scan-data liked a model 5 days ago
DavidAU/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-ULTRA-HERETIC-UncensoredOrganizations
None yet
liked a
Space 5 days ago
liked a
dataset 5 days ago
liked a
model 5 days ago
upvoted an article 5 days ago
Article
OpenRouter Leaderboard: 425 Models by Price, Measured Speed and Korean Quality
ginigen-ai
ā¢ ā¢ 12 reacted to ginigen-ai's post with š 5 days ago
Post
2936
OpenRouter Leaderboard ā every model, every provider, one comparable table. Price, precision, uptime, measured latency and language quality on the same axes.
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics ā only 8.5% earn an A
Knowledge of Korean institutions ā 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks ā it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
š https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard š ginigen-ai/open-router-leaderboard
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics ā only 8.5% earn an A
Knowledge of Korean institutions ā 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks ā it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
š https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard š ginigen-ai/open-router-leaderboard