open-llm-leaderboard/open_llm_leaderboard

Resource: Understanding the new benchmarks

pinned

2

#796 opened 6 months ago by

rombodawg

💬 Discussion thread: Model contamination techniques 💬

pinned

34

#472 opened about 1 year ago by

clefourrier

💎 Resources and community initiatives around the Leaderboard! 💎

pinned

#174 opened over 1 year ago by

clefourrier

Model removal

#1048 opened about 10 hours ago by

MultivexAI

docker-container-test

#1047 opened 1 day ago by

alozowski

Open LLM Leaderboard Results Dataset

#1046 opened 2 days ago by

natalialanzoni

Normalization for MuSR object placement

1

#1040 opened 8 days ago by

recojt

update ranking number when editing filters

3

#1036 opened 11 days ago by

clem

Requested feature: searchable tags for official supported languages for each model.

#1035 opened 11 days ago by

Reza2kn

Proposal for new column

2

#1032 opened 12 days ago by

Yuma42

I can't replicate results.

5

#1016 opened about 1 month ago by

Pretergeek

merged models marked as non merged in the leaderboard

3

#993 opened about 2 months ago by

fblgit

Feature Request: change request file format to disambiguate chat and non-chat models?

3

#954 opened 3 months ago by

CombinHorizon

Are Qwen models pretrained or continuously pretrained?

7

#941 opened 3 months ago by

djstrong

Feature request: Add toggle to only show models with linked dataset

1

#763 opened 7 months ago by

ThiloteE

Feature request: Hide models with insufficient model card from default view in leaderboard

4

#762 opened 7 months ago by

ThiloteE

Discussion: naming pattern to converge on to better identify fine-tunes

17

#761 opened 7 months ago by

ThiloteE

Crowd-Source Hardware for the LeaderBoard?

4

#570 opened 11 months ago by

ibivibiv

Feature request: Using weights hash to identify duplicates

1

#422 opened about 1 year ago by

mrfakename

Tool: Adding evaluation results to model cards

47

#370 opened about 1 year ago by

Weyaxi

Feature suggestion: average of selected (rather than all) columns

4

#368 opened about 1 year ago by

Minus0

Tool: Open LLM Leaderboard Model Renamer

31

#310 opened about 1 year ago by

Weyaxi