updated caching to include size of models
5933808
Clémentine
commited on
Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Commit History
Updated model info to get number of parameters in almost all cases, even without safetensors
301c384
Clémentine
commited on
Fix merge
5da3025
Nathan Habib
commited on
Merge branch 'main' of https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
bc44e71
Nathan Habib
commited on
use cache for model metadata
0799cf8
Nathan Habib
commited on
fixes display for model params that are 0
6e79cea
Clémentine
commited on
type updated
1d49827
Clémentine
commited on
fix list of finished models to include models waiting for new eval
eed1ccd
Nathan Habib
commited on
Fix sorting of model files by date, added extra fields if we need the info later
5228101
Clémentine
commited on
Added rate limiting system to the leaderboard to prevent abuse
3777786
Clémentine
commited on
flagged gaodrew/gaodrew-gorgonzola-13b
77c51de
fix bug in metadata display
e0b891a
Clémentine
commited on
fix of the model type display
9e0f1e6
Clémentine
commited on
Update src/display_models/model_metadata_type.py
6d1329a
Flagging TigerResearch/tigerbot-7b-sft-v1
ff09f56
fix submit different revisions
49a4ed6
Clémentine
commited on
Flagging Fredithefish/ReasonixPajama-3B-HF
bbd101d
Update src/display_models/model_metadata_type.py
8541f99
Cleaned and refactored the code, improved filtering, added selection of deleted models
8c49cb6
Clémentine
commited on
do not display models with an empty metric result
ba25d90
Clémentine
commited on
Set to 0 if metric not found (#220)
c6b775f
Add a model size filter ✨ (#218)
d2179b0
added 'forbidden models' submission, to allow orgs to request their models to not be submitted in case of contamination
ed1fdef
Clémentine
commited on
simplified header text
6fefae4
Clémentine
commited on
Flagged model per discussion
6e039c4
Clémentine
commited on
removed need for tokens in the leaderboard + removed skull in flagged models
a40c960
Clémentine
commited on
Adding flagging systemi, removing changelog
699e8ff
Clémentine
commited on
Adding link to detailed results and evals (#203)
6254b87
Update src/auto_leaderboard/model_metadata_type.py
1108259
Update src/auto_leaderboard/model_metadata_type.py (#199)
0ba9d60
Small update and reorg of text (#198)
d313dbd
look at model info if not in request file
a33e66d
Clémentine
commited on
typo fix
1b7afb7
Clémentine
commited on
Updated model metadata according to #162
a5023e4
Clémentine
commited on
Re-labelled model types (#162)
16a8ecc
clarified how to get MMLU average
6095833
Clémentine
commited on
rm lighteval sha from id
2bb5ded
Clémentine
commited on
added precision
6eaad72
Clémentine
commited on
fix rounding
d350941
Clémentine
commited on
corrected display of symbols
35763fc
Clémentine
commited on
Merge branch 'main' into link_requests_and_results
a79408c
Nathan Habib
commited on
get model type info from request file
80f4eeb
Nathan Habib
commited on
added more nuance in ft models
95f85ed
Clémentine
commited on
Update src/auto_leaderboard/model_metadata_type.py (#159)
eedc0f1
corrected finetuned mentions
0f4a719
Clémentine
commited on
Update newcomers (#153)
d7daa68
look for model type in request file
d295afa
Nathan Habib
commited on
