Ludwig Stumpp commited on
Commit
84a7c6d
β€’
1 Parent(s): 4d54a13
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -1,4 +1,4 @@
1
- # πŸ† llm-leaderboard
2
 
3
  A joint community effort to create one central leaderboard for LLMs. Contributions and corrections welcome!
4
 
@@ -73,6 +73,18 @@ We are always happy for contributions! You can contribute by the following:
73
  - improving the existing code
74
  - requesting and implementing new features
75
 
 
 
 
 
 
 
 
 
 
 
 
 
76
  ## More Open LLMs
77
 
78
  If you are interested in an overview about open llms for commercial use and finetuning, check out the [open-llms](https://github.com/eugeneyan/open-llms) repository.
 
1
+ # πŸ† LLM-Leaderboard
2
 
3
  A joint community effort to create one central leaderboard for LLMs. Contributions and corrections welcome!
4
 
 
73
  - improving the existing code
74
  - requesting and implementing new features
75
 
76
+ ## Future Ideas
77
+
78
+ - add model year
79
+ - add "export current view as .csv" button to streamlit demo
80
+ - (TBD) add model details:
81
+ - #params
82
+ - #tokens seen during training
83
+ - length context window
84
+ - architecture type (transformer-decoder, transformer-encoder, transformer-encoder-decoder, ...)
85
+ - if additional model details, allow to hide them in the interactive streamlit dashboard with a checkbox?
86
+ - (TBD) improvements on the filtering in the streamlit demo, maybe filter by value range?
87
+
88
  ## More Open LLMs
89
 
90
  If you are interested in an overview about open llms for commercial use and finetuning, check out the [open-llms](https://github.com/eugeneyan/open-llms) repository.