Nathan Habib
SaylorTwift
AI & ML interests
None yet
Articles
Organizations
SaylorTwift's activity
bump-transformers-to-4.41.1
2
#753 opened 9 days ago
by
alozowski
apply-ruff
7
#748 opened 14 days ago
by
alozowski
Understanding raw result data files
4
#729 opened 28 days ago
by
jerome-white
No good way to identify number of activated parameters causes MIxtral evaluation failures
28
#680 opened about 2 months ago
by
0-hero
GSM8K failure with Llama 3 finetunes
12
#703 opened about 1 month ago
by
jeiku
Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B
#57 opened about 1 month ago
by
SaylorTwift
Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B
#102 opened about 1 month ago
by
SaylorTwift
Update README.md
1
#16 opened about 2 months ago
by
SaylorTwift
Model evaluation failed after 2 days
17
#622 opened 3 months ago
by
migtissera
bigstral and bigyi both failed
1
#628 opened 3 months ago
by
ehartford
Renaming Model gg-hf/gemma-2b to google/gemma-2b
2
#46 opened 3 months ago
by
SaylorTwift
Renaming Model gg-hf/gemma-7b to google/gemma-7b
2
#45 opened 3 months ago
by
SaylorTwift
Fix typo
#15 opened 3 months ago
by
SaylorTwift
Renaming Model gg-hf/gemma-2b to google/gemma-2b
#1 opened 3 months ago
by
SaylorTwift
Renaming Model gg-hf/gemma-7b to google/gemma-7b
#1 opened 3 months ago
by
SaylorTwift
Renaming Model gg-hf/gemma-2b to google/gemma-2b
#59 opened 3 months ago
by
SaylorTwift
Renaming Model gg-hf/gemma-7b to google/gemma-7b
#58 opened 3 months ago
by
SaylorTwift
Model not found on hub
4
#584 opened 4 months ago
by
akshay326
152334H/miqu-1-70b-sf marked as private or deleted
3
#587 opened 4 months ago
by
TNTOutburst
Model submission
1
#590 opened 4 months ago
by
axra
gsm8k score largely different from local run
6
#591 opened 4 months ago
by
mobicham
Create REBOOT.md
4
#586 opened 4 months ago
by
nisten
Model not showing up in the queue
2
#588 opened 4 months ago
by
bhavyaaiplanet
Is the eval server down?
1
#589 opened 4 months ago
by
appoose
can I see MMLU By Task?
1
#559 opened 4 months ago
by
jijivski
invisible models in openllm leaderboard
13
#554 opened 4 months ago
by
leejunhyeok
[FLAG] Garrulus and Turdus based models
3
#548 opened 4 months ago
by
MichaelKarpe
Add Mute Button for Notifications
6
#547 opened 4 months ago
by
aigeek0x0
Cannot reproduce accuracy of mncai/Llama2-7B-guanaco-dolphin-500 gsm8k
16
#527 opened 5 months ago
by
zhentaocc
Model works fine on A100 (80GB) GPU
3
#541 opened 5 months ago
by
aigeek0x0
missing evaluation results of finished eval
16
#529 opened 5 months ago
by
fblgit
Details of run not Found
1
#518 opened 5 months ago
by
arshadshk
Evaluation of Dolphin Mixtral series failed
6
#517 opened 5 months ago
by
Dampfinchen
Bagel 8x7B evaluation failed
5
#516 opened 5 months ago
by
Dampfinchen
my model is not showing on the llm leaderboard
2
#504 opened 5 months ago
by
abdulrahman-nuzha
Update src/submission/check_validity.py
4
#509 opened 5 months ago
by
BearSean
undeleted/unprivate model is invisible in leaderboard
11
#487 opened 5 months ago
by
leejunhyeok
Models Failure
11
#374 opened 7 months ago
by
Weyaxi
Model deletion from LLM leaderboard
4
#476 opened 6 months ago
by
Toten5
Bug- model show incorrect # Params
4
#499 opened 5 months ago
by
felixz
[FLAG] zyh3826 / GML-Mistral-merged-v1
2
#503 opened 5 months ago
by
nlpguy
Model Upload Error: This model has been already submitted.
7
#506 opened 5 months ago
by
kyujinpy
Remove model
1
#507 opened 5 months ago
by
jeonsworld
Why is "trust_remote_code" not supported?
1
#501 opened 5 months ago
by
Q-bert
[FLAG] ceadar-ie / FinanceConnect-13B
2
#502 opened 5 months ago
by
nlpguy
Request for removal of models
1
#500 opened 5 months ago
by
sequelbox
l3utterfly/minima-3b-layla-v2 shown as "submitted" but cannot find it anywhere
6
#493 opened 5 months ago
by
l3utterfly
Model evaluation failed
3
#494 opened 5 months ago
by
adamo1139
Deployed For Evaluation Still Not On Leaderboard
2
#497 opened 5 months ago
by
vikash06
Model not visible on leaderboard
4
#489 opened 5 months ago
by
mwitiderrick
There seems to be a problem with the mixtral finetuning evaluations
9
#491 opened 5 months ago
by
DavidGF
Better citation readability
1
#1 opened 6 months ago
by
SaylorTwift
Metis-0.3 failed
1
#479 opened 6 months ago
by
Mihaiii
What does it mean for a model to be in the Running evaluation queue?
1
#480 opened 6 months ago
by
Mihaiii
Potential data contamination with regards to ultrafeedback-binarized and Nectar datasets
42
#474 opened 6 months ago
by
killawhale2
nathan-flagged-models-vis
5
#478 opened 6 months ago
by
SaylorTwift
Brainstorming: Suggestions for improving the leaderboard
25
#477 opened 6 months ago
by
xxyyy123
Please check this failed task
3
#446 opened 6 months ago
by
JosephusCheung
Please remove the wrong item
3
#439 opened 6 months ago
by
JosephusCheung
Add HumanEval+ benchmark to the leaderboard
5
#442 opened 6 months ago
by
HoangHa