Nathan Habib

New activity in open-llm-leaderboard/requests 1 day ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#102 opened 1 day ago by

New activity in databricks/dbrx-base 18 days ago

Update README.md

#16 opened 18 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard about 1 month ago

Model evaluation failed after 2 days

17

#622 opened about 2 months ago by

migtissera

bigstral and bigyi both failed

#628 opened about 1 month ago by

ehartford

New activity in open-llm-leaderboard/results about 2 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#46 opened about 2 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#45 opened about 2 months ago by

New activity in google/gemma-7b about 2 months ago

Fix typo

#15 opened about 2 months ago by

New activity in open-llm-leaderboard/details_google__gemma-2b about 2 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#1 opened about 2 months ago by

New activity in open-llm-leaderboard/details_google__gemma-7b about 2 months ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#1 opened about 2 months ago by

New activity in open-llm-leaderboard/requests about 2 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#59 opened about 2 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#58 opened about 2 months ago by

New activity in HuggingFaceH4/open_llm_leaderboard 2 months ago

Model not found on hub

#584 opened 2 months ago by

akshay326

152334H/miqu-1-70b-sf marked as private or deleted

#587 opened 2 months ago by

TNTOutburst

Model submission

#590 opened 2 months ago by

axra

gsm8k score largely different from local run

#591 opened 2 months ago by

mobicham

Create REBOOT.md

#586 opened 2 months ago by

nisten

Model not showing up in the queue

#588 opened 2 months ago by

bhavyaaiplanet

Is the eval server down?

#589 opened 2 months ago by

appoose

New activity in HuggingFaceH4/open_llm_leaderboard 3 months ago

can I see MMLU By Task?

#559 opened 3 months ago by

jijivski

invisible models in openllm leaderboard

13

#554 opened 3 months ago by

leejunhyeok

[FLAG] Garrulus and Turdus based models

#548 opened 3 months ago by

MichaelKarpe

Add Mute Button for Notifications

#547 opened 3 months ago by

aigeek0x0

Cannot reproduce accuracy of mncai/Llama2-7B-guanaco-dolphin-500 gsm8k

16

#527 opened 3 months ago by

zhentaocc

Model works fine on A100 (80GB) GPU

#541 opened 3 months ago by

aigeek0x0

missing evaluation results of finished eval

16

#529 opened 3 months ago by

fblgit

Details of run not Found

#518 opened 3 months ago by

arshadshk

Evaluation of Dolphin Mixtral series failed

#517 opened 3 months ago by

Dampfinchen

Bagel 8x7B evaluation failed

5

#516 opened 4 months ago by

Dampfinchen

New activity in HuggingFaceH4/open_llm_leaderboard 4 months ago

my model is not showing on the llm leaderboard

#504 opened 4 months ago by

abdulrahman-nuzha

Update src/submission/check_validity.py

#509 opened 4 months ago by

BearSean

undeleted/unprivate model is invisible in leaderboard

11

#487 opened 4 months ago by

leejunhyeok

Models Failure

11

#374 opened 5 months ago by

Weyaxi

Model deletion from LLM leaderboard

#476 opened 4 months ago by

Toten5

Bug- model show incorrect # Params

#499 opened 4 months ago by

felixz

[FLAG] zyh3826 / GML-Mistral-merged-v1

#503 opened 4 months ago by

nlpguy

Model Upload Error: This model has been already submitted.

7

#506 opened 4 months ago by

kyujinpy

Remove model

#507 opened 4 months ago by

jeonsworld

Why is "trust_remote_code" not supported?

#501 opened 4 months ago by

Q-bert

[FLAG] ceadar-ie / FinanceConnect-13B

#502 opened 4 months ago by

nlpguy

Request for removal of models

#500 opened 4 months ago by

sequelbox

l3utterfly/minima-3b-layla-v2 shown as "submitted" but cannot find it anywhere

#493 opened 4 months ago by

l3utterfly

Model evaluation failed

#494 opened 4 months ago by

adamo1139

Deployed For Evaluation Still Not On Leaderboard

#497 opened 4 months ago by

vikash06

Model not visible on leaderboard

#489 opened 4 months ago by

mwitiderrick

There seems to be a problem with the mixtral finetuning evaluations

9

#491 opened 4 months ago by

DavidGF

New activity in OpenGVLab/MVBench_Leaderboard 4 months ago

Better citation readability

#1 opened 4 months ago by

New activity in HuggingFaceH4/open_llm_leaderboard 4 months ago

Metis-0.3 failed

#479 opened 4 months ago by

Mihaiii

What does it mean for a model to be in the Running evaluation queue?

#480 opened 4 months ago by

Mihaiii

Potential data contamination with regards to ultrafeedback-binarized and Nectar datasets

40

#474 opened 4 months ago by

killawhale2

nathan-flagged-models-vis

5

#478 opened 4 months ago by

Brainstorming: Suggestions for improving the leaderboard

25

#477 opened 4 months ago by

xxyyy123

Please check this failed task

#446 opened 4 months ago by

JosephusCheung

Please remove the wrong item

#439 opened 4 months ago by

JosephusCheung

Add HumanEval+ benchmark to the leaderboard

5

#442 opened 4 months ago by

HoangHa

Delcos/Velara is 'fine-tuned' not 'pretrained'

#440 opened 4 months ago by

HenkPoley

How to submit Qwen model?

#436 opened 4 months ago by

Cookize

New activity in HuggingFaceH4/open_llm_leaderboard 5 months ago

Evaluating Model was suddenly disappeared..!

#419 opened 5 months ago by

KaeriJenti

Benchmark pipeline broken?

#418 opened 5 months ago by

vmajor

Why the gsm8k acc of many models changes?