I have added an application to Open LLM Leaderboard and see my scores on it, but how do I use the LLM Performance Leaderboard?

#25
by yyjjtt - opened

I have added an application to Open LLM Leaderboard and see my scores on it, but how do I use the LLM Performance Leaderboard?

Hugging Face Optimum org

we can't measure the performance of all models on the open llm leaderboard so we limit our benchmarks to only pretrained (because fine-tuning adds no inference cost), non quantized variants (we do all quantizations inline).

IlyasMoutawwakil changed discussion status to closed

Sign up or log in to comment