Clémentine Fourrier's picture

Clémentine Fourrier

clefourrier

·

http://clefourrier.github.io

AI & ML interests

None yet

Articles

Introducing the Open Chain of Thought Leaderboard

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Introducing the Chatbot Guardrails Arena

Introducing ConTextual: How well can your Multimodal model jointly reason over text and image in text-rich scenes?

TTS Arena: Benchmarking Text-to-Speech Models in the Wild

Introducing the Red-Teaming Resistance Leaderboard

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

NPHardEval Leaderboard: Unveiling the Reasoning Abilities of Large Language Models through Complexity Classes and Dynamic Updates

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard

2023, year of open LLMs

Open LLM Leaderboard: DROP deep dive

Overview of natively supported quantization schemes in 🤗 Transformers

What's going on with the Open LLM Leaderboard?

Introduction to Graph Machine Learning

Organizations

clefourrier's activity

New activity in HuggingFaceH4/open_llm_leaderboard 3 days ago

dummy column refactoring

#688 opened 8 days ago by

Add google/recurrentgemma-2b-it

#677 opened 13 days ago by

Failed evaluation, and cannot summit again

#699 opened 4 days ago by

Merge model failed

#700 opened 3 days ago by

failed run Llama-3-11.5B-v2

#698 opened 4 days ago by

Llama-3-8B finetuned model Failed Evaluation

#695 opened 5 days ago by

GPTQ and Mixtral models will need to be relaunched

#692 opened 6 days ago by

Removing FAILED models

#701 opened 3 days ago by

ALL Jamba models failing

#690 opened 7 days ago by

New activity in gaia-benchmark/leaderboard 4 days ago

Runtime error :(

#15 opened 19 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard 4 days ago

Runtime Error

#697 opened 4 days ago by

Llama 3 foundation models failing!

#693 opened 6 days ago by

New activity in open-llm-leaderboard/requests 4 days ago

Delete MaziyarPanahi/Llama-3-16B-Instruct-v0.1_eval_request_False_float16_Original.json

#114 opened 5 days ago by

Delete MaziyarPanahi/Llama-3-13B-Instruct-v0.1_eval_request_False_float16_Original.json

#113 opened 5 days ago by

Delete MaziyarPanahi/Goku-8x22B-v0.2_eval_request_False_float16_Original.json

#112 opened 5 days ago by

Delete MaziyarPanahi/Goku-8x22B-v0.1_eval_request_False_float16_Original.json

#110 opened 5 days ago by

Delete MaziyarPanahi/Goku-8x22B-v0.2_eval_request_False_float16_Original.json

#104 opened 7 days ago by

Failure request indicators

#103 opened 7 days ago by

FAILED

#105 opened 7 days ago by

Evaluation Failure NLPark/Test0_SLIDE

#107 opened 6 days ago by

Llama-3-MoE eval failed

#109 opened 5 days ago by

Evaluation Failure - rmdhirr/Calyx_7B

#106 opened 7 days ago by

Failed run

#108 opened 6 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard 6 days ago

Future feature: system prompt and chat support

#459 opened 5 months ago by

New activity in MM-UPD/MM-UPD 7 days ago

Have a benchmark leaderboard for the dataset

#1 opened 7 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard 8 days ago

72b models eval failed

#689 opened 8 days ago by

python-upgrade

#683 opened 10 days ago by

transformers-upgrade

#687 opened 8 days ago by

GPTQ failed submission request

#669 opened 17 days ago by

No good way to identify number of activated parameters causes MIxtral evaluation failures

#680 opened 10 days ago by

72b Eval model failed

#685 opened 9 days ago by

False Flagging

#686 opened 9 days ago by

Walmart-the-bag

Announcement: Flagging merged models with incorrect metadata

#510 opened 4 months ago by

New activity in HuggingFaceH4/open_llm_leaderboard 9 days ago

Any updates on redesigning the leaderboard?

#595 opened 2 months ago by

GSM8K: which value will be selected?

#682 opened 10 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard 10 days ago

Bump Gradio Space CI to 0.2.3

#679 opened 11 days ago by

dataframe-improvement

#671 opened 16 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard 11 days ago

Queue is currently very slow

#676 opened 14 days ago by

Walmart-the-bag

New activity in HuggingFaceH4/open_llm_leaderboard 15 days ago

Our model(s) failed - Can we get the logs?

#675 opened 15 days ago by

Is it realistic that GSM8K would fail so extremely on a Solar-based merge?

#670 opened 17 days ago by

Question about "until token" of huggingface inference method.

#674 opened 15 days ago by

New activity in leaderboards/LeaderboardsExplorer 16 days ago

Why not exclude the duplicate or malfunctioning leaderboards?

#2 opened 18 days ago by

New activity in HuggingFaceH4/open_llm_leaderboard 16 days ago

🚩 Report: Not working

#673 opened 16 days ago by

New activity in open-llm-leaderboard/details_InferenceIllusionist__Excalibur-7B 16 days ago

Renaming Model InferenceIllusionist/Excalibur-7B to InferenceIllusionist/Excalibur-7b

#2 opened about 1 month ago by

InferenceIllusionist

New activity in open-llm-leaderboard/results 16 days ago

Renaming Model InferenceIllusionist/Excalibur-7B to InferenceIllusionist/Excalibur-7b

#52 opened about 1 month ago by

InferenceIllusionist

New activity in open-llm-leaderboard/requests 16 days ago

Renaming Model InferenceIllusionist/Excalibur-7B to InferenceIllusionist/Excalibur-7b

#86 opened about 1 month ago by

InferenceIllusionist

Delete MaziyarPanahi/Calme-7B-Instruct-v0.3_eval_request_False_float16_Original.json

#88 opened about 1 month ago by

Delete MaziyarPanahi/Calme-4x7B-MoE-v0.2_eval_request_False_float16_Original.json

#89 opened about 1 month ago by

commented a paper 5 months ago

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 170 •