Clémentine Fourrier's picture

Clémentine Fourrier

clefourrier

·

http://clefourrier.github.io

AI & ML interests

None yet

Articles

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Falcon 2: An 11B parameter pretrained language model and VLM, trained on over 5000B tokens tokens and 11 languages

Let's talk about LLM evaluation

Introducing the Open Arabic LLM Leaderboard

about 1 month ago

Introducing the Open Leaderboard for Hebrew LLMs!

Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face

Improving Prompt Consistency with Structured Generations

Introducing the Open Chain of Thought Leaderboard

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Introducing the Chatbot Guardrails Arena

Introducing ConTextual: How well can your Multimodal model jointly reason over text and image in text-rich scenes?

TTS Arena: Benchmarking Text-to-Speech Models in the Wild

Introducing the Red-Teaming Resistance Leaderboard

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

NPHardEval Leaderboard: Unveiling the Reasoning Abilities of Large Language Models through Complexity Classes and Dynamic Updates

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard

2023, year of open LLMs

Open LLM Leaderboard: DROP deep dive

Overview of natively supported quantization schemes in 🤗 Transformers

What's going on with the Open LLM Leaderboard?

Introduction to Graph Machine Learning

Organizations

clefourrier's activity

New activity in open-llm-leaderboard/open_llm_leaderboard about 14 hours ago

FLAG: saltlux/luxia-21.4b-alignment-v1.2 GSM8k v1.0 to v1.2 29% GSM Tests contamination

#767 opened 13 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 20 hours ago

Issue with Model Category Update on Leaderboard: Remains Private After Switching to Public

#781 opened 7 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 2 days ago

What happened with qwen2 ratings?

#786 opened 2 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 3 days ago

Queue frozen

#783 opened 5 days ago by

Are deleted models subject to being flagged if they cheat?

#785 opened 3 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 5 days ago

Can't submit a model

#774 opened 10 days ago by

New activity in bigcode/bigcodebench-leaderboard 6 days ago

Collab on BigCodeBench Leaderboard?

#1 opened 6 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 6 days ago

parquet files loading error for details dataset

#782 opened 6 days ago by

Model submitted does not appear in pending queue

#780 opened 7 days ago by

New activity in gaia-benchmark/leaderboard 6 days ago

Runtime error

#17 opened 6 days ago by

New activity in demo-leaderboard-backend/leaderboard 7 days ago

Is this space supposed to work in tandem with Lighteval?

#5 opened 16 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 7 days ago

No good way to identify number of activated parameters causes MIxtral evaluation failures

#680 opened about 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 8 days ago

Model disappeared from app(I can't find the dataset related with the model either)

#759 opened 16 days ago by

kamilmuratyilmaz

Model evaluation failed after a few days

#778 opened 9 days ago by

ETA From submission to evaluation

#779 opened 8 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 9 days ago

Feature Request for Leaderboard: date added to hub

#425 opened 6 months ago by

Models failed

#776 opened 10 days ago by

models submitted for eval are finished, but do not appear on the leaderboard

#768 opened 13 days ago by

Llama-3 70b model eval failed and can't submit again

#709 opened about 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 10 days ago

reclassify some ORPO models as chat 💬

#758 opened 18 days ago by

Model "Amu/dpo-qlora-Qwen1.5-0.5B-Chat-xtuner" was not found or misconfigured on the hub!

#772 opened 11 days ago by

Amu

Model was not found or misconfigured on the hub

#775 opened 10 days ago by

Model "X" was not found or misconfigured on the hub!

#771 opened 12 days ago by

Feature request: Date Filtering Option

#777 opened 10 days ago by

loading_from_contents

#766 opened 14 days ago by

GSM8K Evaluation has a serious bug/oversight, that is negatively impacting score of all Llama 3 models. Please consider updating to the latest commit of lm-evaluation-harness which fixes it.

#770 opened 12 days ago by

gradientai/Llama-3-70B-Instruct-Gradient-1048k FAILED, can I investigate the logs?

#765 opened 15 days ago by

leo-pekelis-gradient

Best text classification model for sentiment analysis?

#773 opened 11 days ago by

Announcement: Flagging merged models with incorrect metadata

#510 opened 5 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 12 days ago

webhooks

#769 opened 12 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 14 days ago

Models that used Nectar dataset

#749 opened 25 days ago by

Feature request: Hide models with insufficient model card from default view in leaderboard

#762 opened 15 days ago by

Discussion: naming pattern to converge on to better identify fine-tunes

#761 opened 15 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 15 days ago

Feature request: Add toggle to only show models with linked dataset

#763 opened 15 days ago by

Search by parameter count gives surprising results

#764 opened 15 days ago by

Feature request: Run 100B + models automatically

#434 opened 6 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 16 days ago

GSM8K (5-shot) performance is quite different compared to running lm_eval locally

#755 opened 20 days ago by

llama3

#760 opened 16 days ago by

[Feature request] Add option for native quantization format (as default) for model submissions form

#757 opened 18 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 21 days ago

Some Issues Regarding Bugs in 0-1B Model Rankings

#750 opened 23 days ago by

Feature Request: Multilingual Evaluations 🌐

#745 opened 29 days ago by

is everything good with the benchmark?

#752 opened 22 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 29 days ago

restore-emoji

#743 opened about 1 month ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 30 days ago

GSM8K do not appear.

#742 opened about 1 month ago by

New activity in open-llm-leaderboard/results about 1 month ago

Git clone fails because of invalid paths

#59 opened about 1 month ago by

commented a paper 7 months ago

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 174 •