Clémentine Fourrier's picture

Clémentine Fourrier

clefourrier

·

http://clefourrier.github.io

AI & ML interests

None yet

Articles

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Falcon 2: An 11B parameter pretrained language model and VLM, trained on over 5000B tokens tokens and 11 languages

Let's talk about LLM evaluation

Introducing the Open Arabic LLM Leaderboard

Introducing the Open Leaderboard for Hebrew LLMs!

Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face

Improving Prompt Consistency with Structured Generations

Introducing the Open Chain of Thought Leaderboard

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Introducing the Chatbot Guardrails Arena

Introducing ConTextual: How well can your Multimodal model jointly reason over text and image in text-rich scenes?

TTS Arena: Benchmarking Text-to-Speech Models in the Wild

Introducing the Red-Teaming Resistance Leaderboard

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

NPHardEval Leaderboard: Unveiling the Reasoning Abilities of Large Language Models through Complexity Classes and Dynamic Updates

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard

2023, year of open LLMs

Open LLM Leaderboard: DROP deep dive

Overview of natively supported quantization schemes in 🤗 Transformers

What's going on with the Open LLM Leaderboard?

Introduction to Graph Machine Learning

Organizations

clefourrier's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 31 minutes ago

FLAG: saltlux/luxia-21.4b-alignment-v1.2 GSM8k v1.0 to v1.2 29% GSM Tests contamination

#767 opened 17 days ago by

New activity in Salesforce/xgen-7b-8k-inst 4 days ago

Adding the license tag

#18 opened 4 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 5 days ago

Issue with Model Category Update on Leaderboard: Remains Private After Switching to Public

#781 opened 11 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 7 days ago

What happened with qwen2 ratings?

#786 opened 7 days ago by

Queue frozen

#783 opened 9 days ago by

Are deleted models subject to being flagged if they cheat?

#785 opened 7 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 10 days ago

Can't submit a model

#774 opened 14 days ago by

New activity in bigcode/bigcodebench-leaderboard 10 days ago

Collab on BigCodeBench Leaderboard?

#1 opened 10 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 10 days ago

parquet files loading error for details dataset

#782 opened 10 days ago by

Model submitted does not appear in pending queue

#780 opened 11 days ago by

New activity in gaia-benchmark/leaderboard 11 days ago

Runtime error

#17 opened 11 days ago by

New activity in demo-leaderboard-backend/leaderboard 11 days ago

Is this space supposed to work in tandem with Lighteval?

#5 opened 20 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 12 days ago

No good way to identify number of activated parameters causes MIxtral evaluation failures

#680 opened 2 months ago by

Model disappeared from app(I can't find the dataset related with the model either)

#759 opened 21 days ago by

kamilmuratyilmaz

Model evaluation failed after a few days

#778 opened 13 days ago by

ETA From submission to evaluation

#779 opened 12 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 13 days ago

Feature Request for Leaderboard: date added to hub

#425 opened 7 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 14 days ago

Models failed

#776 opened 14 days ago by

models submitted for eval are finished, but do not appear on the leaderboard

#768 opened 17 days ago by

Llama-3 70b model eval failed and can't submit again

#709 opened about 2 months ago by

reclassify some ORPO models as chat 💬

#758 opened 22 days ago by

Model "Amu/dpo-qlora-Qwen1.5-0.5B-Chat-xtuner" was not found or misconfigured on the hub!

#772 opened 16 days ago by

Amu

Model was not found or misconfigured on the hub

#775 opened 14 days ago by

Model "X" was not found or misconfigured on the hub!

#771 opened 16 days ago by

Feature request: Date Filtering Option

#777 opened 14 days ago by

loading_from_contents

#766 opened 19 days ago by

GSM8K Evaluation has a serious bug/oversight, that is negatively impacting score of all Llama 3 models. Please consider updating to the latest commit of lm-evaluation-harness which fixes it.

#770 opened 16 days ago by

gradientai/Llama-3-70B-Instruct-Gradient-1048k FAILED, can I investigate the logs?

#765 opened 19 days ago by

leo-pekelis-gradient

Best text classification model for sentiment analysis?

#773 opened 15 days ago by

Announcement: Flagging merged models with incorrect metadata

#510 opened 6 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 17 days ago

webhooks

#769 opened 17 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 18 days ago

Models that used Nectar dataset

#749 opened 30 days ago by

Feature request: Hide models with insufficient model card from default view in leaderboard

#762 opened 20 days ago by

Discussion: naming pattern to converge on to better identify fine-tunes

#761 opened 20 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 19 days ago

Feature request: Add toggle to only show models with linked dataset

#763 opened 20 days ago by

Search by parameter count gives surprising results

#764 opened 20 days ago by

Feature request: Run 100B + models automatically

#434 opened 6 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 20 days ago

GSM8K (5-shot) performance is quite different compared to running lm_eval locally

#755 opened 24 days ago by

llama3

#760 opened 21 days ago by

[Feature request] Add option for native quantization format (as default) for model submissions form

#757 opened 22 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 25 days ago

Some Issues Regarding Bugs in 0-1B Model Rankings

#750 opened 27 days ago by

Feature Request: Multilingual Evaluations 🌐

#745 opened about 1 month ago by

is everything good with the benchmark?

#752 opened 26 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

restore-emoji

#743 opened about 1 month ago by

GSM8K do not appear.

#742 opened about 1 month ago by

commented a paper 7 months ago

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 174 •