llm-trustworthy-leaderboard

Running on CPU Upgrade

App Files Files Community

Including on extra column options will hide some submission results...

by zhiminy - opened Jan 30

Discussion

zhiminy

Jan 30

•

edited Jan 30

For example, if we check on Type, Architecture, Precision, and #Params (B), then models such as anthropic/claude-2.0 and openai/gpt-3.5-turbo-0301 suddenly vanish from nowhere...
This is what it looks like before checking those options:

This is what it looks like after checking those options:

zhiminy

Jan 30

•

edited Jan 30

Even if we deselect those options afterward, these vanished submission records still fail to show up as the original state. They are gone completely...

zhiminy changed discussion title from Clicking on extra options will hide some submission results... to Clicking on extra column options will hide some submission results... Jan 30

zhiminy changed discussion title from Clicking on extra column options will hide some submission results... to Including on extra column options will hide some submission results... Jan 30

danielz01

Secure Learning Lab org Jan 30

Thanks for your interest. This seems to be the problem with model metadata and the filtering function. We will look into it after ICML deadline.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment