Add model size to all tabs

#49
by do-me - opened

It would be nice if you could add the model size to all tabs and not only in the "overall" tab. In this way it becomes easier to compare size & quality for specific tasks.

Massive Text Embedding Benchmark org

Yeah, we can do this if many people want this. Perso, I felt like it would be too much duplicated information. Usually the most important models appear somewhere at the top of the Overall tabs so you can easily look up their size & size is something that's easily remembered 🤔

I see, you'd like to keep it convenient to use for the majority.
I can tell you about my use case if it helps to understand why it might be valuable. For SemanticFinder (in-browser semantic search) I am heavily relying on the smallest (and fastest) models on MTEB leaderboard. However, having to deal with lots of European documents and of course also for the international community, it is crucial to identify a) multilingual models that are b) as small as possible for fast load times.

There might be more use cases like this where you need to balance performance and size, especially considering emerging mobile applications.

I'm not quite sure whether Gradio already offers some kind of column toggle option (afaik not) - if so, it'd be the perfect. Just keep the default as is but offer the option to select other columns too.

Massive Text Embedding Benchmark org

Thanks! Yeah toggling columns in Gradio would be a great feature cc @abidlabs

Sign up or log in to comment