[feature request] prioritize the queue (by user voting?)

#46
by zed9h - opened

If I got it right the queue is "first come, first served", but some recent models seem much more relevant than others that are already piling up in the queue, wouldn't it be nice if the users could vote to prioritize the pending queue?

This would make much more sense than giving priority access to certain models.

Yeah, there are 407 models in the running+pending queues and around 7 models tested per day. Something like this could help to keep up. The concurrent thread count increase they did definitely helped. It used to be 1-2 per day.

Open LLM Leaderboard org

Hi! As we caught up on the queue, and increased the speed of our backend, it now goes fast enough to not need this feature!

clefourrier changed discussion status to closed

Sign up or log in to comment