Suggestion to set max queue size

#6
by abidlabs HF staff - opened

In order to reduce long wait times, you could consider adding a max queue size. After the queue size reaches this amount, no further users are added to the queue, and instead an error message is displayed. We've found that this tends to provide a better UI for users as it rewards those users who are persistent (i.e. those who try to run the prediction again) and gives them a shorter wait time

abidlabs changed pull request title from Update app.py to Suggestion to set max queue size

Good idea!

pharmapsychotic changed pull request status to merged

Sign up or log in to comment