Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Added parallel worker threads
#10
by
ysharma
HF staff
- opened
Limited max queue size to 10 and set the number of concurrent worker threads to 40. This should help in negotiating the long (>4000) queues and in improving User experience.
Muennighoff
changed pull request status to
merged