API : wait_for_model Doesn't work
#5
by
Mohamed123321
- opened
Hello, I encountered an issue while using the API for the pythia-12b-sft-v8-7k-steps model. The error message I received is: "'Model OpenAssistant/pythia-12b-sft-v8-7k-steps is currently loading', 'estimated_time': 20.0}". Even when I set the 'wait_for_model' parameter to True, the problem was not resolved. Did anyone also have this issue?
@Mohamed123321 don't worry I also used to get this error (I'm using differ model of Open Assistant) but I let the model cooldown by not running it for few minutes after that again model start running