FatalWorkerException
#1
by
tomasmcm
- opened
Hi there, thank you so much for all the work you're doing 🙌
While trying to run this model on vllm I'm getting this error. Is this something to do with the AWQ files or my setup?
fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
Exception: No such file or directory (os error 2)
Thanks!
Sorry about that - there was an error in tokenizer_config.json, inherited from the base model.
I've just fixed it. Please trigger a download of the model again, and it will get the new file and should hopefully now work.
Let me know if it doesn't.
Amazing! It works perfectly now.
I've been uploading some of your most interesting and quirky models to replicate. This one is here: https://replicate.com/tomasmcm/dans-adventurouswinds-mk2-7b
tomasmcm
changed discussion status to
closed