Error when deploying to inference endpoint
#1
by
ridewinter
- opened
Am consistently getting this error when deploying to an A10:
ValueError: Non-consecutive added token '<unk>' found. Should have index 32000 but has index 0 in saved vocabulary.
Am consistently getting this error when deploying to an A10:
ValueError: Non-consecutive added token '<unk>' found. Should have index 32000 but has index 0 in saved vocabulary.
Are you using VLLM