Not able to launch using TGI in Sagemaker
#11
by
aastha6
- opened
Trying to deploy this model in Sagemaker.
Inference deployment details:
instance_type = g5.2xlarge
TGI image version = 1.1.0
Error details:
ValueError: Non-consecutive added token '<unk>' found. Should have index 32000 but has index 0 in saved vocabulary.