can't deploy it in AWS with permission error

#105
by JeffJay - opened

Access to model mistralai/Mistral-7B-Instruct-v0.2 is restricted and you are not in the authorized list. Visit https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2 to ask for access.
I already included the HF token when deploying.

Please also accepts the terms and conditions in the 'Homepage' of the model.

In addition, try passing the token also into the AutoTokenizer, not only on AutoModelForCausalLM:

AutoTokenizer.from_pretrained(model_id, token = '<your token>')

AutoModelForCausalLM.from_pretrained(model_id, token = '<your token>')

JeffJay changed discussion status to closed

Sign up or log in to comment