meta-llama

/

Meta-Llama-3-8B

like 4.13k

I am sorry, surely there is a reasonable explanation for this, but I just don't get it ...

I have been granted access to the model:

But unfortunately I still can't access it through the example script:

(with hf_token in pipeline construction)

OSError: You are trying to access a gated repo.
Make sure to have access to it at https://huggingface.co/meta-llama/Meta-Llama-3-8B.
401 Client Error. (Request ID: Root=1-663fb5bd-7d28f4447bfd337e03d1d7e1;9595c68e-90d4-4f08-bbd9-096df0c5ddcb)

Cannot access gated repo for url https://huggingface.co/meta-llama/Meta-Llama-3-8B/resolve/main/config.json.
Access to model meta-llama/Meta-Llama-3-8B is restricted. You must be authenticated to access it.

without the hf_token in transformers.pipeline:

What am I missing?

edit: I am providing my hf token in the pipeline creation

model_id = "meta-llama/Meta-Llama-3-8B"

pipeline = transformers.pipeline(
"text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto", use_auth_token=hf_token
)