I cannot use the model from the hub following the code in the main page

#101
by Arianna27 - opened

hi all,

When I execute the following code, it doesn't download anything and print the message: read time out

import transformers
import torch

model_id = "meta-llama/Meta-Llama-3-8B"

pipeline = transformers.pipeline(
"text-generation", model=model_id, model_kwargs={"torch_dtype": torch.bfloat16}, device_map="auto"
)
pipeline("Hey how are you doing today?")

Do I have to pay something? How can i sort the problem? Thank you so much for your help

Sign up or log in to comment