Spaces:

fxmarty
/

tgi-mi300-demo-chat

Runtime error

fxmarty commited on May 13

Commit

0142f47

•

1 Parent(s): da994a7

update tokenizer

Files changed (1) hide show

app.py CHANGED Viewed

@@ -5,7 +5,7 @@ import time
 from huggingface_hub import InferenceClient
 from transformers import AutoTokenizer
-tokenizer = AutoTokenizer.from_pretrained("meta-llama/Meta-Llama-3-8B-Instruct")
 client = InferenceClient(model="https://6274-20-63-4-233.ngrok-free.app")

 from huggingface_hub import InferenceClient
 from transformers import AutoTokenizer
+tokenizer = AutoTokenizer.from_pretrained("meta-llama/Meta-Llama-3-70B-Instruct")
 client = InferenceClient(model="https://6274-20-63-4-233.ngrok-free.app")