McGill-NLP
/

Llama-3-8B-Web

Text Generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

xhluca commited on Apr 26

Commit

09856c2

•

1 Parent(s): dcf6ae5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -60,7 +60,7 @@ template = open('templates/llama.txt').read()
 # Run the agent on a single state (text representation) and get the action
 state = template.format(**valid[0])
-agent = pipeline("McGill-NLP/Llama-3-8b-Web")
 out = agent(state, return_full_text=False)[0]
 print("Action:", out['generated_text'])

 # Run the agent on a single state (text representation) and get the action
 state = template.format(**valid[0])
+agent = pipeline(model="McGill-NLP/Llama-3-8b-Web", device=0, torch_dtype='auto')
 out = agent(state, return_full_text=False)[0]
 print("Action:", out['generated_text'])