DiscoResearch
/

Llama3-DiscoLeo-Instruct-8B-32k-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

bjoernp commited on May 29

Commit

21214b3

•

1 Parent(s): 381d72a

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -60,9 +60,12 @@ We release DiscoLeo-8B in the following configurations:
 Here's how to use the model with transformers:
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
 model = AutoModelForCausalLM.from_pretrained(
-    "DiscoResearch/Llama3-DiscoLeo-Instruct-8B-v0.1",
     torch_dtype="auto",
     device_map="auto"
 )

 Here's how to use the model with transformers:
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+device="cuda"
 model = AutoModelForCausalLM.from_pretrained(
+    "DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k-v0.1",
     torch_dtype="auto",
     device_map="auto"
 )