Update README.md
Browse files
README.md
CHANGED
@@ -58,9 +58,12 @@ We release DiscoLeo-8B in the following configurations:
|
|
58 |
Here's how to use the model with transformers:
|
59 |
```python
|
60 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
|
|
|
|
|
|
61 |
|
62 |
model = AutoModelForCausalLM.from_pretrained(
|
63 |
-
"DiscoResearch/Llama3-DiscoLeo-Instruct-8B-
|
64 |
torch_dtype="auto",
|
65 |
device_map="auto"
|
66 |
)
|
|
|
58 |
Here's how to use the model with transformers:
|
59 |
```python
|
60 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
61 |
+
import torch
|
62 |
+
|
63 |
+
device="cuda"
|
64 |
|
65 |
model = AutoModelForCausalLM.from_pretrained(
|
66 |
+
"DiscoResearch/Llama3-DiscoLeo-Instruct-8B-32k",
|
67 |
torch_dtype="auto",
|
68 |
device_map="auto"
|
69 |
)
|