Update README.md
Browse filesMissing quotes in the full precision python snippet for the model inference
README.md
CHANGED
@@ -46,7 +46,7 @@ model = AutoModelForCausalLM.from_pretrained(checkpoint).to(device)
|
|
46 |
inputs = tokenizer.encode("def print_hello_world():", return_tensors="pt").to(device)
|
47 |
outputs = model.generate(inputs)
|
48 |
print(tokenizer.decode(outputs[0]))
|
49 |
-
|
50 |
* _Using `torch.bfloat16`_
|
51 |
```python
|
52 |
# pip install accelerate
|
|
|
46 |
inputs = tokenizer.encode("def print_hello_world():", return_tensors="pt").to(device)
|
47 |
outputs = model.generate(inputs)
|
48 |
print(tokenizer.decode(outputs[0]))
|
49 |
+
```
|
50 |
* _Using `torch.bfloat16`_
|
51 |
```python
|
52 |
# pip install accelerate
|