cosimoiaia commited on
Commit
2676858
1 Parent(s): f7ec9af

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -4
README.md CHANGED
@@ -44,11 +44,14 @@ https://huggingface.co/cosimoiaia/Loquace-20B - Based on gpt-neox-20B
44
 
45
 
46
  ```python
47
- from peft import PeftModel
48
- from transformers import LLaMATokenizer, LLaMAForCausalLM, GenerationConfig
 
 
 
49
 
50
- tokenizer = LLaMATokenizer.from_pretrained("cosimoiaia/Loquace-70m")
51
- model = LLaMAForCausalLM.from_pretrained(
52
  "cosimoiaia/Loquace-70m",
53
  load_in_8bit=True,
54
  device_map="auto",
 
44
 
45
 
46
  ```python
47
+ from transformers import (
48
+ AutoTokenizer,
49
+ AutoModelForCausalLM,
50
+ BitsAndBytesConfig
51
+ )
52
 
53
+ tokenizer = AutoTokenizer.from_pretrained("cosimoiaia/Loquace-70m", padding_side="right", use_fast=True)
54
+ model = AutoModelForCausalLM.from_pretrained(
55
  "cosimoiaia/Loquace-70m",
56
  load_in_8bit=True,
57
  device_map="auto",