atsuki-yamaguchi commited on
Commit
86842e4
1 Parent(s): ff9cfe2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -15,6 +15,13 @@ from transformers import AutoTokenizer
15
  model = AutoPeftModelForCausalLM.from_pretrained(
16
  "atsuki-yamaguchi/bloom-7b1-clpp-ar"
17
  )
 
 
 
 
 
 
 
18
  ```
19
 
20
  ## Citation
 
15
  model = AutoPeftModelForCausalLM.from_pretrained(
16
  "atsuki-yamaguchi/bloom-7b1-clpp-ar"
17
  )
18
+
19
+ # w/ GPU
20
+ model = AutoModelForCausalLM.from_pretrained(
21
+ "atsuki-yamaguchi/bloom-7b1-clpp-ar",
22
+ device_map="auto",
23
+ load_in_8bit=True,
24
+ )
25
  ```
26
 
27
  ## Citation