learnanything
commited on
Commit
•
ca5c1b3
1
Parent(s):
28775d1
Update README.md
Browse files
README.md
CHANGED
@@ -23,12 +23,12 @@ model = AutoModel.from_pretrained('learnanything/llama-7b-huggingface')
|
|
23 |
tokenizer = AutoTokenizer.from_pretrained('learnanything/llama-7b-huggingface')
|
24 |
```
|
25 |
|
26 |
-
### Load in
|
27 |
|
28 |
-
First install `bitsandbytes` by
|
29 |
|
30 |
```shell
|
31 |
-
python3 -m pip install bitsandbytes
|
32 |
```
|
33 |
|
34 |
and then
|
|
|
23 |
tokenizer = AutoTokenizer.from_pretrained('learnanything/llama-7b-huggingface')
|
24 |
```
|
25 |
|
26 |
+
### Load LLaMa in 8bit
|
27 |
|
28 |
+
First install `bitsandbytes` and `accelerate` by
|
29 |
|
30 |
```shell
|
31 |
+
python3 -m pip install bitsandbytes accelerate
|
32 |
```
|
33 |
|
34 |
and then
|