Update README.md
Browse files
README.md
CHANGED
|
@@ -21,20 +21,18 @@ Default arguments used except when the bits per weight is above 6.0, at that poi
|
|
| 21 |
|
| 22 |
Original model: https://huggingface.co/internlm/internlm2-chat-20b
|
| 23 |
|
|
|
|
| 24 |
|
|
|
|
| 25 |
|
| 26 |
-
<a href="https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2/tree/
|
| 27 |
-
|
| 28 |
-
<a href="https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2/tree/4_5">4.5 bits per weight</a>
|
| 29 |
-
|
| 30 |
-
<a href="https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2/tree/3_5">3.5 bits per weight</a>
|
| 31 |
|
| 32 |
## Download instructions
|
| 33 |
|
| 34 |
With git:
|
| 35 |
|
| 36 |
```shell
|
| 37 |
-
git clone --single-branch --branch 4_0 https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2
|
| 38 |
```
|
| 39 |
|
| 40 |
With huggingface hub (credit to TheBloke for instructions):
|
|
@@ -47,12 +45,12 @@ To download the `main` (only useful if you only care about measurement.json) bra
|
|
| 47 |
|
| 48 |
```shell
|
| 49 |
mkdir internlm2-chat-20b-llama-exl2
|
| 50 |
-
huggingface-cli download bartowski/internlm2-chat-20b-llama-exl2 --local-dir internlm2-chat-20b-llama-exl2 --local-dir-use-symlinks False
|
| 51 |
```
|
| 52 |
|
| 53 |
To download from a different branch, add the `--revision` parameter:
|
| 54 |
|
| 55 |
```shell
|
| 56 |
mkdir internlm2-chat-20b-llama-exl2
|
| 57 |
-
huggingface-cli download bartowski/internlm2-chat-20b-llama-exl2 --revision 4_0 --local-dir internlm2-chat-20b-llama-exl2 --local-dir-use-symlinks False
|
| 58 |
```
|
|
|
|
| 21 |
|
| 22 |
Original model: https://huggingface.co/internlm/internlm2-chat-20b
|
| 23 |
|
| 24 |
+
<a href="https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2-old/tree/6_5">6.5 bits per weight</a>
|
| 25 |
|
| 26 |
+
<a href="https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2-old/tree/4_5">4.5 bits per weight</a>
|
| 27 |
|
| 28 |
+
<a href="https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2-old/tree/3_5">3.5 bits per weight</a>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
## Download instructions
|
| 31 |
|
| 32 |
With git:
|
| 33 |
|
| 34 |
```shell
|
| 35 |
+
git clone --single-branch --branch 4_0 https://huggingface.co/bartowski/internlm2-chat-20b-llama-exl2-old
|
| 36 |
```
|
| 37 |
|
| 38 |
With huggingface hub (credit to TheBloke for instructions):
|
|
|
|
| 45 |
|
| 46 |
```shell
|
| 47 |
mkdir internlm2-chat-20b-llama-exl2
|
| 48 |
+
huggingface-cli download bartowski/internlm2-chat-20b-llama-exl2-old --local-dir internlm2-chat-20b-llama-exl2 --local-dir-use-symlinks False
|
| 49 |
```
|
| 50 |
|
| 51 |
To download from a different branch, add the `--revision` parameter:
|
| 52 |
|
| 53 |
```shell
|
| 54 |
mkdir internlm2-chat-20b-llama-exl2
|
| 55 |
+
huggingface-cli download bartowski/internlm2-chat-20b-llama-exl2-old --revision 4_0 --local-dir internlm2-chat-20b-llama-exl2 --local-dir-use-symlinks False
|
| 56 |
```
|