Commit
•
8705647
1
Parent(s):
8439e86
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -38,3 +38,21 @@ tags:
|
|
| 38 |
| [chinese-alpaca-2-7b.Q6_K.gguf](https://huggingface.co/shaowenchen/chinese-alpaca-2-7b-GGUF/blob/main/chinese-alpaca-2-7b.Q6_K.gguf) | Q6_K | 5.3 GB |
|
| 39 |
| [chinese-alpaca-2-7b.Q8_0.gguf](https://huggingface.co/shaowenchen/chinese-alpaca-2-7b-GGUF/blob/main/chinese-alpaca-2-7b.Q8_0.gguf) | Q8_0 | 6.9 GB |
|
| 40 |
| [chinese-alpaca-2-7b.gguf](https://huggingface.co/shaowenchen/chinese-alpaca-2-7b-GGUF/blob/main/chinese-alpaca-2-7b.gguf) | full | 13 GB |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
| [chinese-alpaca-2-7b.Q6_K.gguf](https://huggingface.co/shaowenchen/chinese-alpaca-2-7b-GGUF/blob/main/chinese-alpaca-2-7b.Q6_K.gguf) | Q6_K | 5.3 GB |
|
| 39 |
| [chinese-alpaca-2-7b.Q8_0.gguf](https://huggingface.co/shaowenchen/chinese-alpaca-2-7b-GGUF/blob/main/chinese-alpaca-2-7b.Q8_0.gguf) | Q8_0 | 6.9 GB |
|
| 40 |
| [chinese-alpaca-2-7b.gguf](https://huggingface.co/shaowenchen/chinese-alpaca-2-7b-GGUF/blob/main/chinese-alpaca-2-7b.gguf) | full | 13 GB |
|
| 41 |
+
|
| 42 |
+
## Provided images
|
| 43 |
+
|
| 44 |
+
| Name | Quant method | Size |
|
| 45 |
+
| ------------------------------------------------------------------------------------------------------------------------------------ | ------------ | ------- |
|
| 46 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q2_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q2_K | 3.68 GB |
|
| 47 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q3_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q3_K | 4.16 GB |
|
| 48 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q3_K_L](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q3_K_L | 4.46 GB |
|
| 49 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q3_K_S](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q3_K_S | 3.81 GB |
|
| 50 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q4_0](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q4_0 | 4.7 GB |
|
| 51 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q4_K](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q4_K | 4.95 GB |
|
| 52 |
+
| [shaowenchen/chinese-alpaca-2-7b-gguf:Q4_K_S](https://hub.docker.com/repository/docker/shaowenchen/chinese-alpaca-2-7b-gguf/general) | Q4_K_S | 4.73 GB |
|
| 53 |
+
|
| 54 |
+
```
|
| 55 |
+
docker run --rm -p 8000:8000 shaowenchen/chinese-alpaca-2-7b-gguf:Q2_K
|
| 56 |
+
```
|
| 57 |
+
|
| 58 |
+
and open http://localhost:8000/docs to view the API documentation.
|