Commit
•
cf53f37
1
Parent(s):
188229c
add images to readme
Browse files
README.md
CHANGED
@@ -50,9 +50,9 @@ and you can view http://localhost:8000/docs to see the swagger UI.
|
|
50 |
|
51 |
| Name | Quant method | Compressed Size |
|
52 |
| ------------------------------------------- | ------------ | --------------- |
|
53 |
-
| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q2_K` | Q2_K |
|
54 |
-
| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q3_K` | Q3_K |
|
55 |
-
| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q4_K` | Q4_K |
|
56 |
|
57 |
Usage:
|
58 |
|
|
|
50 |
|
51 |
| Name | Quant method | Compressed Size |
|
52 |
| ------------------------------------------- | ------------ | --------------- |
|
53 |
+
| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q2_K` | Q2_K | 5.29 GB |
|
54 |
+
| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q3_K` | Q3_K | 6.11 GB |
|
55 |
+
| `shaowenchen/vicuna-13b-v1.5-16k-gguf:Q4_K` | Q4_K | 7.47 GB |
|
56 |
|
57 |
Usage:
|
58 |
|