shaowenchen
/

vicuna-7b-v1.5-16k-gguf

Text Generation

Model card Files Files and versions Community

shaowenchen commited on Sep 12, 2023

Commit

93b1c30

•

1 Parent(s): a0b7213

add images to readme

Files changed (1) hide show

README.md +5 -3

README.md CHANGED Viewed

@@ -48,9 +48,11 @@ and you can view http://localhost:8000/docs to see the swagger UI.
 ## Provided images
-| Name                                  | Quant method | Size    |
-| ------------------------------------- | ------------ | ------- |
-| `shaowenchen/vicuna-7b-v1.5-16k-gguf` | Q2_K         | 3.68 GB |
 Usage:

 ## Provided images
+| Name                                       | Quant method | Compressed Size |
+| ------------------------------------------ | ------------ | --------------- |
+| `shaowenchen/vicuna-7b-v1.5-16k-gguf:Q2_K` | Q2_K         | 2.88 GB         |
+| `shaowenchen/vicuna-7b-v1.5-16k-gguf:Q3_K` | Q3_K         | 3.3 GB          |
+| `shaowenchen/vicuna-7b-v1.5-16k-gguf:Q4_K` | Q4_K         | 4 GB            |
 Usage: