chharlesonfire commited on
Commit
0d7df93
1 Parent(s): 7a5a40a

First model version

Browse files
Files changed (2) hide show
  1. README.md +13 -0
  2. ggml-vicuna-7b-q4_0.bin +3 -0
README.md CHANGED
@@ -1,3 +1,16 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ ## convert ggml-vicuna-7b-f16 to ggml-vicuna-7b-q4_0
6
+ Source: https://huggingface.co/chharlesonfire/ggml-vicuna-7b-f16
7
+
8
+ No unnecessary changes
9
+
10
+ ## Usage:
11
+
12
+ 1. Download llama.cpp from https://github.com/ggerganov/llama.cpp
13
+
14
+ 2. make and run llama.cpp and choose model with ggml-vicuna-7b-q4_0.bin
15
+
16
+
ggml-vicuna-7b-q4_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a72cabdef3d6bbf3e69aef0894f3e4ec966a8ba6181891e932ca7e462cb6682
3
+ size 4212864640