Hugging Face's logo

BioMistral
/
BioMistral-7B-GGUF

Text Generation
Transformers
GGUF
mistral
medical
biology
Inference Endpoints
conversational
Model card Files Community
1
qanastek commited on
Commit
85cfa00
•
1 Parent(s): 3398658

Upload 7 files

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. ggml-model-Q4_0.gguf +3 -0
  3. ggml-model-Q4_K_M.gguf +3 -0
  4. ggml-model-Q4_K_S.gguf +3 -0
  5. ggml-model-Q5_K_M.gguf +3 -0
  6. ggml-model-Q5_K_S.gguf +3 -0
  7. ggml-model-Q6_K.gguf +3 -0
  8. ggml-model-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ggml-model-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ ggml-model-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ ggml-model-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ ggml-model-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ ggml-model-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ ggml-model-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ ggml-model-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
ggml-model-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:421e0c51bbfdc285dd5f70065f49df24d62d76317bf2469cb696633480e1869a
3
+ size 2746511360
ggml-model-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fc1397c3eb2ba46904540accce468479c17aaabe4c51f06665fddc1babef75d
3
+ size 4368439424
ggml-model-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fff7de79e65b96db59f2d5117e8507126b20bfb8d3d1abd0efd49ab030274294
3
+ size 4140374144
ggml-model-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3415073c45bc0aa3e6a6441adcdeb64e542a9544d2055e6c280903d729b11e7b
3
+ size 5131409536
ggml-model-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b836d5967800b9cbfaedb9397f953d2bbe5a69f11056a17d1c49568863f6a59c
3
+ size 4997716096
ggml-model-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:883c72f6b43af8c6cd17536706bd7e3aa9bc9d5c28fdd7206d3cdd4527bae2f6
3
+ size 5942065280
ggml-model-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ca44f2acdb4cb441161cd2e8ca48e6cb548c036e671a9a17212db4670070a1a
3
+ size 7695857792