Hugging Face's logo

bartowski
/
EveryoneLLM-7b-Gemma-Base-GGUF-old

Text Generation
GGUF
Merge
Inference Endpoints
Model card Files Community
1
bartowski commited on
Commit
752fb5b
•
1 Parent(s): 2969a98

Llamacpp quants

Browse files
Files changed (14) hide show
  1. .gitattributes +12 -0
  2. EveryoneLLM-7b-Gemma-Base-Q2_K.gguf +3 -0
  3. EveryoneLLM-7b-Gemma-Base-Q3_K_L.gguf +3 -0
  4. EveryoneLLM-7b-Gemma-Base-Q3_K_M.gguf +3 -0
  5. EveryoneLLM-7b-Gemma-Base-Q3_K_S.gguf +3 -0
  6. EveryoneLLM-7b-Gemma-Base-Q4_0.gguf +3 -0
  7. EveryoneLLM-7b-Gemma-Base-Q4_K_M.gguf +3 -0
  8. EveryoneLLM-7b-Gemma-Base-Q4_K_S.gguf +3 -0
  9. EveryoneLLM-7b-Gemma-Base-Q5_0.gguf +3 -0
  10. EveryoneLLM-7b-Gemma-Base-Q5_K_M.gguf +3 -0
  11. EveryoneLLM-7b-Gemma-Base-Q5_K_S.gguf +3 -0
  12. EveryoneLLM-7b-Gemma-Base-Q6_K.gguf +3 -0
  13. EveryoneLLM-7b-Gemma-Base-Q8_0.gguf +3 -0
  14. README.md +34 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ EveryoneLLM-7b-Gemma-Base-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ EveryoneLLM-7b-Gemma-Base-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ EveryoneLLM-7b-Gemma-Base-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ EveryoneLLM-7b-Gemma-Base-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ EveryoneLLM-7b-Gemma-Base-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ EveryoneLLM-7b-Gemma-Base-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ EveryoneLLM-7b-Gemma-Base-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ EveryoneLLM-7b-Gemma-Base-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
44
+ EveryoneLLM-7b-Gemma-Base-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ EveryoneLLM-7b-Gemma-Base-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ EveryoneLLM-7b-Gemma-Base-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ EveryoneLLM-7b-Gemma-Base-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
EveryoneLLM-7b-Gemma-Base-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4283eb215dc46fc84993b471a069e25ee0f6712efa6f1bd504d60423a0ddd66e
3
+ size 3094374752
EveryoneLLM-7b-Gemma-Base-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0214879a5d1be9df66679ca664498253de5d86c045a3761b0b239a094f271a71
3
+ size 4401867104
EveryoneLLM-7b-Gemma-Base-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ceb3610b7997f7f23a801edf55b7bdce3c283d7849caec6350467973e120f98
3
+ size 4062128480
EveryoneLLM-7b-Gemma-Base-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5d80a34d9c8136ed6006417fa044aefee8dd56e1704306cf8439f53e9a4b1cb
3
+ size 3675203936
EveryoneLLM-7b-Gemma-Base-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d407832df50a2dbad0b99fc8036dcf5ccba56e64db0f42fdbf20f5c8202d711
3
+ size 4809091424
EveryoneLLM-7b-Gemma-Base-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91693d7c0e779571fcd3dd413b3b97a7121987c30c7aea921783cce90b100af9
3
+ size 5127006560
EveryoneLLM-7b-Gemma-Base-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8f4cfb2d7f019484d94aff4a194d6fac2d01c00aaccf4f70c6e7e5f1577fbc3
3
+ size 4843694432
EveryoneLLM-7b-Gemma-Base-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22260e602b58d0efde9ed0071310f7d6b76741d4f5a50de7e119d82d818a619e
3
+ size 5876279648
EveryoneLLM-7b-Gemma-Base-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db9236bb3d8a27054ac196595f4b9e47ddaccb194fe611cad010e9ebec3f1fbc
3
+ size 6040054112
EveryoneLLM-7b-Gemma-Base-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5fcc0cf813e3b285c18993a4070571fb05fb3ea5ac1f6020d8b99981bfbef287
3
+ size 5876279648
EveryoneLLM-7b-Gemma-Base-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c9910df78a086810f1a2691bb971560b52df69a77df9b8752e660920c89d893
3
+ size 7010167136
EveryoneLLM-7b-Gemma-Base-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1560fc4fd55111024e6d753872f0e4f013a41ccbe33632d9b7f81211743365b
3
+ size 9077844320
README.md ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: gemma-terms-of-use
4
+ license_link: https://ai.google.dev/gemma/terms
5
+ tags:
6
+ - merge
7
+ quantized_by: bartowski
8
+ pipeline_tag: text-generation
9
+ ---
10
+
11
+ ## Llamacpp Quantizations of EveryoneLLM-7b-Gemma-Base
12
+
13
+ Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b2354">b2354</a> for quantization.
14
+
15
+ Original model: https://huggingface.co/rombodawg/EveryoneLLM-7b-Gemma-Base
16
+
17
+ Download a file (not the whole branch) from below:
18
+
19
+ | Filename | Quant type | File Size | Description |
20
+ | -------- | ---------- | --------- | ----------- |
21
+ | [EveryoneLLM-7b-Gemma-Base-Q8_0.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q8_0.gguf) | Q8_0 | 9.07GB | Extremely high quality, generally unneeded but max available quant. |
22
+ | [EveryoneLLM-7b-Gemma-Base-Q6_K.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q6_K.gguf) | Q6_K | 7.01GB | Very high quality, near perfect, *recommended*. |
23
+ | [EveryoneLLM-7b-Gemma-Base-Q5_K_M.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q5_K_M.gguf) | Q5_K_M | 6.04GB | High quality, very usable. |
24
+ | [EveryoneLLM-7b-Gemma-Base-Q5_K_S.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q5_K_S.gguf) | Q5_K_S | 5.87GB | High quality, very usable. |
25
+ | [EveryoneLLM-7b-Gemma-Base-Q5_0.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q5_0.gguf) | Q5_0 | 5.87GB | High quality, older format, generally not recommended. |
26
+ | [EveryoneLLM-7b-Gemma-Base-Q4_K_M.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q4_K_M.gguf) | Q4_K_M | 5.12GB | Good quality, similar to 4.25 bpw. |
27
+ | [EveryoneLLM-7b-Gemma-Base-Q4_K_S.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q4_K_S.gguf) | Q4_K_S | 4.84GB | Slightly lower quality with small space savings. |
28
+ | [EveryoneLLM-7b-Gemma-Base-Q4_0.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q4_0.gguf) | Q4_0 | 4.80GB | Decent quality, older format, generally not recommended. |
29
+ | [EveryoneLLM-7b-Gemma-Base-Q3_K_L.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q3_K_L.gguf) | Q3_K_L | 4.40GB | Lower quality but usable, good for low RAM availability. |
30
+ | [EveryoneLLM-7b-Gemma-Base-Q3_K_M.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q3_K_M.gguf) | Q3_K_M | 4.06GB | Even lower quality. |
31
+ | [EveryoneLLM-7b-Gemma-Base-Q3_K_S.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q3_K_S.gguf) | Q3_K_S | 3.67GB | Low quality, not recommended. |
32
+ | [EveryoneLLM-7b-Gemma-Base-Q2_K.gguf](https://huggingface.co/bartowski/EveryoneLLM-7b-Gemma-Base-GGUF//main/EveryoneLLM-7b-Gemma-Base-Q2_K.gguf) | Q2_K | 3.09GB | Extremely low quality, *not* recommended.
33
+
34
+ Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski