Hugging Face's logo

bartowski
/
Tess-v2.5-Phi-3-medium-128k-14B-GGUF

Text Generation
GGUF
Generated from Trainer
Model card Files Community
1
bartowski commited on
Commit
055fba1
•
1 Parent(s): e887e65

Llamacpp quants

Browse files
Files changed (24) hide show
  1. .gitattributes +4 -0
  2. README.md +22 -18
  3. Tess-v2.5-Phi-3-medium-128k-14B-IQ2_M.gguf +2 -2
  4. Tess-v2.5-Phi-3-medium-128k-14B-IQ2_S.gguf +2 -2
  5. Tess-v2.5-Phi-3-medium-128k-14B-IQ2_XS.gguf +2 -2
  6. Tess-v2.5-Phi-3-medium-128k-14B-IQ3_M.gguf +2 -2
  7. Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XS.gguf +2 -2
  8. Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XXS.gguf +2 -2
  9. Tess-v2.5-Phi-3-medium-128k-14B-IQ4_XS.gguf +2 -2
  10. Tess-v2.5-Phi-3-medium-128k-14B-Q2_K.gguf +2 -2
  11. Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_L.gguf +2 -2
  12. Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_M.gguf +2 -2
  13. Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_S.gguf +2 -2
  14. Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_L.gguf +3 -0
  15. Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_M.gguf +2 -2
  16. Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_S.gguf +2 -2
  17. Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_L.gguf +3 -0
  18. Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_M.gguf +2 -2
  19. Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_S.gguf +2 -2
  20. Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf +2 -2
  21. Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf +3 -0
  22. Tess-v2.5-Phi-3-medium-128k-14B-Q8_0_L.gguf +3 -0
  23. Tess-v2.5-Phi-3-medium-128k-14B-f32.gguf/Tess-v2.5-Phi-3-medium-128k-14B-f32-00001-of-00002.gguf +1 -1
  24. Tess-v2.5-Phi-3-medium-128k-14B.imatrix +1 -1
.gitattributes CHANGED
@@ -53,3 +53,7 @@ Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
53
  Tess-v2.5-Phi-3-medium-128k-14B-f32.gguf/Tess-v2.5-Phi-3-medium-128k-14B-f32-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
54
  Tess-v2.5-Phi-3-medium-128k-14B-f32.gguf/Tess-v2.5-Phi-3-medium-128k-14B-f32-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
55
  Tess-v2.5-Phi-3-medium-128k-14B.imatrix filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
53
  Tess-v2.5-Phi-3-medium-128k-14B-f32.gguf/Tess-v2.5-Phi-3-medium-128k-14B-f32-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
54
  Tess-v2.5-Phi-3-medium-128k-14B-f32.gguf/Tess-v2.5-Phi-3-medium-128k-14B-f32-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
55
  Tess-v2.5-Phi-3-medium-128k-14B.imatrix filter=lfs diff=lfs merge=lfs -text
56
+ Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_L.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Tess-v2.5-Phi-3-medium-128k-14B-Q8_0_L.gguf filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -12,7 +12,7 @@ pipeline_tag: text-generation
12
 
13
  ## Llamacpp imatrix Quantizations of Tess-v2.5-Phi-3-medium-128k-14B
14
 
15
- Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3152">b3152</a> for quantization.
16
 
17
  Original model: https://huggingface.co/migtissera/Tess-v2.5-Phi-3-medium-128k-14B
18
 
@@ -33,23 +33,27 @@ All quants made using imatrix option with dataset from [here](https://gist.githu
33
 
34
  | Filename | Quant type | File Size | Description |
35
  | -------- | ---------- | --------- | ----------- |
36
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf) | Q8_0 | 15.14GB | Extremely high quality, generally unneeded but max available quant. |
37
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf) | Q6_K | 11.84GB | Very high quality, near perfect, *recommended*. |
38
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_M.gguf) | Q5_K_M | 10.48GB | High quality, *recommended*. |
39
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_S.gguf) | Q5_K_S | 10.03GB | High quality, *recommended*. |
40
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_M.gguf) | Q4_K_M | 8.99GB | Good quality, uses about 4.83 bits per weight, *recommended*. |
41
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_S.gguf) | Q4_K_S | 8.38GB | Slightly lower quality with more space savings, *recommended*. |
42
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ4_XS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ4_XS.gguf) | IQ4_XS | 7.90GB | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
43
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_L.gguf) | Q3_K_L | 7.94GB | Lower quality but usable, good for low RAM availability. |
44
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_M.gguf) | Q3_K_M | 7.37GB | Even lower quality. |
45
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ3_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ3_M.gguf) | IQ3_M | 6.92GB | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
46
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_S.gguf) | Q3_K_S | 6.51GB | Low quality, not recommended. |
47
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XS.gguf) | IQ3_XS | 6.25GB | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
48
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XXS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XXS.gguf) | IQ3_XXS | 5.92GB | Lower quality, new method with decent performance, comparable to Q3 quants. |
49
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q2_K.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q2_K.gguf) | Q2_K | 5.61GB | Very low quality but surprisingly usable. |
50
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ2_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ2_M.gguf) | IQ2_M | 5.19GB | Very low quality, uses SOTA techniques to also be surprisingly usable. |
51
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ2_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ2_S.gguf) | IQ2_S | 4.81GB | Very low quality, uses SOTA techniques to be usable. |
52
- | [Tess-v2.5-Phi-3-medium-128k-14B-IQ2_XS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ2_XS.gguf) | IQ2_XS | 4.61GB | Very low quality, uses SOTA techniques to be usable. |
 
 
 
 
53
 
54
  ## Downloading using huggingface-cli
55
 
 
12
 
13
  ## Llamacpp imatrix Quantizations of Tess-v2.5-Phi-3-medium-128k-14B
14
 
15
+ Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3166">b3166</a> for quantization.
16
 
17
  Original model: https://huggingface.co/migtissera/Tess-v2.5-Phi-3-medium-128k-14B
18
 
 
33
 
34
  | Filename | Quant type | File Size | Description |
35
  | -------- | ---------- | --------- | ----------- |
36
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_1.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF//main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_1.gguf) | Q8_1 | | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Extremely high quality, generally unneeded but max available quant. |
37
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf) | Q8_0 | 14.83GB | Extremely high quality, generally unneeded but max available quant. |
38
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf) | Q6_K_L | 11.84GB | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Very high quality, near perfect, *recommended*. |
39
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf) | Q6_K | 11.45GB | Very high quality, near perfect, *recommended*. |
40
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_L.gguf) | Q5_K_L | 10.48GB | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. High quality, *recommended*. |
41
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_M.gguf) | Q5_K_M | 10.07GB | High quality, *recommended*. |
42
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_S.gguf) | Q5_K_S | 9.62GB | High quality, *recommended*. |
43
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_L.gguf) | Q4_K_L | 8.99GB | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Good quality, uses about 4.83 bits per weight, *recommended*. |
44
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_M.gguf) | Q4_K_M | 8.56GB | Good quality, uses about 4.83 bits per weight, *recommended*. |
45
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_S.gguf) | Q4_K_S | 7.95GB | Slightly lower quality with more space savings, *recommended*. |
46
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ4_XS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ4_XS.gguf) | IQ4_XS | 7.46GB | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
47
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_L.gguf) | Q3_K_L | 7.49GB | Lower quality but usable, good for low RAM availability. |
48
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_M.gguf) | Q3_K_M | 6.92GB | Even lower quality. |
49
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ3_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ3_M.gguf) | IQ3_M | 6.47GB | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
50
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_S.gguf) | Q3_K_S | 6.06GB | Low quality, not recommended. |
51
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XS.gguf) | IQ3_XS | 5.80GB | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
52
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XXS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XXS.gguf) | IQ3_XXS | 5.45GB | Lower quality, new method with decent performance, comparable to Q3 quants. |
53
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q2_K.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q2_K.gguf) | Q2_K | 5.14GB | Very low quality but surprisingly usable. |
54
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ2_M.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ2_M.gguf) | IQ2_M | 4.71GB | Very low quality, uses SOTA techniques to also be surprisingly usable. |
55
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ2_S.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ2_S.gguf) | IQ2_S | 4.33GB | Very low quality, uses SOTA techniques to be usable. |
56
+ | [Tess-v2.5-Phi-3-medium-128k-14B-IQ2_XS.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-IQ2_XS.gguf) | IQ2_XS | 4.12GB | Very low quality, uses SOTA techniques to be usable. |
57
 
58
  ## Downloading using huggingface-cli
59
 
Tess-v2.5-Phi-3-medium-128k-14B-IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2afd762754f28666c53acf4a09cffe424c1b93a08eb94a0cf5791f2418d01750
3
- size 5190271008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64fb6b648f5fa84f3eb4dafeff7744e0afa770f3e56d48c68523e21b4b7e3b9b
3
+ size 4717006368
Tess-v2.5-Phi-3-medium-128k-14B-IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e23a5c7e1c39da0a0a6d7f925a9ec83fc397cfe1b37bf88edc738c1fd33e5f9d
3
- size 4811391008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbb08dd44d922944121fccd940ac0673637a9168766762f3600f4d72bda24eed
3
+ size 4338126368
Tess-v2.5-Phi-3-medium-128k-14B-IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b9535b9f341d8e7a26491028384dfe340543421c9163a5e0aa4bbcbae01235ed
3
- size 4617343008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c888f88cd89ca5591f8142266596b5022e2354bda10b8a5288c8a1a6db258e2
3
+ size 4127405088
Tess-v2.5-Phi-3-medium-128k-14B-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a80db5a75de5f79639612ce4fbbcc10e7cbf80f1f3d05c5388bc10b70c1a0f2d
3
- size 6925439008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:051f5f8c58730237a5ff3ccc7dc71a4301caf535d8785a8506ff1be9ba4a345b
3
+ size 6473977888
Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e49a04257c622e586dfeeaf9eaf1a41926da006d1937d3ec54499b1643ef3d27
3
- size 6258303008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:241bf49739394b85d87191536ff6852ccf5c6091919d90069fd5e6ca0dd72aaf
3
+ size 5806841888
Tess-v2.5-Phi-3-medium-128k-14B-IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:87aa9a5b119319760bd5e6871fa185654c380d81b0bf8ba1da60e7cc44ca6c24
3
- size 5926527008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2960df665e86324a65b610153c3d26c768e890e5ae50b7192ed1f58dd9e15a8
3
+ size 5453262368
Tess-v2.5-Phi-3-medium-128k-14B-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a79d375a5f054f3113fc7975791cfea5994827a2a527ae35c3fa37f45aa8f993
3
- size 7900799008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a64503753418a69ab07fd4c3a2b982d464cbff2628af2762f8a53b153ab1b70
3
+ size 7466011168
Tess-v2.5-Phi-3-medium-128k-14B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5df891b4408ddac087c1fc08325d3e4534726906f56a6d9f3089cfcbaf001ffc
3
- size 5611135008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:871706e12623d125d931b5aa75e50db0932cbe71969e39db37c8a4d7295b6805
3
+ size 5143000608
Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5c01e684af28620cf4f734ce33b9a533a6cd7ef43007138b23d350dbcf124874
3
- size 7941759008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82dbf59209f6db4a8478ba60737c4610e923042e8f808f84a267dd2532cb6f97
3
+ size 7490297888
Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:74385ce065eccee110774e3cf987d91b33f4371e7259daf79923c00c945f7fda
3
- size 7374872608
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f46c253bdf1f27f69adb76ff6a5e1cc3e822988f5d6e65593a40054580f6c52
3
+ size 6923411488
Tess-v2.5-Phi-3-medium-128k-14B-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7da7652aa23168d462326506c94057691d6fc844e25f4003c675ac5fc27d1dc4
3
- size 6516351008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff3fc536dfa507f088dccc9f753dc672ce5715441655a9388a96c1287612e2a3
3
+ size 6064889888
Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:492ef6fb088e7080e568ed6fff7a02f16b4b157ba6c58ca9f93fd6c5b17e2c21
3
+ size 8996479008
Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9efb6ebc00de74012d0fb36134cce07d624a870fc12f38b16b57ce447b86e27e
3
- size 8996479008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37267609552586bfae6b29bb1b5da7243863b1a8d49e3156229fb82c4407d17d
3
+ size 8566821408
Tess-v2.5-Phi-3-medium-128k-14B-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:edc80c942f2c334763c4405a44e397d88208a9bc623bb35b7a46ad37c6172572
3
- size 8384127008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea44e0e62fec22f021fedd0001a97af6e93401242497e13bbe957171ef27741e
3
+ size 7954469408
Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b1091c453e0e45909c0fe18a56e899b80e56a8d986b7e51e8c5c5df09c65b6a
3
+ size 10483327008
Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a6c8291099bc4e75c36a0008e9ce8e2d0be1db7b6cffc51615f42ae0d85572f
3
- size 10483327008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5073823904f973d1116caa83fcc03b3349e4aebc522fa839df27ac3d3fc43439
3
+ size 10074190368
Tess-v2.5-Phi-3-medium-128k-14B-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2691f0326ba5cc9e9fda3fc157cb25931ba2c02a4b4a56740cb0aa87e14f4de6
3
- size 10030719008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:359a6e3a4529592255641976e7533a4fa3b4414d1fd21c93c4d6b7d80c030a0a
3
+ size 9621582368
Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:57f020cd182091726a70a9519e49ae54616b3989a2cc14b2bf45b87fd2c06120
3
- size 11841151008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f0c7188f02c60889c94786e84f1988338bc13b166bffc7658c779e95e949bcf
3
+ size 11453817888
Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ee8f8f88218a377197ce35541bf8425a975441668afc9d6a4b0c01180bbb635
3
+ size 11841151008
Tess-v2.5-Phi-3-medium-128k-14B-Q8_0_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d89fef59e8233f1cac707d3521e0eefb6298613ed8a8db57270b7823ff09dad4
3
+ size 15142527008
Tess-v2.5-Phi-3-medium-128k-14B-f32.gguf/Tess-v2.5-Phi-3-medium-128k-14B-f32-00001-of-00002.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e2d424c5dfcb650041cd517df000851bc91c003271afc8ff108b586f937eb92e
3
  size 39455887104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e490e671494958f7f502fdbcd8bc89c9f722019c10139c8c0594027c634aaf8
3
  size 39455887104
Tess-v2.5-Phi-3-medium-128k-14B.imatrix CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:55e66982ff9c0b0adb29f4914bbe229fb1bd52b26d1c6c7a330ba1b7ccb6ee85
3
  size 5330289
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19c0b8f545880972242fc83795ad839d0dd02c065c25fea4840d74eb97b89a53
3
  size 5330289