Hugging Face's logo

bartowski
/
Tess-v2.5-Phi-3-medium-128k-14B-GGUF

Text Generation
GGUF
Generated from Trainer
Model card Files Community
1
bartowski commited on
Commit
fad49ea
•
1 Parent(s): 055fba1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -33,7 +33,7 @@ All quants made using imatrix option with dataset from [here](https://gist.githu
33
 
34
  | Filename | Quant type | File Size | Description |
35
  | -------- | ---------- | --------- | ----------- |
36
- | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_1.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF//main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_1.gguf) | Q8_1 | | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Extremely high quality, generally unneeded but max available quant. |
37
  | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf) | Q8_0 | 14.83GB | Extremely high quality, generally unneeded but max available quant. |
38
  | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf) | Q6_K_L | 11.84GB | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Very high quality, near perfect, *recommended*. |
39
  | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf) | Q6_K | 11.45GB | Very high quality, near perfect, *recommended*. |
 
33
 
34
  | Filename | Quant type | File Size | Description |
35
  | -------- | ---------- | --------- | ----------- |
36
+ | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_0_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_0_L.gguf) | Q8_0_L | 15.1GB | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Extremely high quality, generally unneeded but max available quant. |
37
  | [Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q8_0.gguf) | Q8_0 | 14.83GB | Extremely high quality, generally unneeded but max available quant. |
38
  | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K_L.gguf) | Q6_K_L | 11.84GB | *Experimental*, uses f16 for embed and output weights. Please provide any feedback of differences. Very high quality, near perfect, *recommended*. |
39
  | [Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf](https://huggingface.co/bartowski/Tess-v2.5-Phi-3-medium-128k-14B-GGUF/blob/main/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf) | Q6_K | 11.45GB | Very high quality, near perfect, *recommended*. |