bartowski
/

Tess-v2.5-Gemma-2-27B-alpha-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

bartowski commited on Jul 2

Commit

f93e60c

•

1 Parent(s): d33151f

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -12,14 +12,14 @@ Original model: https://huggingface.co/migtissera/Tess-v2.5-Gemma-2-27B-alpha
 All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
 ## Prompt format
 ```
-<bos><start_of_turn>user
 {prompt}<end_of_turn>
 <start_of_turn>model
-<end_of_turn>
-<start_of_turn>model
 ```

 All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
+Experimental quants are made with `--output-tensor-type f16 --token-embedding-type f16` per [ZeroWw](https://huggingface.co/ZeroWw)'s suggestion, please provide any feedback on quality differences you spot.
 ## Prompt format
 ```
+<start_of_turn>user
 {prompt}<end_of_turn>
 <start_of_turn>model
 ```