File size: 1,793 Bytes
5bee87d 0dbed80 89e6782 5bee87d b7035e2 5bee87d 961828a 5f5e35b 5bee87d 5f5e35b 5bee87d 0dbed80 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
license: apache-2.0
tags:
- ultra quality
- upscale 32 bit
- imatrix plus 2
- imatrix x
- creative
- story
- roleplay
- rp
- remastered
- writing
---
<h3> Experimental running Quants of "Dark Sapling V2 7B Ultra Quality" (32k context) in Imatrix Plus 2 and Imatrix X protocols. </h3>
Imatrix Plus 2 is an advanced Imatrix quanting method using multiple datasets.
Imatrix X takes Imatrix Plus 2 a step further and introduces a "pass-through merge" method between Imatrix Plus 2 and regular Quants.
This leverages the full power of both Imatrix Plus 2 and regular quant (which is based on Ultra Quality 32 bit precision).
Imatrix Plus 2 and Imatrix X are the next steps in Ultra Quality experience.
The 11 quants hosted here are various versions of "Imatrix X" (with Imatrix Plus 2), with the exception of
"DarkSapling-V2-Ultra-Quality-7B-Q4_k_m-imat1.gguf" which is stand alone Imatrix Plus 2.
All quants operate, however there is more work in progress and these quants are subject to revision without notice.
For testing purposes (if you download more than one) set "TEMP:0" and test your prompt(s).
You should use prompts with "no right answer" to fully evalute the quant (and vs other quants here).
Not all of these quants are suitable for all purposes and protocol(s) are still under developement.
Dark Sapling V2 7B is a fiction, roleplay, fantasy and story telling model.
Although these are all "Q4_K_M Imatrix 2" quants they differ greatly due to Imatrix X protocols.
Some will be far more verbose than others, answer differently, make stuff up, lie to you or worse... it might flirt with you.
Caution: Can generate NSFW content.
For more information on Dark Sapling V2 Ultra Quality please see:
[ https://huggingface.co/DavidAU/DarkSapling-V2-Ultra-Quality-7B-GGUF ] |