File size: 2,465 Bytes
5bee87d 0dbed80 89e6782 ecb21f2 5bee87d bbe21c7 5bee87d b6252d0 5bee87d 1bde6b8 2f84e8a edca1b9 5bee87d b7035e2 5bee87d 961828a 5f5e35b 2f84e8a 5bee87d 5f5e35b edca1b9 5bee87d 0dbed80 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 |
---
license: apache-2.0
tags:
- ultra quality
- upscale 32 bit
- imatrix plus 2
- imatrix x
- creative
- story
- roleplay
- rp
- remastered
- writing
pipeline_tag: text-generation
---
<h3> Experimental running Quants of "Dark Sapling V2 7B Ultra Quality" (32 k context) in Imatrix Plus 2 and Imatrix X protocols. </h3>
<img src="robot-ferrari.jpg" style="width:400px; height:400px; float:right; padding:10px;">
Imatrix Plus 2 is an advanced Imatrix quanting method using multiple datasets.
Imatrix X takes Imatrix Plus 2 a step further and introduces a "pass-through merge" method between Imatrix Plus 2 and regular Quants.
This leverages the full power of both Imatrix Plus 2 and regular quant (which is based on Ultra Quality 32 bit precision).
This marries (to varying degrees) the best of THREE worlds: The Ultra Quality model, the Imatrix Plus 2 (and enhancements from the datasets)
, and the raw power of the unfiltered/unaltered Ultra Quality model itself.
These methods target the weak point(s) and enhance the strong point(s) at the same time.
Imatrix Plus 2 and Imatrix X are the next steps in Ultra Quality experience.
The 11 quants hosted here are various versions of "Imatrix X" (with Imatrix Plus 2), with the exception of
"DarkSapling-V2-Ultra-Quality-7B-Q4_k_m-imat1.gguf" which is stand alone Imatrix Plus 2.
All quants operate, however there is more work in progress and these quants are subject to revision without notice.
For testing purposes (if you download more than one) set "TEMP:0" and test your prompt(s).
You should use prompts with "no right answer" to fully evalute the quant (and vs other quants here).
Not all of these quants are suitable for all purposes and protocol(s) are still under developement.
Dark Sapling V2 7B is a fiction, roleplay, fantasy and story telling model.
Although all quants at this repo are all "Q4_K_M Imatrix 2" quants they differ greatly due to Imatrix X protocols.
Some will be far more verbose than others, answer differently, make stuff up, lie to you or worse... it might flirt with you.
Others will be more "sciency" in their replies, whereas others will be more "fictional".
Some Imat X versions even bring the core model to new levels of performance, above and beyond current 32 bit Ultra Quality levels.
Caution: Can generate NSFW content.
For more information on Dark Sapling V2 Ultra Quality please see:
[ https://huggingface.co/DavidAU/DarkSapling-V2-Ultra-Quality-7B-GGUF ] |