Initial release

.gitattributes

@@ -4,6 +4,7 @@
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,52 @@
----
-license: cc-by-nc-4.0
----
+---
+base_model:
+- grimjim/rogue-enchantress-32k-7B
+- grimjim/kunoichi-lemon-royale-v2-32K-7B
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: cc-by-nc-4.0
+pipeline_tag: text-generation
+---
+# kunoichi-lemon-royale-v3-32K-7B
+
+This is a merge of pre-trained Mistral 7B language models created using [mergekit](https://github.com/cg123/mergekit).
+
+With this merger, we explore *merge densification*, a merge approach that attempts to transfer and adapt some benefits of denser models. A highly creative model, which itself was merged from multiple dense models, was merged in at very low weight in order to lightly modify the base model. The result was expected to improve variability in output without significantly impacting the coherence in the base model.
+
+Tested with ChatML instruct templates, temperature 1.0, and minP 0.02. Practical context length should be at least 16K.
+
+The additional model merge weight of 0.02 was deliberately chosen to be on par with the minP setting.
+
+- Full weights: [grimjim/kunoichi-lemon-royale-v3-32K-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-v3-32K-7B)
+- GGUF quants: [grimjim/kunoichi-lemon-royale-v3-32K-7B-GGUF](https://huggingface.co/grimjim/kunoichi-lemon-royale-v3-32K-7B-GGUF)
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [grimjim/kunoichi-lemon-royale-v2-32K-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-v2-32K-7B) as a base.
+
+### Models Merged
+
+The following model was also included in the merge:
+* [grimjim/rogue-enchantress-32k-7B](https://huggingface.co/grimjim/rogue-enchantress-32k-7B)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+base_model: grimjim/kunoichi-lemon-royale-v2-32K-7B
+dtype: bfloat16
+merge_method: task_arithmetic
+slices:
+- sources:
+  - layer_range: [0, 32]
+    model: grimjim/kunoichi-lemon-royale-v2-32K-7B
+  - layer_range: [0, 32]
+    model: grimjim/rogue-enchantress-32k-7B
+    parameters:
+      weight: 0.02
+
+```

kunoichi-lemon-royale-v3-32K-7B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6cddc2118f034bbef68554daff3bd385a30853138bb3524f895e9a8e47359ee6
+size 4368439616

kunoichi-lemon-royale-v3-32K-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ab07da7dce842aba247802dada8f625b7d008ca0eabbcbc499fb35f081587c2
+size 5131409728

kunoichi-lemon-royale-v3-32K-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bbf3065df79ad54b215dca474a055ed1ae79f0399e26812ce641de8ace7eb484
+size 5942065472

kunoichi-lemon-royale-v3-32K-7B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:265b436a8bfd5af113895d67a80bfc1dd6d0244afe90b4a940252a8558571199
+size 7695857984