Upload 7 files

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+ggml-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
+ggml-model-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+ggml-model-Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
+ggml-model-Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
+ggml-model-Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
+ggml-model-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,59 @@
+---
+base_model:
+- SanjiWatsuki/Kunoichi-DPO-v2-7B
+- Epiculous/Fett-uccine-7B
+library_name: transformers
+tags:
+- mergekit
+- merge
+- alpaca
+- mistral
+---
+Thanks to @Epiculous for the dope model/ help with llm backends and support overall.
+
+Id like to also thank @kalomaze for the dope sampler additions to ST. 
+
+@SanjiWatsuki Thank you very much for the help, and the model!
+
+ST users can find the TextGenPreset in the folder labeled so.
+
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642265bc01c62c1e4102dc36/9obNSalcJqCilQwr_4ssM.jpeg)
+
+Quants:Thank you @bartowski! https://huggingface.co/bartowski/Kunocchini-exl2 and @s3nh https://huggingface.co/s3nh/Kunocchini-7b-128k-test-GGUF
+# mergedmodel
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the SLERP merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
+* [Epiculous/Fett-uccine-7B](https://huggingface.co/Epiculous/Fett-uccine-7B)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+slices:
+  - sources:
+      - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
+        layer_range: [0, 32]
+      - model: Epiculous/Fett-uccine-7B
+        layer_range: [0, 32]
+merge_method: slerp
+base_model: SanjiWatsuki/Kunoichi-DPO-v2-7B
+parameters:
+  t:
+    - filter: self_attn
+      value: [0, 0.5, 0.3, 0.7, 1]
+    - filter: mlp
+      value: [1, 0.5, 0.7, 0.3, 0]
+    - value: 0.5
+dtype: bfloat16
+```

ggml-model-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f564c7bd92c387c088435394149e93c846ea1c453ab15fc42e63e8193399f1c5
+size 2719241856

ggml-model-Q3_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:38b91baaadba5812e208603330fd593e84ea9f5458d1181b8f189d621b1d8755
+size 3518985856

ggml-model-Q4_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4ab5d33c4230dd27de52dff319df03e63c4cb4f2889986b2a3612040dca60ea6
+size 4368438912

ggml-model-Q5_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:322c80821dc9ef385d8954e231c2a1ae957cb3c024f88e341cb3b686c559ee8e
+size 5131409024

ggml-model-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a7b2e7e44352704d6067e746af7909933e43561fecb04137ca11297fbaebbe0
+size 5942064768

ggml-model-f16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3b8b9e588548293424ccc10ebf0cb384381dc74ea1930778f6845ee96a077dc5
+size 14484731456