Initial release

.gitattributes

@@ -4,6 +4,7 @@
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,52 @@
 ---
+base_model:
+- grimjim/zephyr-beta-wizardLM-2-merge-7B
+- alpindale/Mistral-7B-v0.2-hf
+library_name: transformers
+tags:
+- mergekit
+- merge
 license: cc-by-nc-4.0
+pipeline_tag: text-generation
 ---
+# madwind-wizard-7B-GGUF
+
+This is a merge of pre-trained 7B language models created using [mergekit](https://github.com/cg123/mergekit).
+
+The intended goal of this merge was to combine the 32K context window of Mistral v0.2 base with the richness and strength of the Zephyr Beta and WizardLM 2 models. This was a mixed-precision merge, promoting Mistral v0.2 base from fp16 to bf16.
+
+The result can be used for text generation. Note that Zephyr Beta training removed in-built alignment from datasets, resulting in a model more likely to generate problematic text when prompted. This merge appears to have inherited that feature.
+
+- Full weights: [grimjim/madwind-wizard-7B](https://huggingface.co/grimjim/madwind-wizard-7B)
+- GGUF quants: [grimjim/madwind-wizard-7B-GGUF](https://huggingface.co/grimjim/madwind-wizard-7B-GGUF)
+
+## Merge Details
+### Merge Method
+
+This model was merged using the SLERP merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [grimjim/zephyr-beta-wizardLM-2-merge-7B](https://huggingface.co/grimjim/zephyr-beta-wizardLM-2-merge-7B)
+* [alpindale/Mistral-7B-v0.2-hf](https://huggingface.co/alpindale/Mistral-7B-v0.2-hf)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+slices:
+  - sources:
+    - model: alpindale/Mistral-7B-v0.2-hf
+      layer_range: [0,32]
+    - model: grimjim/zephyr-beta-wizardLM-2-merge-7B
+      layer_range: [0,32]
+merge_method: slerp
+base_model: alpindale/Mistral-7B-v0.2-hf
+parameters:
+  t:
+    - value: 0.5
+dtype: bfloat16
+
+```

madwind-wizard-7B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83fd2b27f1a0102d2f3d273a4a43d8473c6a9aeaf723c63ad14ba43951386ea2
+size 4368439072

madwind-wizard-7B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62821f889fc0f8ff869c93fcbf292ed7ebb0c0876d62e23282adfc0381ae72a9
+size 5131409184

madwind-wizard-7B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:21c057bd1694cd8f6965507e9aba2651d9ff8542a9e47d64511af0dddb3b5c83
+size 5942064928

madwind-wizard-7B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cb1e4bd92a8c7f0001ec0ab6d6512cad4ae60b1bca4f054ff57c21876d50d59e
+size 7695857440