Upload 6 files

.gitattributes

@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+West-Hermes-7B-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+West-Hermes-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+West-Hermes-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+West-Hermes-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+West-Hermes-7B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,48 @@
 ---
-license: apache-2.0
+base_model:
+- teknium/OpenHermes-2.5-Mistral-7B
+- mistralai/Mistral-7B-v0.1
+- senseable/WestLake-7B-v2
+tags:
+- mergekit
+- merge
+
 ---
+# merge
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)
+* [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: mistralai/Mistral-7B-v0.1
+    # No parameters necessary for base model
+  - model: senseable/WestLake-7B-v2
+    parameters:
+      density: 0.53
+      weight: 0.75
+  - model: teknium/OpenHermes-2.5-Mistral-7B
+    parameters:
+      density: 0.53
+      weight: 0.25
+merge_method: dare_ties
+base_model: mistralai/Mistral-7B-v0.1
+parameters:
+  int8_mask: true
+dtype: bfloat16
+
+```

West-Hermes-7B-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7b006c9fc759beffc24b7d4d752e78e2a4cbeaa4c5713e5232a442940728cc4
+size 2719241920

West-Hermes-7B-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:001359714b46c266f20827351c5606e202ecbc1f701132c7b7846cd710f104b5
+size 3518985920

West-Hermes-7B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff9960242f438bb5cd3b7f235fbef56e6c9750b2d097cf9eacf2f63e7cd60cee
+size 4368438976

West-Hermes-7B-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a3dfa46e60309c600cd692815382328f4c9cb965a6fe186638e0cf3fb4f994a1
+size 5131409088

West-Hermes-7B-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d56861b8e3d625e0a0077a44dae0f2ea10ecfc2491df359aa5c3fd1cbf7cafd8
+size 5942064832