Create README.md

README.md

@@ -0,0 +1,51 @@
+---
+base_model: Locutusque/Llama-3-Yggdrasil-8B
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: llama3
+pipeline_tag: text-generation
+---
+# Llama-3-Yggdrasil-8B-GGUF
+This is quantized version of [Locutusque/Llama-3-Yggdrasil-8B](https://huggingface.co/Locutusque/Llama-3-Yggdrasil-8B) created using llama.cpp
+
+## Model Description
+### Merge Method
+
+This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [NousResearch/Meta-Llama-3-8B](https://huggingface.co/NousResearch/Meta-Llama-3-8B) as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* [NousResearch/Meta-Llama-3-8B-Instruct](https://huggingface.co/NousResearch/Meta-Llama-3-8B-Instruct)
+* [Locutusque/Llama-3-Hercules-5.0-8B](https://huggingface.co/Locutusque/Llama-3-Hercules-5.0-8B)
+* [Locutusque/llama-3-neural-chat-v2.2-8b](https://huggingface.co/Locutusque/llama-3-neural-chat-v2.2-8b)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: NousResearch/Meta-Llama-3-8B
+    # No parameters necessary for base model
+  - model: NousResearch/Meta-Llama-3-8B-Instruct
+    parameters:
+      density: 0.6
+      weight: 0.55
+  - model: Locutusque/llama-3-neural-chat-v2.2-8b
+    parameters:
+      density: 0.55
+      weight: 0.45
+  - model: Locutusque/Llama-3-Hercules-5.0-8B
+    parameters:
+      density: 0.57
+      weight: 0.5
+merge_method: dare_ties
+base_model: NousResearch/Meta-Llama-3-8B
+parameters:
+  int8_mask: true
+dtype: bfloat16
+
+```