Update README.md

README.md

@@ -1,53 +1,45 @@
 ---
-base_model: ReadyArt/Forgotten-Abomination-24B-V2.1
+base_model:
+- ReadyArt/Forgotten-Safeword-24B-V2.0
+- TheDrummer/Cydonia-24B-v2
 library_name: transformers
 tags:
 - mergekit
 - merge
-- llama-cpp
-- gguf-my-repo
----
 
-# sleepdeprived3/Forgotten-Abomination-24B-V2.1-Q5_K_M-GGUF
-This model was converted to GGUF format from [`ReadyArt/Forgotten-Abomination-24B-V2.1`](https://huggingface.co/ReadyArt/Forgotten-Abomination-24B-V2.1) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
-Refer to the [original model card](https://huggingface.co/ReadyArt/Forgotten-Abomination-24B-V2.1) for more details on the model.
+---
+# merge
 
-## Use with llama.cpp
-Install llama.cpp through brew (works on Mac and Linux)
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
-```bash
-brew install llama.cpp
+## Merge Details
+### Merge Method
 
-```
-Invoke the llama.cpp server or the CLI.
+This model was merged using the [DARE TIES](https://arxiv.org/abs/2311.03099) merge method using [TheDrummer/Cydonia-24B-v2](https://huggingface.co/TheDrummer/Cydonia-24B-v2) as a base.
 
-### CLI:
-```bash
-llama-cli --hf-repo sleepdeprived3/Forgotten-Abomination-24B-V2.1-Q5_K_M-GGUF --hf-file forgotten-abomination-24b-v2.1-q5_k_m.gguf -p "The meaning to life and the universe is"
-```
+### Models Merged
 
-### Server:
-```bash
-llama-server --hf-repo sleepdeprived3/Forgotten-Abomination-24B-V2.1-Q5_K_M-GGUF --hf-file forgotten-abomination-24b-v2.1-q5_k_m.gguf -c 2048
-```
+The following models were included in the merge:
+* [ReadyArt/Forgotten-Safeword-24B-V2.0](https://huggingface.co/ReadyArt/Forgotten-Safeword-24B-V2.0)
 
-Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
+### Configuration
 
-Step 1: Clone llama.cpp from GitHub.
-```
-git clone https://github.com/ggerganov/llama.cpp
-```
+The following YAML configuration was used to produce this model:
 
-Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
-```
-cd llama.cpp && LLAMA_CURL=1 make
-```
+```yaml
+merge_method: dare_ties
+base_model: TheDrummer/Cydonia-24B-v2
+models:
+  - model: TheDrummer/Cydonia-24B-v2
+    parameters:
+      weight: 0.5
+  - model: ReadyArt/Forgotten-Safeword-24B-V2.0
+    parameters:
+      weight: 0.5
+parameters:
+  density: 0.3
+tokenizer:
+  source: union
+chat_template: auto
 
-Step 3: Run inference through the main binary.
-```
-./llama-cli --hf-repo sleepdeprived3/Forgotten-Abomination-24B-V2.1-Q5_K_M-GGUF --hf-file forgotten-abomination-24b-v2.1-q5_k_m.gguf -p "The meaning to life and the universe is"
-```
-or 
-```
-./llama-server --hf-repo sleepdeprived3/Forgotten-Abomination-24B-V2.1-Q5_K_M-GGUF --hf-file forgotten-abomination-24b-v2.1-q5_k_m.gguf -c 2048
 ```