File size: 1,784 Bytes
5d70d6d 136ee3f 5d70d6d 136ee3f b1d4f2e 136ee3f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
language:
- en
pipeline_tag: text-generation
tags:
- text-generation-inference
- instruct
- conversational
- roleplay
license: cc-by-4.0
---
<h1 style="text-align: center">Erosumika-7B-v3</h1>
<div style="display: flex; justify-content: center;">
<img src="https://cdn-uploads.huggingface.co/production/uploads/6512681f4151fb1fa719e033/ZX5NLfB2CctdwuctS9W8A.gif" alt="Header GIF">
</div>
7.1bpw exl2 quant. great for 16k context on 8GB GPUS!
Original Model : (https://huggingface.co/localfultonextractor/Erosumika-7B-v3)
## Model Details
A DARE TIES merge between Nitral's [Kunocchini-7b](https://huggingface.co/Nitral-AI/Kunocchini-7b), Endevor's [InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B) and my [FlatErosAlpha](https://huggingface.co/localfultonextractor/FlatErosAlpha), a flattened(in order to keep the vocab size 32000) version of tavtav's [eros-7B-ALPHA](https://huggingface.co/tavtav/eros-7B-ALPHA). Alpaca and ChatML work best.
[GGUF quants](https://huggingface.co/localfultonextractor/Erosumika-7B-v3-GGUF)
## Limitations and biases
The intended use-case for this model is fictional writing for entertainment purposes. Any other sort of usage is out of scope.
It may produce socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. Outputs might often be factually wrong or misleading.
```yaml
base_model: localfultonextractor/FlatErosAlpha
models:
- model: localfultonextractor/FlatErosAlpha
- model: Epiculous/InfinityRP-v1-7B
parameters:
density: 0.4
weight: 0.25
- model: Nitral-AI/Kunocchini-7b
parameters:
density: 0.3
weight: 0.35
merge_method: dare_ties
dtype: bfloat16
```
Note: Copied the tokenizer from InfinityRP-v1-7B. |