File size: 1,887 Bytes
19330e8 82cb4f5 19330e8 82cb4f5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 |
---
language:
- en
pipeline_tag: text-generation
tags:
- text-generation-inference
- instruct
- conversational
- roleplay
license: cc-by-4.0
---
<h1 style="text-align: center">Erosumika-7B-v3-0.2</h1>
<h2 style="text-align: center">~Mistral 0.2 Edition~</h1>
<div style="display: flex; justify-content: center;">
<img src="https://cdn-uploads.huggingface.co/production/uploads/6512681f4151fb1fa719e033/8YBKfcegQZliRlQNm0oir.gif" alt="Header GIF">
</div>
7.1bpw quant of Erosumika 7b 0.2 v3. Original Link : (https://huggingface.co/localfultonextractor/Erosumika-7B-v3-0.2)
Best way to achieve 16k context withing 8GB of vram while achieving as much context as possible
## Model Details
The Mistral 0.2 version of Erosumika-7B-v3, a DARE TIES merge between Nitral's [Kunocchini-7b](https://huggingface.co/Nitral-AI/Kunocchini-7b), Endevor's [InfinityRP-v1-7B](https://huggingface.co/Endevor/InfinityRP-v1-7B) and my [FlatErosAlpha](https://huggingface.co/localfultonextractor/FlatErosAlpha), a flattened(in order to keep the vocab size 32000) version of tavtav's [eros-7B-ALPHA](https://huggingface.co/tavtav/eros-7B-ALPHA). Alpaca and ChatML work best. Slightly smarter and better prompt comprehension than Mistral 0.1 Erosumika-7B-v3. 32k context should work.
[GGUF quants](https://huggingface.co/localfultonextractor/Erosumika-7B-v3-0.2-GGUF)
## Limitations and biases
The intended use-case for this model is fictional writing for entertainment purposes. Any other sort of usage is out of scope.
It may produce socially unacceptable or undesirable text, even if the prompt itself does not include anything explicitly offensive. Outputs might often be factually wrong or misleading.
```yaml
merge_method: task_arithmetic
base_model: alpindale/Mistral-7B-v0.2-hf
models:
- model: localfultonextractor/Erosumika-7B-v3
parameters:
weight: 1.0
dtype: float16
``` |