File size: 1,912 Bytes
bbb747c fae5886 bbb747c 6adcfec bbb747c 76594c7 bbb747c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
---
license: cc-by-nc-4.0
tags:
- not-for-all-audiences
- nsfw
---
<!-- description start -->
## Description
This repo contains fp16 files of Mistral-RP-0.1-7B.
[Some exemple of output](https://files.catbox.moe/mdkebx.png)
Here is the recipe:
```shell
slices:
- sources:
- model: migtissera/Synthia-7B-v1.3
layer_range: [0, 32]
- model: Undi95/Mistral-small_pippa_limaRP-v3-7B
layer_range: [0, 32]
merge_method: slerp
base_model: migtissera/Synthia-7B-v1.3
parameters:
t:
- filter: lm_head
value: [0.75]
- filter: embed_tokens
value: [0.75]
- filter: self_attn
value: [0.75, 0.25]
- filter: mlp
value: [0.25, 0.75]
- filter: layernorm
value: [0.5, 0.5]
- filter: modelnorm
value: [0.75]
- value: 0.5 # fallback for rest of tensors
dtype: float16
```
Tool used : https://github.com/cg123/mergekit/tree/yaml
<!-- description end -->
<!-- description start -->
## Model and lora used
- [Mistral-7B-small_pippa_limaRP-v3-lora](https://huggingface.co/Undi95/Mistral-7B-small_pippa_limaRP-v3-lora)
- [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1)
- [Synthia-7B-v1.3](https://huggingface.co/migtissera/Synthia-7B-v1.3)
## Prompt template: Alpaca
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
```
## LimaRP v3 usage and suggested settings
You can follow these instruction format settings in SillyTavern. Replace tiny with your desired response length:
<!-- description end -->
If you want to support me, you can [here](https://ko-fi.com/undiai). |