File size: 1,442 Bytes
62f2b34 599bb63 62f2b34 0b85640 599bb63 62f2b34 599bb63 62f2b34 e8faa15 599bb63 62f2b34 599bb63 62f2b34 599bb63 62f2b34 599bb63 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
---
language:
- en
license: cc-by-nc-4.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
- Roleplay
- roleplay
base_model: Sao10K/Fimbulvetr-11B-v2
---
# About this model
TSF content
Beta for V2 of https://huggingface.co/Alsebay/Narumashi-11B-v0.9 (wrong typo but I'm too lazy to fix), but have only 32 rank and 32 lora rank, which cause the model didn't learn well all dataset information, it just know basis information. Anyways, it good if your have a chinese, japanese prompt to trigger TSF content. Maybe not smart, I haven't test yet.
- **Finetuned from model :** Sao10K/Fimbulvetr-11B-v2 . Thank Sao10K a lot :)
## I have text and found that Sao10K/Fimbulvetr-11B-v2 could unlock as 8K context length (maybe logic will go down a bit?), so I leave it alone to reduce RAM and VRAM. That mean you can use as 8k context length although this model say only 4k.
## GGUF version? [here is it](https://huggingface.co/Alsebay/Narisumashi-GGUF).
## Dataset
All chinese novels dataset
```
Dataset(all are novels):
60% skinsuit
25% possession
5% transform(shapeshift)
10% other
```
# Thank Unsloth for good finetuning tool. This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |