|
--- |
|
license: llama3 |
|
license_name: llama3 |
|
license_link: LICENSE |
|
library_name: transformers |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
|
|
Sunfall (2024-06-21) v0.4 LoRA on top of https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2. |
|
|
|
Beware, depraved. Not suitable for any audience. |
|
|
|
Experimental. Please give feedback. Begone if you demand perfection. |
|
|
|
This is still an early stage experiment. |
|
|
|
Reverted some changes in v0.3 that seemed to cause excessively short responses. |
|
|
|
New since v0.3: |
|
* Dataset expanded, and strategy refined to make the model better at following instructions |
|
* **Instruct preset changed from Llama3-instruct-named to Llama3-instruct (not-named).** |
|
|
|
Feedback so far: |
|
* Model tends to speak for the user. This is probably due to the above reversion, which should be fixed in future iterations. |
|
|
|
To use lore book tags ([example](https://files.catbox.moe/w5otyq.json)), make sure you use **Status: Blue (constant)** and write e.g. |
|
|
|
``` |
|
Follow the Diamond Law at all costs. |
|
|
|
Tags: humor, dark, complex storytelling, intricate characters, immersive. |
|
``` |
|
|
|
![sunfall-standard-sfw.png](https://huggingface.co/crestf411/L3-8B-sunfall-v0.4-stheno-v3.2/resolve/main/sunfall-standard-sfw.png?) |
|
|
|
This model has been trained on context that mimics that of Silly Tavern's Llama3-instruct preset, with the following settings: |
|
|
|
**System Prompt:** |
|
``` |
|
You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason. Currently your role is {{char}}, which is described in detail below. As {{char}}, continue the exchange with {{user}}. |
|
``` |
|
|
|
The card has also been trained on content which includes a narrator card, which was used when the content did not mainly revolve around two characters. Future versions will expand on this idea, so forgive the vagueness at this time. |
|
|
|
(The Diamond Law is this, although new rules were added: https://files.catbox.moe/d15m3g.txt -- So far results are unclear, but the training was done with this phrase included, and the training data adheres to the law.) |
|
|
|
The model has also been trained to do storywriting. The system message ends up looking something like this: |
|
``` |
|
You are an expert storyteller, who can roleplay or write compelling stories. Follow the Diamond Law at all costs. Below is a scenario with character descriptions and content tags. Write a story based on this scenario. |
|
|
|
Scenario: The story is about James, blabla. |
|
|
|
James is an overweight 63 year old blabla. |
|
|
|
Lucy: James's 62 year old wife. |
|
|
|
Tags: tag1, tag2, tag3, ... |
|
``` |
|
|