zarakiquemparte
commited on
Commit
·
b33e597
1
Parent(s):
078092f
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
tags:
|
4 |
+
- llama2
|
5 |
+
---
|
6 |
+
# Model Card: Kuchiki L2 7b
|
7 |
+
This model uses [Nous Hermes Llama2 7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b) (70%) as a base with [Airoboros L2 7B GPT4 2.0](https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-2.0) (30%) and the result of this merge was merged with [LimaRP LLama2 7B Lora](https://huggingface.co/lemonilia/limarp-llama2).
|
8 |
+
|
9 |
+
This merge of models(hermes and airoboros) was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/merge-cli.py)
|
10 |
+
|
11 |
+
This merge of Lora with Model was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/apply-lora.py)
|
12 |
+
|
13 |
+
Quantized Model by @TheBloke:
|
14 |
+
- [GGUF](https://huggingface.co/TheBloke/Kuchiki-L2-7B-GGUF)
|
15 |
+
- [GPTQ](https://huggingface.co/TheBloke/Kuchiki-L2-7B-GPTQ)
|
16 |
+
|
17 |
+
Merge illustration:
|
18 |
+
|
19 |
+
![illustration](merge-illustration.png)
|
20 |
+
|
21 |
+
## Usage:
|
22 |
+
|
23 |
+
Since this is a merge between Nous Hermes, Airoboros and LimaRP, the following instruction formats should work:
|
24 |
+
|
25 |
+
Alpaca 2:
|
26 |
+
|
27 |
+
```
|
28 |
+
### Instruction:
|
29 |
+
<prompt>
|
30 |
+
|
31 |
+
### Response:
|
32 |
+
<leave a newline blank for model to respond>
|
33 |
+
```
|
34 |
+
|
35 |
+
Alpaca LimaRP:
|
36 |
+
|
37 |
+
```
|
38 |
+
### Instruction:
|
39 |
+
Character's Persona: {bot character description}
|
40 |
+
|
41 |
+
User's Persona: {user character description}
|
42 |
+
|
43 |
+
Scenario: {what happens in the story}
|
44 |
+
|
45 |
+
Play the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length.
|
46 |
+
|
47 |
+
### Input:
|
48 |
+
User: {utterance}
|
49 |
+
|
50 |
+
### Response:
|
51 |
+
Character: {utterance}
|
52 |
+
```
|
53 |
+
|
54 |
+
## Bias, Risks, and Limitations
|
55 |
+
|
56 |
+
This model is not intended for supplying factual information or advice in any form
|
57 |
+
|
58 |
+
## Training Details
|
59 |
+
|
60 |
+
This model is merged and can be reproduced using the tools mentioned above. Please refer to all provided links for extra model-specific details.
|