zarakiquemparte commited on
Commit
b33e597
·
1 Parent(s): 078092f

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +60 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - llama2
5
+ ---
6
+ # Model Card: Kuchiki L2 7b
7
+ This model uses [Nous Hermes Llama2 7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b) (70%) as a base with [Airoboros L2 7B GPT4 2.0](https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-2.0) (30%) and the result of this merge was merged with [LimaRP LLama2 7B Lora](https://huggingface.co/lemonilia/limarp-llama2).
8
+
9
+ This merge of models(hermes and airoboros) was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/merge-cli.py)
10
+
11
+ This merge of Lora with Model was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/apply-lora.py)
12
+
13
+ Quantized Model by @TheBloke:
14
+ - [GGUF](https://huggingface.co/TheBloke/Kuchiki-L2-7B-GGUF)
15
+ - [GPTQ](https://huggingface.co/TheBloke/Kuchiki-L2-7B-GPTQ)
16
+
17
+ Merge illustration:
18
+
19
+ ![illustration](merge-illustration.png)
20
+
21
+ ## Usage:
22
+
23
+ Since this is a merge between Nous Hermes, Airoboros and LimaRP, the following instruction formats should work:
24
+
25
+ Alpaca 2:
26
+
27
+ ```
28
+ ### Instruction:
29
+ <prompt>
30
+
31
+ ### Response:
32
+ <leave a newline blank for model to respond>
33
+ ```
34
+
35
+ Alpaca LimaRP:
36
+
37
+ ```
38
+ ### Instruction:
39
+ Character's Persona: {bot character description}
40
+
41
+ User's Persona: {user character description}
42
+
43
+ Scenario: {what happens in the story}
44
+
45
+ Play the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length.
46
+
47
+ ### Input:
48
+ User: {utterance}
49
+
50
+ ### Response:
51
+ Character: {utterance}
52
+ ```
53
+
54
+ ## Bias, Risks, and Limitations
55
+
56
+ This model is not intended for supplying factual information or advice in any form
57
+
58
+ ## Training Details
59
+
60
+ This model is merged and can be reproduced using the tools mentioned above. Please refer to all provided links for extra model-specific details.