zarakiquemparte commited on
Commit
66db51f
1 Parent(s): d07ae60

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - llama2
5
+ ---
6
+ # Model Card: Zarablend L2 7b
7
+ This model uses [Nous Hermes Llama2 7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b) (66%) as a base with [Airoboros L2 7B GPT4 2.0](https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-2.0) (34%) and the result of this merge was merged with [LimaRP LLama2 7B Lora](https://huggingface.co/lemonilia/limarp-llama2).
8
+
9
+ This merge of models(hermes and airoboros) was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/merge-cli.py)
10
+
11
+ This merge of Lora with Model was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/apply-lora.py)
12
+
13
+ Merge illustration:
14
+
15
+ ![illustration](zarablend-merge-illustration.png)
16
+
17
+ ## Usage:
18
+
19
+ Since this is a merge between Nous Hermes, Airoboros and LimaRP, the following instruction formats should work:
20
+
21
+ Alpaca 2:
22
+
23
+ ```
24
+ ### Instruction:
25
+ <prompt>
26
+
27
+ ### Response:
28
+ <leave a newline blank for model to respond>
29
+ ```
30
+
31
+ LimaRP instruction format:
32
+
33
+ ```
34
+ <<SYSTEM>>
35
+ <character card and system prompt>
36
+
37
+ <<USER>>
38
+ <prompt>
39
+
40
+ <<AIBOT>>
41
+ <leave a newline blank for model to respond>
42
+ ```
43
+
44
+ ## Bias, Risks, and Limitations
45
+
46
+ This model is not intended for supplying factual information or advice in any form
47
+
48
+ ## Training Details
49
+
50
+ This model is merged and can be reproduced using the tools mentioned above. Please refer to all provided links for extra model-specific details.