zarakiquemparte commited on
Commit
08f34c8
1 Parent(s): c7d321d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +54 -0
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ tags:
4
+ - llama2
5
+ ---
6
+ # Model Card: Zarablend M L2 7b
7
+ This model uses [Nous Hermes Llama2 7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b) (61%) as a base with [Airoboros L2 7B GPT4 m2.0](https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-m2.0) (39%) and the result of this merge was merged with [LimaRP LLama2 7B Lora](https://huggingface.co/lemonilia/limarp-llama2).
8
+
9
+ This merge of models(hermes and airoboros) was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/merge-cli.py)
10
+
11
+ This merge of Lora with Model was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/apply-lora.py)
12
+
13
+ Quantized Model by @TheBloke:
14
+ - [GGML](https://huggingface.co/TheBloke/Zarablend-L2-7B-GGML)
15
+ - [GPTQ](https://huggingface.co/TheBloke/Zarablend-L2-7B-GPTQ)
16
+
17
+ Merge illustration:
18
+
19
+ ![illustration](zarablend-merge-illustration.png)
20
+
21
+ ## Usage:
22
+
23
+ Since this is a merge between Nous Hermes, Airoboros and LimaRP, the following instruction formats should work:
24
+
25
+ Alpaca 2:
26
+
27
+ ```
28
+ ### Instruction:
29
+ <prompt>
30
+
31
+ ### Response:
32
+ <leave a newline blank for model to respond>
33
+ ```
34
+
35
+ LimaRP instruction format:
36
+
37
+ ```
38
+ <<SYSTEM>>
39
+ <character card and system prompt>
40
+
41
+ <<USER>>
42
+ <prompt>
43
+
44
+ <<AIBOT>>
45
+ <leave a newline blank for model to respond>
46
+ ```
47
+
48
+ ## Bias, Risks, and Limitations
49
+
50
+ This model is not intended for supplying factual information or advice in any form
51
+
52
+ ## Training Details
53
+
54
+ This model is merged and can be reproduced using the tools mentioned above. Please refer to all provided links for extra model-specific details.