zarakiquemparte commited on
Commit
a339439
1 Parent(s): f97cd92

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -1
README.md CHANGED
@@ -3,4 +3,48 @@ license: other
3
  tags:
4
  - llama2
5
  ---
6
- Quantized GGML of [ZaraXE L2 7b](https://huggingface.co/zarakiquemparte/zaraxe-l2-7b)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  tags:
4
  - llama2
5
  ---
6
+ # Model Card: ZaraXE L2 7b
7
+ This model uses [Zarafusionex L2 7b without LimaRP](https://huggingface.co/zarakiquemparte/zarafusionex-l2-7b) (71%) as a base with [Airoboros L2 7B GPT4 2.0](https://huggingface.co/jondurbin/airoboros-l2-7b-gpt4-2.0) (29%) and the result of this merge was merged with [LimaRP LLama2 7B Lora](https://huggingface.co/lemonilia/limarp-llama2).
8
+
9
+ This merge of models(zarafusionex w/o LimaRP and airoboros) was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/merge-cli.py)
10
+
11
+ This merge of Lora with Model was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/apply-lora.py)
12
+
13
+ Merge illustration:
14
+
15
+ ![illustration](zaraxe-merge-illustration.png)
16
+
17
+ ## Usage:
18
+
19
+ Since this is a merge between Zarafusionex, Airoboros and LimaRP, the following instruction formats should work:
20
+
21
+ Alpaca 2:
22
+
23
+ ```
24
+ ### Instruction:
25
+ <prompt>
26
+
27
+ ### Response:
28
+ <leave a newline blank for model to respond>
29
+ ```
30
+
31
+ LimaRP instruction format:
32
+
33
+ ```
34
+ <<SYSTEM>>
35
+ <character card and system prompt>
36
+
37
+ <<USER>>
38
+ <prompt>
39
+
40
+ <<AIBOT>>
41
+ <leave a newline blank for model to respond>
42
+ ```
43
+
44
+ ## Bias, Risks, and Limitations
45
+
46
+ This model is not intended for supplying factual information or advice in any form
47
+
48
+ ## Training Details
49
+
50
+ This model is merged and can be reproduced using the tools mentioned above. Please refer to all provided links for extra model-specific details.