RichardErkhov commited on
Commit
c5c20d1
1 Parent(s): 8b8a109

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +94 -0
README.md ADDED
@@ -0,0 +1,94 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ pygmalion-instruct - GGUF
11
+ - Model creator: https://huggingface.co/alpindale/
12
+ - Original model: https://huggingface.co/alpindale/pygmalion-instruct/
13
+
14
+
15
+ | Name | Quant method | Size |
16
+ | ---- | ---- | ---- |
17
+ | [pygmalion-instruct.Q2_K.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q2_K.gguf) | Q2_K | 2.36GB |
18
+ | [pygmalion-instruct.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.IQ3_XS.gguf) | IQ3_XS | 2.6GB |
19
+ | [pygmalion-instruct.IQ3_S.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.IQ3_S.gguf) | IQ3_S | 2.75GB |
20
+ | [pygmalion-instruct.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q3_K_S.gguf) | Q3_K_S | 2.75GB |
21
+ | [pygmalion-instruct.IQ3_M.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.IQ3_M.gguf) | IQ3_M | 2.9GB |
22
+ | [pygmalion-instruct.Q3_K.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q3_K.gguf) | Q3_K | 3.07GB |
23
+ | [pygmalion-instruct.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q3_K_M.gguf) | Q3_K_M | 3.07GB |
24
+ | [pygmalion-instruct.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q3_K_L.gguf) | Q3_K_L | 3.35GB |
25
+ | [pygmalion-instruct.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.IQ4_XS.gguf) | IQ4_XS | 3.4GB |
26
+ | [pygmalion-instruct.Q4_0.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q4_0.gguf) | Q4_0 | 3.56GB |
27
+ | [pygmalion-instruct.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.IQ4_NL.gguf) | IQ4_NL | 3.58GB |
28
+ | [pygmalion-instruct.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q4_K_S.gguf) | Q4_K_S | 3.59GB |
29
+ | [pygmalion-instruct.Q4_K.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q4_K.gguf) | Q4_K | 3.8GB |
30
+ | [pygmalion-instruct.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q4_K_M.gguf) | Q4_K_M | 3.8GB |
31
+ | [pygmalion-instruct.Q4_1.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q4_1.gguf) | Q4_1 | 3.95GB |
32
+ | [pygmalion-instruct.Q5_0.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q5_0.gguf) | Q5_0 | 4.33GB |
33
+ | [pygmalion-instruct.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q5_K_S.gguf) | Q5_K_S | 4.33GB |
34
+ | [pygmalion-instruct.Q5_K.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q5_K.gguf) | Q5_K | 4.45GB |
35
+ | [pygmalion-instruct.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q5_K_M.gguf) | Q5_K_M | 4.45GB |
36
+ | [pygmalion-instruct.Q5_1.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q5_1.gguf) | Q5_1 | 4.72GB |
37
+ | [pygmalion-instruct.Q6_K.gguf](https://huggingface.co/RichardErkhov/alpindale_-_pygmalion-instruct-gguf/blob/main/pygmalion-instruct.Q6_K.gguf) | Q6_K | 5.15GB |
38
+
39
+
40
+
41
+
42
+ Original model description:
43
+ ---
44
+ license: mit
45
+ ---
46
+
47
+ ## Model Details
48
+
49
+ Experimental model. Trained with the [Pygmalion](https://huggingface.co/PygmalionAI/pygmalion-6b/tree/dev) and the [WizardLM](https://huggingface.co/ehartford/WizardLM-7B-Uncensored) datasets.
50
+
51
+ The purpose of this model is to enable complex Instruct prompting but with the RP capabilties of Pygmalion.
52
+
53
+ ### Prompting format
54
+ ```
55
+ instruction:
56
+ output:
57
+ ```
58
+
59
+ <!-- Provide the basic links for the model. -->
60
+
61
+ - **Repository:** [More Information Needed]
62
+ - **Paper [optional]:** [More Information Needed]
63
+ - **Demo [optional]:** [More Information Needed]
64
+
65
+ ### Uses
66
+
67
+ The intended use-case is Role-Playing with Instruct prompts. Guiding the bot towards a certain conversation style should be easier this way. Subject to experimentation.
68
+
69
+
70
+
71
+ ### Out-of-Scope Use
72
+
73
+ - Assistant Bot [subject to providing incorrect instructions]
74
+ - Complex multi-character chat
75
+
76
+ ### Risks
77
+
78
+ The model can generate potentially harmful or NSFW outputs. Please use with caution.
79
+
80
+ ### Citation
81
+
82
+ WizardLM:
83
+ ```
84
+ @misc{xu2023wizardlm,
85
+ title={WizardLM: Empowering Large Language Models to Follow Complex Instructions},
86
+ author={Can Xu and Qingfeng Sun and Kai Zheng and Xiubo Geng and Pu Zhao and Jiazhan Feng and Chongyang Tao and Daxin Jiang},
87
+ year={2023},
88
+ eprint={2304.12244},
89
+ archivePrefix={arXiv},
90
+ primaryClass={cs.CL}
91
+ }
92
+ ```
93
+
94
+