Hugging Face's logo

RichardErkhov
/
NeverSleep_-_Noromaid-13b-v0.2-gguf

GGUF
Inference Endpoints
Model card Files Community
RichardErkhov commited on
Commit
7603b19
•
1 Parent(s): 0fa04e1

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +131 -0
README.md ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ Noromaid-13b-v0.2 - GGUF
11
+ - Model creator: https://huggingface.co/NeverSleep/
12
+ - Original model: https://huggingface.co/NeverSleep/Noromaid-13b-v0.2/
13
+
14
+
15
+ | Name | Quant method | Size |
16
+ | ---- | ---- | ---- |
17
+ | [Noromaid-13b-v0.2.Q2_K.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q2_K.gguf) | Q2_K | 4.52GB |
18
+ | [Noromaid-13b-v0.2.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.IQ3_XS.gguf) | IQ3_XS | 4.99GB |
19
+ | [Noromaid-13b-v0.2.IQ3_S.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.IQ3_S.gguf) | IQ3_S | 5.27GB |
20
+ | [Noromaid-13b-v0.2.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q3_K_S.gguf) | Q3_K_S | 5.27GB |
21
+ | [Noromaid-13b-v0.2.IQ3_M.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.IQ3_M.gguf) | IQ3_M | 5.57GB |
22
+ | [Noromaid-13b-v0.2.Q3_K.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q3_K.gguf) | Q3_K | 5.9GB |
23
+ | [Noromaid-13b-v0.2.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q3_K_M.gguf) | Q3_K_M | 5.9GB |
24
+ | [Noromaid-13b-v0.2.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q3_K_L.gguf) | Q3_K_L | 6.45GB |
25
+ | [Noromaid-13b-v0.2.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.IQ4_XS.gguf) | IQ4_XS | 6.54GB |
26
+ | [Noromaid-13b-v0.2.Q4_0.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q4_0.gguf) | Q4_0 | 6.86GB |
27
+ | [Noromaid-13b-v0.2.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.IQ4_NL.gguf) | IQ4_NL | 6.9GB |
28
+ | [Noromaid-13b-v0.2.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q4_K_S.gguf) | Q4_K_S | 6.91GB |
29
+ | [Noromaid-13b-v0.2.Q4_K.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q4_K.gguf) | Q4_K | 7.33GB |
30
+ | [Noromaid-13b-v0.2.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q4_K_M.gguf) | Q4_K_M | 7.33GB |
31
+ | [Noromaid-13b-v0.2.Q4_1.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q4_1.gguf) | Q4_1 | 7.61GB |
32
+ | [Noromaid-13b-v0.2.Q5_0.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q5_0.gguf) | Q5_0 | 8.36GB |
33
+ | [Noromaid-13b-v0.2.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q5_K_S.gguf) | Q5_K_S | 8.36GB |
34
+ | [Noromaid-13b-v0.2.Q5_K.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q5_K.gguf) | Q5_K | 8.6GB |
35
+ | [Noromaid-13b-v0.2.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q5_K_M.gguf) | Q5_K_M | 8.6GB |
36
+ | [Noromaid-13b-v0.2.Q5_1.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q5_1.gguf) | Q5_1 | 9.1GB |
37
+ | [Noromaid-13b-v0.2.Q6_K.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q6_K.gguf) | Q6_K | 9.95GB |
38
+ | [Noromaid-13b-v0.2.Q8_0.gguf](https://huggingface.co/RichardErkhov/NeverSleep_-_Noromaid-13b-v0.2-gguf/blob/main/Noromaid-13b-v0.2.Q8_0.gguf) | Q8_0 | 12.88GB |
39
+
40
+
41
+
42
+
43
+ Original model description:
44
+ ---
45
+ license: cc-by-nc-4.0
46
+ ---
47
+
48
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/VKX2Z2yjZX5J8kXzgeCYO.png)
49
+
50
+
51
+ ---
52
+
53
+ # Disclaimer:
54
+ ## This is a ***VERY EXPERIMENTAL*** version, don't expect everything to work!!!
55
+ ## If you don't like this model, use [Noromaid 0.1.1](https://huggingface.co/NeverSleep/Noromaid-13b-v0.1.1)
56
+
57
+ You may use our custom **prompting format**(scroll down to download them!), or simple alpaca. **(Choose which fits best for you!)**
58
+
59
+ Expect that many things will change in the next version!!
60
+
61
+ ---
62
+
63
+ Mergemonster and a new dataset were used.
64
+
65
+ If you want a 7b, or 20b hit us up in the Community tab!
66
+
67
+ # This model is a collab between [IkariDev](https://huggingface.co/IkariDev) and [Undi](https://huggingface.co/Undi95)!
68
+
69
+ Test model. Suitable for RP, ERP and general stuff.
70
+
71
+ [Recommended settings - No settings yet(Please suggest some over in the Community tab!)]
72
+
73
+ <!-- description start -->
74
+ ## Description
75
+
76
+ <!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->
77
+
78
+ This repo contains FP16 files of Noromaid-13b-v0.2.
79
+
80
+ [FP16 - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-13b-v0.2)
81
+
82
+ <!-- [GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)-->
83
+
84
+ <!-- [GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)-->
85
+
86
+ <!-- [exl2[8bpw-8h] - by AzureBlack](https://huggingface.co/AzureBlack/Echidna-13b-v0.3-8bpw-8h-exl2)-->
87
+
88
+ <!-- [AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)-->
89
+
90
+ <!-- [fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)-->
91
+
92
+ [GGUF - by IkariDev and Undi](https://huggingface.co/NeverSleep/Noromaid-13b-v0.2-GGUF)
93
+ <!-- [OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->
94
+
95
+ ## Ratings:
96
+
97
+ Note: We have permission of all users to upload their ratings, we DONT screenshot random reviews without asking if we can put them here!
98
+
99
+ No ratings yet!
100
+
101
+ If you want your rating to be here, send us a message over on DC and we'll put up a screenshot of it here. DC name is "ikaridev" and "undi".
102
+
103
+ <!-- description end -->
104
+ <!-- prompt-template start -->
105
+ ## Prompt template: Custom format, or Alpaca
106
+
107
+ ### Custom format:
108
+ UPDATED!! SillyTavern config files: [Context](https://files.catbox.moe/ifmhai.json), [Instruct](https://files.catbox.moe/ttw1l9.json).
109
+
110
+ ### Alpaca:
111
+ ```
112
+ Below is an instruction that describes a task. Write a response that appropriately completes the request.
113
+
114
+ ### Instruction:
115
+ {prompt}
116
+
117
+ ### Response:
118
+
119
+ ```
120
+
121
+ ## Training data used:
122
+ - [no_robots dataset](https://huggingface.co/Undi95/Llama2-13B-no_robots-alpaca-lora) let the model have more human behavior, enhances the output.
123
+ - [Aesir Private RP dataset] New data from a new and never used before dataset, add fresh data, no LimaRP spam, this is 100% new. Thanks to the [MinvervaAI Team](https://huggingface.co/MinervaAI) and, in particular, [Gryphe](https://huggingface.co/Gryphe) for letting us use it!
124
+ - [Another private Aesir dataset]
125
+
126
+ ## Others
127
+
128
+ Undi: If you want to support me, you can [here](https://ko-fi.com/undiai).
129
+
130
+ IkariDev: Visit my [retro/neocities style website](https://ikaridevgit.github.io/) please kek
131
+