Update README.md
Browse files
README.md
CHANGED
@@ -19,16 +19,148 @@ language:
|
|
19 |
|
20 |
# Model Description
|
21 |
This is a highly experimental model for merging models into a MOE model.
|
22 |
-
- base model: [
|
23 |
1. [trinity-v1](https://huggingface.co/janhq/trinity-v1): for General Chat
|
24 |
-
2. [
|
25 |
-
3. [
|
26 |
-
4. [
|
|
|
|
|
|
|
|
|
27 |
|
28 |
Special thanks to the interested work of [Chargoddard](https://huggingface.co/chargoddard) and [Undi95](https://huggingface.co/Undi95)
|
29 |
|
30 |
```yaml
|
31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
32 |
```
|
33 |
|
34 |
# Run this model
|
@@ -42,6 +174,7 @@ Jan is an open source, ChatGPT alternative that is:
|
|
42 |
- π **OpenAI Compatible**: Local server on port `1337` with OpenAI compatible endpoints
|
43 |
- π **Open Source & Free**: We build in public; check out our [Github](https://github.com/janhq)
|
44 |
|
|
|
45 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/r7VmEBLGXpPLTu2MImM7S.png)
|
46 |
|
47 |
# About Jan
|
|
|
19 |
|
20 |
# Model Description
|
21 |
This is a highly experimental model for merging models into a MOE model.
|
22 |
+
- base model: [mistralai/Mistral-7B-Instruct-v0.2 ](https://huggingface.co/janhq/trinity-v1)
|
23 |
1. [trinity-v1](https://huggingface.co/janhq/trinity-v1): for General Chat
|
24 |
+
2. [OpenHermes-2.5-neural-chat-v3-3-Slerp](https://huggingface.co/Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp): for General Chat
|
25 |
+
3. [AshhLimaRP-Mistral-7B](https://huggingface.co/lemonilia/AshhLimaRP-Mistral-7B): for Role-playing
|
26 |
+
4. [Toppy-M-7B](https://huggingface.co/Undi95/Toppy-M-7B): for Role-playing
|
27 |
+
5. [speechless-code-mistral-7b-v2.0](https://huggingface.co/uukuguy/speechless-code-mistral-7b-v2.0): for Coding
|
28 |
+
6. [Mistral-Trismegistus-7B](https://huggingface.co/teknium/Mistral-Trismegistus-7B): for Writing
|
29 |
+
7. [Mistral-7B-storywriter](https://huggingface.co/Norquinal/Mistral-7B-storywriter): for Writing
|
30 |
+
8. [openchat-3.5-1210](https://huggingface.co/openchat/openchat-3.5-1210): For Logical thinking
|
31 |
|
32 |
Special thanks to the interested work of [Chargoddard](https://huggingface.co/chargoddard) and [Undi95](https://huggingface.co/Undi95)
|
33 |
|
34 |
```yaml
|
35 |
+
base_model: mistralai/Mistral-7B-Instruct-v0.2
|
36 |
+
gate_mode: hidden
|
37 |
+
experts:
|
38 |
+
- source_model: janhq/trinity-v1
|
39 |
+
positive_prompts:
|
40 |
+
- "question"
|
41 |
+
- "answer"
|
42 |
+
- "chat"
|
43 |
+
- "friend"
|
44 |
+
- "assistant"
|
45 |
+
- "[Mode: Chat]"
|
46 |
+
negative_prompts:
|
47 |
+
- "storywriting"
|
48 |
+
- "book"
|
49 |
+
- "story"
|
50 |
+
- "chapter"
|
51 |
+
- "[Mode: Writing]"
|
52 |
+
- source_model: Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp
|
53 |
+
positive_prompts:
|
54 |
+
- "adventure"
|
55 |
+
- "friend"
|
56 |
+
- "chat"
|
57 |
+
- "companion"
|
58 |
+
- "[Mode: Chat]"
|
59 |
+
negative_prompts:
|
60 |
+
- "storywriting"
|
61 |
+
- "book"
|
62 |
+
- "story"
|
63 |
+
- "chapter"
|
64 |
+
- "[Mode: Writing]"
|
65 |
+
- source_model: lemonilia/AshhLimaRP-Mistral-7B
|
66 |
+
positive_prompts:
|
67 |
+
- "roleplay"
|
68 |
+
- "uncensored"
|
69 |
+
- "emotive engagement"
|
70 |
+
- "creative improvisation"
|
71 |
+
- "interactive"
|
72 |
+
- "[Mode: Roleplay]"
|
73 |
+
negative_prompts:
|
74 |
+
- "storywriting"
|
75 |
+
- "book"
|
76 |
+
- "story"
|
77 |
+
- "chapter"
|
78 |
+
- "[Mode: Writing]"
|
79 |
+
- source_model: Undi95/Toppy-M-7B
|
80 |
+
positive_prompts:
|
81 |
+
- "roleplay"
|
82 |
+
- "uncensored"
|
83 |
+
- "emotive engagement"
|
84 |
+
- "creative improvisation"
|
85 |
+
- "interactive"
|
86 |
+
- "[Mode: Roleplay]"
|
87 |
+
- "[Mode: Chat]"
|
88 |
+
negative_prompts:
|
89 |
+
- "storywriting"
|
90 |
+
- "book"
|
91 |
+
- "story"
|
92 |
+
- "chapter"
|
93 |
+
- "[Mode: Writing]"
|
94 |
+
- source_model: uukuguy/speechless-code-mistral-7b-v2.0
|
95 |
+
positive_prompts:
|
96 |
+
- "algorithm optimization"
|
97 |
+
- "code for calculating"
|
98 |
+
- "programming"
|
99 |
+
- "implementing statistical functions in code"
|
100 |
+
- "solving equations with code"
|
101 |
+
- "data analysis"
|
102 |
+
- "SQL"
|
103 |
+
- "C++"
|
104 |
+
- "Python"
|
105 |
+
- "[Mode: Coding]"
|
106 |
+
- "logical"
|
107 |
+
- "numerical methods in programming"
|
108 |
+
negative_prompts:
|
109 |
+
- "non-technical chat"
|
110 |
+
- "purely theoretical mathematics"
|
111 |
+
- "creative writing or storytelling"
|
112 |
+
- "general conversation unrelated to coding"
|
113 |
+
- "[Mode: Non-Technical Discussion]"
|
114 |
+
- "[Mode: Storytelling]"
|
115 |
+
- source_model: teknium/Mistral-Trismegistus-7B
|
116 |
+
positive_prompts:
|
117 |
+
- "philosphy"
|
118 |
+
- "occult"
|
119 |
+
- "esoteric"
|
120 |
+
- "spiritual"
|
121 |
+
- "alchemy"
|
122 |
+
- "magic"
|
123 |
+
- "[Mode: Occultism]"
|
124 |
+
- "[Mode: Writing]"
|
125 |
+
negative_prompts:
|
126 |
+
- "[Mode: Roleplay]"
|
127 |
+
- "[Mode: Chat]"
|
128 |
+
- "[Mode: Mathematics]"
|
129 |
+
- "chat"
|
130 |
+
- "roleplay"
|
131 |
+
- source_model: Norquinal/Mistral-7B-storywriter
|
132 |
+
positive_prompts:
|
133 |
+
- "storywriting"
|
134 |
+
- "book"
|
135 |
+
- "story"
|
136 |
+
- "chapter"
|
137 |
+
- "tale"
|
138 |
+
- "history"
|
139 |
+
- "write"
|
140 |
+
- "[Mode: Writing]"
|
141 |
+
negative_prompts:
|
142 |
+
- "[Mode: Roleplay]"
|
143 |
+
- "[Mode: Chat]"
|
144 |
+
- "chat"
|
145 |
+
- "roleplay"
|
146 |
+
- source_model: openchat/openchat-3.5-1210
|
147 |
+
positive_prompts:
|
148 |
+
- "theorem"
|
149 |
+
- "algebra"
|
150 |
+
- "mathematics"
|
151 |
+
- "sqrt(a*x^2 + b*y)"
|
152 |
+
- "solve for"
|
153 |
+
- "equation"
|
154 |
+
- "[Mode: Mathematics]"
|
155 |
+
- "logical"
|
156 |
+
- "planning"
|
157 |
+
- "853295 + 12763"
|
158 |
+
negative_prompts:
|
159 |
+
- "sex"
|
160 |
+
- "roleplay"
|
161 |
+
- "[Mode: Occultism]"
|
162 |
+
- "[Mode: Roleplay]"
|
163 |
+
- "[Mode: Writing]"
|
164 |
```
|
165 |
|
166 |
# Run this model
|
|
|
174 |
- π **OpenAI Compatible**: Local server on port `1337` with OpenAI compatible endpoints
|
175 |
- π **Open Source & Free**: We build in public; check out our [Github](https://github.com/janhq)
|
176 |
|
177 |
+
|
178 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/r7VmEBLGXpPLTu2MImM7S.png)
|
179 |
|
180 |
# About Jan
|