mrfakename
commited on
Commit
•
c810358
1
Parent(s):
9092ae6
Add documentation, correct minor issues
Browse files
README.md
CHANGED
@@ -10,12 +10,27 @@ base_model: teknium/OpenHermes-2-Mistral-7B
|
|
10 |
datasets:
|
11 |
- Pclanglais/MonadGPT
|
12 |
---
|
|
|
|
|
|
|
13 |
What would have happened if ChatGPT was invented in the 17th century? MonadGPT is a possible answer.
|
14 |
|
15 |
-
MonadGPT is a finetune of Mistral-Hermes on 11,000 early modern texts in English, French and Latin, mostly coming from EEBO and Gallica.
|
16 |
|
17 |
Like the original Mistral-Hermes, MonadGPT can be used in conversation mode. It will not only answer in an historical language and style but will use historical and dated references. This is especially visible for science questions (astronomy, medecine). Obviously, it's not recommended to follow any advice from Monad-GPT
|
18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
## Examples
|
20 |
|
21 |
> User: What are the planets of the solar system?<br>
|
@@ -42,15 +57,22 @@ Like the original Mistral-Hermes, MonadGPT can be used in conversation mode. It
|
|
42 |
> Monad-GPT: Les vertus & les effets de chacune des Planètes sont différents, & il est fort utile pour ceux qui veulent bien s'en renseigner, car ils peuvent en tirer grand profit pour le bonheur de leur corps & de leur esprit. Les 7 principales Planètes, dont l'Art & la Science nous ont fait connoître leurs effets, sont : Jupiter, Mars, Mercure, Venus, Saturne, le Soleil, et la Lune; Et voici les noms qu'ils ont reçu en Latin: Juperius, Martius, Mercurius, Veneris, Saturnus, Sol, Luna.
|
43 |
|
44 |
## Format
|
45 |
-
Monad-GPT uses the chatML format with a special system prompt.
|
46 |
|
47 |
-
|
48 |
|
|
|
49 |
|
50 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
51 |
|
52 |
## Caveats
|
|
|
53 |
MonadGPT is still very much in an experimental phase. The following caveats apply:
|
54 |
-
* Conversation issues: as MonadGPT is mostly trained on early modern books, it may answer in an haphazard
|
55 |
* Localization issues: sometime, the answer given by MonadGPT will be in near modern English.
|
56 |
-
* Language issues: while Latin is a significant part of the finetuning corpus, results are
|
|
|
10 |
datasets:
|
11 |
- Pclanglais/MonadGPT
|
12 |
---
|
13 |
+
|
14 |
+
# MonadGPT
|
15 |
+
|
16 |
What would have happened if ChatGPT was invented in the 17th century? MonadGPT is a possible answer.
|
17 |
|
18 |
+
MonadGPT is a finetune of [Mistral-Hermes 2](https://huggingface.co/teknium/OpenHermes-2-Mistral-7B) on 11,000 early modern texts in English, French and Latin, mostly coming from EEBO and Gallica.
|
19 |
|
20 |
Like the original Mistral-Hermes, MonadGPT can be used in conversation mode. It will not only answer in an historical language and style but will use historical and dated references. This is especially visible for science questions (astronomy, medecine). Obviously, it's not recommended to follow any advice from Monad-GPT
|
21 |
|
22 |
+
## Installation
|
23 |
+
|
24 |
+
If you have a GPU, you may run this model using Hugging Face Transformers:
|
25 |
+
|
26 |
+
```python
|
27 |
+
from transformers import pipeline
|
28 |
+
pipe = pipeline('text-generation', model='Pclanglais/MonadGPT', device='cuda')
|
29 |
+
print(pipe("<|im_start|>system\nYou are MonadGPT, a very old chatbot from the 17th century. Please answer the questions using an archaic language<|im_end|>\n<|im_start|>user\nQuelles sont les planètes du système solaire ?<|im_end|>\n<|im_start|>assistant"))
|
30 |
+
```
|
31 |
+
|
32 |
+
If you would like to run a faster quantized version of this model, you may use [llama.cpp](https://github.com/ggerganov/llama.cpp). Apple Silicon and GPU acceleration is also supported with llama.cpp. [A quantized version of this model is available in llama.cpp's format, GGUF.](https://huggingface.co/TheBloke/MonadGPT-GGUF)
|
33 |
+
|
34 |
## Examples
|
35 |
|
36 |
> User: What are the planets of the solar system?<br>
|
|
|
57 |
> Monad-GPT: Les vertus & les effets de chacune des Planètes sont différents, & il est fort utile pour ceux qui veulent bien s'en renseigner, car ils peuvent en tirer grand profit pour le bonheur de leur corps & de leur esprit. Les 7 principales Planètes, dont l'Art & la Science nous ont fait connoître leurs effets, sont : Jupiter, Mars, Mercure, Venus, Saturne, le Soleil, et la Lune; Et voici les noms qu'ils ont reçu en Latin: Juperius, Martius, Mercurius, Veneris, Saturnus, Sol, Luna.
|
58 |
|
59 |
## Format
|
|
|
60 |
|
61 |
+
MonadGPT uses the ChatML format with a special system prompt.
|
62 |
|
63 |
+
The last example provided was formatted like this:
|
64 |
|
65 |
+
```
|
66 |
+
<|im_start|>system
|
67 |
+
You are MonadGPT, a very old chatbot from the 17th century. Please answer the questions using an archaic language<|im_end|>
|
68 |
+
<|im_start|>user
|
69 |
+
Quelles sont les planètes du système solaire ?<|im_end|>
|
70 |
+
<|im_start|>assistant
|
71 |
+
```
|
72 |
|
73 |
## Caveats
|
74 |
+
|
75 |
MonadGPT is still very much in an experimental phase. The following caveats apply:
|
76 |
+
* Conversation issues: as MonadGPT is mostly trained on early modern books, it may answer in an haphazard manner (starting in between an argument: "But, etc.") or it may even simply ignore an instruction and continue the previous text.
|
77 |
* Localization issues: sometime, the answer given by MonadGPT will be in near modern English.
|
78 |
+
* Language issues: while Latin is a significant part of the finetuning corpus, results are currently poor.
|