AzureBlack
commited on
Commit
·
c704c7a
1
Parent(s):
5dd7694
Upload 2 files
Browse files- README.md +71 -0
- huggingface-metadata.txt +20 -0
README.md
ADDED
@@ -0,0 +1,71 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
pipeline_tag: text-generation
|
5 |
+
---
|
6 |
+
|
7 |
+
# DreamGen Opus V0 70B
|
8 |
+
|
9 |
+
**DreamGen Opus** is a family of **uncensored** models fine-tuned for **(steerable) story writing** and the model also works great for **chat / RP**.
|
10 |
+
The DreamGen Opus V0.5 70B model is derived from [meta-llama/Llama-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf).
|
11 |
+
|
12 |
+
You can **try the Opus V0 70B** (AWQ) model for free on [dreamgen.com](https://dreamgen.com).
|
13 |
+
|
14 |
+
Other sizes:
|
15 |
+
|
16 |
+
- 7B: [dreamgen/opus-v0-7b](https://huggingface.co/dreamgen/opus-v0-7b)
|
17 |
+
|
18 |
+
## Difference from [dreamgen/opus-v0-70b](https://huggingface.co/dreamgen/opus-v0-70b)
|
19 |
+
|
20 |
+
The model should be even better at role-play and chat, and be slighly more "open-minded" in NSFW contexts.
|
21 |
+
|
22 |
+
## Prompting
|
23 |
+
|
24 |
+
Please see the [official documentation](https://dreamgen.com/docs/stories) for more detailed guide, including how to prompt the model for chat / RP.
|
25 |
+
|
26 |
+
The (collaborative / steerable) story writing task teaches the model to respect `<setting>` and `<instruction>` inserted into the prompt.
|
27 |
+
|
28 |
+
Example prompt:
|
29 |
+
|
30 |
+
```
|
31 |
+
<setting>
|
32 |
+
(Setting provides general overview of the story and characters)
|
33 |
+
This story is a twist on the traditional Little Red Riding Hood story.
|
34 |
+
In this variation, the Little Red Riding Hood and her grandma are secretely werevoles.
|
35 |
+
</setting>
|
36 |
+
|
37 |
+
(Previous part of the story, potentially empty)
|
38 |
+
|
39 |
+
<instruction>
|
40 |
+
(Setting tells the model what should happen in the next few sentences / paragraphs)
|
41 |
+
The Little Red Riding hood confronts The Big Bad Wolf, transforming into her wolf form.
|
42 |
+
</instruction>
|
43 |
+
```
|
44 |
+
|
45 |
+
## Dataset
|
46 |
+
|
47 |
+
The fine-tuning dataset consisted of >1M tokens of collaborative writing task examples, each example being up to 4096 tokens. On top of that, >20M tokens of more general, but less instructed examples were included to help preserve generalization.
|
48 |
+
|
49 |
+
All prose in the dataset is from actual humans, not AI generated.
|
50 |
+
|
51 |
+
## Community
|
52 |
+
|
53 |
+
Join the DreamGen community on [**Discord**](https://dreamgen.com/discord), or follow our [**X/Twitter account**](https://dreamgen.com/twitter) for new model releases and other news.
|
54 |
+
We will soon be releasing models with longer context window, as well as models specifically fine-tuned for character chat & roleplay.
|
55 |
+
|
56 |
+
Help us shape the future of DreamGen.
|
57 |
+
|
58 |
+
## Running the model
|
59 |
+
|
60 |
+
The model is should be compatible with any software that supports [meta-llama/Llama-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf).
|
61 |
+
Note that because this is a 70B model, the resource requirements are large. You can try the quantized versions linked at the top, but expect a quality drop.
|
62 |
+
|
63 |
+
### Running on DreamGen.com (free)
|
64 |
+
|
65 |
+
You can try the 70B (AWQ) model for free at [dreamgen.com](https://dreamgen.com) — note that an account is required.
|
66 |
+
The version used for the website is the official AWQ 4bit quant [dreamgen/opus-v0-70b-awq](https://huggingface.co/dreamgen/opus-v0-70b-awq).
|
67 |
+
|
68 |
+
## License
|
69 |
+
|
70 |
+
- For personal and academic use: Same license as the base model, in this case https://ai.meta.com/resources/models-and-libraries/llama-downloads/.
|
71 |
+
- For commercial use: Please reach out to hello@dreamgen.com.
|
huggingface-metadata.txt
ADDED
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
url: https://huggingface.co/dreamgen/opus-v0.5-70b
|
2 |
+
branch: main
|
3 |
+
download date: 2023-11-18 07:48:35
|
4 |
+
sha256sum:
|
5 |
+
d486e3e93034ccbdb88ac1ee5bf235fa2e82ff561df2ceba73560bfab53e1704 pytorch_model-00001-of-00015.bin
|
6 |
+
3bcbe4416005dd41e4c877e0b271a9cf364e5adca8accf6200300351c9dda93d pytorch_model-00002-of-00015.bin
|
7 |
+
a541cc0314176f12922cc3daba2cdc215e9e61a18b3a6b4f02c7f007758be648 pytorch_model-00003-of-00015.bin
|
8 |
+
bab03692d875e916edefaecf356f0626624ae1de7e10fd42a4cd7e5a4d9de087 pytorch_model-00004-of-00015.bin
|
9 |
+
6b1ba5de0e69bc24d2c65da16ce80d1ed1e2c2224ca1ce16cea5170a0f9cb199 pytorch_model-00005-of-00015.bin
|
10 |
+
533c71cb21186baf0cfce4f2ebcf46ae02084b7f6880385e01cd4f49331fba41 pytorch_model-00006-of-00015.bin
|
11 |
+
e46bcb1067dfec22bdab1952d6eb995eea7f64f8c5c5f5416af6a33a82d520c8 pytorch_model-00007-of-00015.bin
|
12 |
+
c7f1bde98d09e7d5e37fd568272732777c4a9c8f1ea3e672e38b386826365cbf pytorch_model-00008-of-00015.bin
|
13 |
+
2a69ce500e53d37e65c014682e8d5b0be9b859a188bee919b0e1c253ab1c49cf pytorch_model-00009-of-00015.bin
|
14 |
+
bf13930f0f3107a96425d80ae2a83fba0931ed38988d0fbeaeacf05a9f2dc925 pytorch_model-00010-of-00015.bin
|
15 |
+
d3f37f002b1b9bb070e98d648ec04e11d9e1ca7da34102c84c38ed38973bd5f7 pytorch_model-00011-of-00015.bin
|
16 |
+
a498db61424a013bb4c1a716aca856082aef24ee1f875a69ca692cfbac85b7f6 pytorch_model-00012-of-00015.bin
|
17 |
+
bfa3ad3082a72f4b25c725e05ba883085671f8a21fd81863928c62a672f4895a pytorch_model-00013-of-00015.bin
|
18 |
+
bf08a98dbdff77ee7f1642f107dba836a0eff85509c62d2058f95147bb0a3f24 pytorch_model-00014-of-00015.bin
|
19 |
+
389b333f28df8197e857b33d0d3415177b5ca2c0977a654b29b90b21d043fc18 pytorch_model-00015-of-00015.bin
|
20 |
+
9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347 tokenizer.model
|