ozyman commited on
Commit
7e293be
1 Parent(s): 923d96c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -7
README.md CHANGED
@@ -13,33 +13,34 @@ tags:
13
  ![GOAT-70B-Storytelling](https://assets.adapt.ws/files/20231117_ehznrqludevtapck.png)
14
  # GOAT-70B-Storytelling model
15
 
16
- GOAT-70B-Storytelling model trained by GOAT.AI lab as a core model for autonomous story-writing agent.
17
-
18
 
19
  # GOAT-Storytelling-Agent
20
- The GOAT-70B-Storytelling model has been developed as an integral component within the GOAT-Storytelling-Agent. This agent facilitates the generation of high-quality, cohesive, and captivating narratives, including stories and books. It achieves this by utilizing inputs such as plot outlines, character profiles, their interrelationships, and other relevant details. Example is provided below.
 
21
 
22
  # Model description
 
23
  - **Base Architecture:** LLaMA 2 70B
24
  - **License:** llama2
25
  - **Context window length:** 4096 tokens
26
 
27
  ### Training details
28
 
29
- For training, we apply the standard recipe with learning rate 1e-5, batch size per GPU 6, optimizer AdamW without weight decay and we train the model via ZeRO-3 on 64xH100 GPU cluster
30
 
31
  ### Learn more
32
 
33
  - **Blogpost:** [GOAT-Storytelling: Arbitrarily Long Story Writing Agent](https://www.blog.goat.ai/goat-st/)
34
  - **GitHub:** [here](https://github.com/GOAT-AI-lab/GOAT-Storytelling-Agent)
35
  - **Generated examples:** [here](https://huggingface.co/datasets/GOAT-AI/generated-novels/tree/main/generated-books)
 
36
  ## Uses
37
 
38
  The main purpose of GOAT-70B-Storytelling is to generate books, novels, movie scripts and etc. as an agent in coping with our GOAT-Storytelling-Agent. It is specifically designed for storywriters.
39
 
40
  ## Usage
41
 
42
-
43
  Usage can be either self-hosted via `transformers` or used with Spaces
44
 
45
  ```python
@@ -62,15 +63,17 @@ First, modify config.py and add your generation endpoint.
62
  Then you can use it inside via GOAT-Storytelling-Agent:
63
 
64
  ```python
65
- from goat_storytelling_agent.story_processor.prompt_manager import generate_story
66
 
67
- novel_scenes = generate_story('never too much coffee', form='novel')
68
  ```
 
69
  ## License
70
 
71
  GOAT-70B-Storytelling model is based on [Meta's LLaMA-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf), and using own datasets.
72
 
73
  GOAT-70B-Storytelling model weights are available under LLAMA-2 license.
 
74
  ### Risks and Biases
75
 
76
  GOAT-70B-Storytelling model can produce factually incorrect output and should not be relied on to deliver factually accurate information. Therefore, the GOAT-70B-Storytelling model could possibly generate wrong, biased, or otherwise offensive outputs.
 
13
  ![GOAT-70B-Storytelling](https://assets.adapt.ws/files/20231117_ehznrqludevtapck.png)
14
  # GOAT-70B-Storytelling model
15
 
16
+ GOAT-70B-Storytelling model trained by GOAT.AI lab as a core model for an autonomous story-writing agent.
 
17
 
18
  # GOAT-Storytelling-Agent
19
+
20
+ The GOAT-70B-Storytelling model has been developed as an integral component within the GOAT-Storytelling-Agent. This agent facilitates the generation of high-quality, cohesive, and captivating narratives, including stories and books. It achieves this by utilizing inputs such as plot outlines, character profiles, their interrelationships, and other relevant details. Examples are provided below.
21
 
22
  # Model description
23
+
24
  - **Base Architecture:** LLaMA 2 70B
25
  - **License:** llama2
26
  - **Context window length:** 4096 tokens
27
 
28
  ### Training details
29
 
30
+ Training was performed on a GPU cluster of 64xH100s and FSDP ZeRO-3 sharding is employed. We instruction finetune on a dataset of 18K examples for one epoch with batch size of 336, AdamW optimizer with learning rate 1e-5.
31
 
32
  ### Learn more
33
 
34
  - **Blogpost:** [GOAT-Storytelling: Arbitrarily Long Story Writing Agent](https://www.blog.goat.ai/goat-st/)
35
  - **GitHub:** [here](https://github.com/GOAT-AI-lab/GOAT-Storytelling-Agent)
36
  - **Generated examples:** [here](https://huggingface.co/datasets/GOAT-AI/generated-novels/tree/main/generated-books)
37
+
38
  ## Uses
39
 
40
  The main purpose of GOAT-70B-Storytelling is to generate books, novels, movie scripts and etc. as an agent in coping with our GOAT-Storytelling-Agent. It is specifically designed for storywriters.
41
 
42
  ## Usage
43
 
 
44
  Usage can be either self-hosted via `transformers` or used with Spaces
45
 
46
  ```python
 
63
  Then you can use it inside via GOAT-Storytelling-Agent:
64
 
65
  ```python
66
+ from goat_storytelling_agent import storytelling_agent as goat
67
 
68
+ novel_scenes = goat.generate_story('treasure hunt in a jungle', form='novel')
69
  ```
70
+
71
  ## License
72
 
73
  GOAT-70B-Storytelling model is based on [Meta's LLaMA-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf), and using own datasets.
74
 
75
  GOAT-70B-Storytelling model weights are available under LLAMA-2 license.
76
+
77
  ### Risks and Biases
78
 
79
  GOAT-70B-Storytelling model can produce factually incorrect output and should not be relied on to deliver factually accurate information. Therefore, the GOAT-70B-Storytelling model could possibly generate wrong, biased, or otherwise offensive outputs.