fabianmmueller commited on
Commit
2ded223
1 Parent(s): a522133

Update Readme

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -16,9 +16,9 @@ This model is a fine-tuned version of [gpt-j-6B-8bit](https://huggingface.co/hiv
16
 
17
  ## Model description
18
 
19
- The model is a fine-tuned version of GPT-2 for generation of [Haikus](https://en.wikipedia.org/wiki/Haiku). The model, data and training procedure is inspired by a [blog post by Robert A. Gonsalves](https://GPT-Jdsdatascience.com/deep-haiku-teaching-gpt-j-to-compose-with-syllable-patterns-5234bca9701). Instead of using a 8bit version of GPT-J 6B, we instead used vanilla GPT-2. From what we saw, the model performance comparable but is much easier to fine-tune.
20
 
21
- We used the same multitask training approach as in der post, but significantly extended the dataset (almost double the size of the original on). A prepared version of the dataset can be found [here](https://huggingface.co/datasets/statworx/haiku).
22
 
23
  ## Intended uses & limitations
24
 
 
16
 
17
  ## Model description
18
 
19
+ The model is a fine-tuned version of GPT-J-6B-8Bit for generation of [Haikus](https://en.wikipedia.org/wiki/Haiku). The model, data and training procedure is inspired by a [blog post by Robert A. Gonsalves](https://towardsdatascience.com/deep-haiku-teaching-gpt-j-to-compose-with-syllable-patterns-5234bca9701).
20
 
21
+ We used the same multitask training approach as in der post, but significantly extended the dataset (almost double the size of the original one). A prepared version of the dataset can be found [here](https://huggingface.co/datasets/statworx/haiku).
22
 
23
  ## Intended uses & limitations
24