bigjoedata commited on
Commit
fb03d85
β€’
1 Parent(s): b854631

Model & README Update

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -1,6 +1,6 @@
1
 
2
  # 🎸 πŸ₯ Rockbot 🎀 🎧
3
- A [GPT-2](https://huggingface.co/blog/how-to-generate) based lyrics generator fine-tuned on the writing styles of 16000 songs by 270 artists across MANY genres (not just rock).
4
 
5
  **Instructions:** Type in a fake song title, pick an artist, click "Generate".
6
 
@@ -8,13 +8,15 @@ Note: Due to the nature of language models, lyrics bleed across artists and you
8
 
9
  Finally, these lyrics are computer generated. Not all of these will be non-repetitive and/or coherent. Just have fun.
10
 
11
- [Repository](https://github.com/bigjoedata/rockbot)
12
 
13
- [Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot)
 
 
14
 
15
  🎹 πŸͺ˜ 🎷 🎺 πŸͺ— πŸͺ• 🎻
16
  ## Background
17
- With the shutdown of [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) I used Google's takeout function to gather the metadata from artists I've listened to over the past several years. I wanted to take advantage of this bounty to build something fun. I scraped the top 50 lyrics for artists I'd listened to at least once from [Genius](https://genius.com/), then fine tuned [GPT-2's](https://openai.com/blog/better-language-models/) 124M token model using the [AITextGen](https://github.com/minimaxir/aitextgen) framework after considerable post-processing.
18
 
19
  ### Full Tech Stack
20
  [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) (R.I.P.).
 
1
 
2
  # 🎸 πŸ₯ Rockbot 🎀 🎧
3
+ A [GPT-2](https://openai.com/blog/better-language-models/) based lyrics generator fine-tuned on the writing styles of 16000 songs by 270 artists across MANY genres (not just rock).
4
 
5
  **Instructions:** Type in a fake song title, pick an artist, click "Generate".
6
 
 
8
 
9
  Finally, these lyrics are computer generated. Not all of these will be non-repetitive and/or coherent. Just have fun.
10
 
11
+ [Github Repository](https://github.com/bigjoedata/rockbot)
12
 
13
+ [GPT-2 124M version Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot)
14
+
15
+ [DistilGPT2 version Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot-distilgpt2/) This is leaner but the lyrics are much more simplistic.
16
 
17
  🎹 πŸͺ˜ 🎷 🎺 πŸͺ— πŸͺ• 🎻
18
  ## Background
19
+ With the shutdown of [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) I used Google's takeout function to gather the metadata from artists I've listened to over the past several years. I wanted to take advantage of this bounty to build something fun. I scraped the top 50 lyrics for artists I'd listened to at least once from [Genius](https://genius.com/), then fine tuned [GPT-2's](https://openai.com/blog/better-language-models/) 124M token model using the [AITextGen](https://github.com/minimaxir/aitextgen) framework after considerable post-processing. For more on generation, see [here.](https://huggingface.co/blog/how-to-generate)
20
 
21
  ### Full Tech Stack
22
  [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) (R.I.P.).