bigjoedata
commited on
Commit
β’
fb03d85
1
Parent(s):
b854631
Model & README Update
Browse files
README.md
CHANGED
@@ -1,6 +1,6 @@
|
|
1 |
|
2 |
# πΈ π₯ Rockbot π€ π§
|
3 |
-
A [GPT-2](https://
|
4 |
|
5 |
**Instructions:** Type in a fake song title, pick an artist, click "Generate".
|
6 |
|
@@ -8,13 +8,15 @@ Note: Due to the nature of language models, lyrics bleed across artists and you
|
|
8 |
|
9 |
Finally, these lyrics are computer generated. Not all of these will be non-repetitive and/or coherent. Just have fun.
|
10 |
|
11 |
-
[Repository](https://github.com/bigjoedata/rockbot)
|
12 |
|
13 |
-
[Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot)
|
|
|
|
|
14 |
|
15 |
πΉ πͺ π· πΊ πͺ πͺ π»
|
16 |
## Background
|
17 |
-
With the shutdown of [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) I used Google's takeout function to gather the metadata from artists I've listened to over the past several years. I wanted to take advantage of this bounty to build something fun. I scraped the top 50 lyrics for artists I'd listened to at least once from [Genius](https://genius.com/), then fine tuned [GPT-2's](https://openai.com/blog/better-language-models/) 124M token model using the [AITextGen](https://github.com/minimaxir/aitextgen) framework after considerable post-processing.
|
18 |
|
19 |
### Full Tech Stack
|
20 |
[Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) (R.I.P.).
|
|
|
1 |
|
2 |
# πΈ π₯ Rockbot π€ π§
|
3 |
+
A [GPT-2](https://openai.com/blog/better-language-models/) based lyrics generator fine-tuned on the writing styles of 16000 songs by 270 artists across MANY genres (not just rock).
|
4 |
|
5 |
**Instructions:** Type in a fake song title, pick an artist, click "Generate".
|
6 |
|
|
|
8 |
|
9 |
Finally, these lyrics are computer generated. Not all of these will be non-repetitive and/or coherent. Just have fun.
|
10 |
|
11 |
+
[Github Repository](https://github.com/bigjoedata/rockbot)
|
12 |
|
13 |
+
[GPT-2 124M version Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot)
|
14 |
+
|
15 |
+
[DistilGPT2 version Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot-distilgpt2/) This is leaner but the lyrics are much more simplistic.
|
16 |
|
17 |
πΉ πͺ π· πΊ πͺ πͺ π»
|
18 |
## Background
|
19 |
+
With the shutdown of [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) I used Google's takeout function to gather the metadata from artists I've listened to over the past several years. I wanted to take advantage of this bounty to build something fun. I scraped the top 50 lyrics for artists I'd listened to at least once from [Genius](https://genius.com/), then fine tuned [GPT-2's](https://openai.com/blog/better-language-models/) 124M token model using the [AITextGen](https://github.com/minimaxir/aitextgen) framework after considerable post-processing. For more on generation, see [here.](https://huggingface.co/blog/how-to-generate)
|
20 |
|
21 |
### Full Tech Stack
|
22 |
[Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) (R.I.P.).
|