|
--- |
|
language: |
|
- en |
|
license: cc |
|
library_name: adapter-transformers |
|
tags: |
|
- music |
|
- art |
|
datasets: |
|
- SpartanCinder/artist-lyrics-dataset |
|
- SpartanCinder/song-lyrics-artist-classifier |
|
metrics: |
|
- accuracy |
|
--- |
|
# GPT2 Pretrained Lyric Generation Model |
|
|
|
This repository contains a pretrained GPT2 model fine-tuned for lyric generation. The model was trained using the Hugging Face's Transformers library. |
|
|
|
## Model Details |
|
|
|
- **Model architecture:** GPT2 |
|
- **Training data:** The datasets were created using the Genius API and are linked in the Model's tags. |
|
- **Training duration:** [Mention how long the model was trained] |
|
|
|
## Usage |
|
|
|
The model can be used to generate lyrics. |
|
It uses nucleus sampling with a probability threshold of 0.9 for generating the lyrics, |
|
which helps in generating more diverse and less repetitive text. |
|
|
|
Here is a basic usage example: |
|
|
|
```python |
|
from transformers import GPT2LMHeadModel, GPT2Tokenizer |
|
|
|
tokenizer = GPT2Tokenizer.from_pretrained("SpartanCinder/GPT2-pretrained-lyric-generation") |
|
model = GPT2LMHeadModel.from_pretrained("SpartanCinder/GPT2-pretrained-lyric-generation") |
|
|
|
input_ids = tokenizer.encode("Once upon a time", return_tensors='pt') |
|
output = model.generate(input_ids, max_length=100, num_return_sequences=5, do_sample=True, top_p=0.9) |
|
print(tokenizer.decode(output[0], skip_special_tokens=True)) |
