File size: 822 Bytes
cf13403
 
 
 
 
 
 
 
 
 
 
 
f825e00
5a8df86
f825e00
cf13403
d7483a4
54f4646
cf13403
54f4646
cf13403
54f4646
cf13403
54f4646
cf13403
54f4646
0fe9bc1
54f4646
0fe9bc1
54f4646
d7483a4
cf13403
 
 
0fe9bc1
 
 
 
54f4646
cf13403
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
language: pt

license: mit
---

# GPT-2 Small Portuguese Lyrics

Pretrained model from lyrics dataset in Portuguese.

## Model description

The model was trained from a Kaggle Dataset, [“Song lyrics from 6 musical genres”](https://www.kaggle.com/neisse/scrapped-lyrics-from-6-genres/version/2), with around 66,000 songs in portuguese.

The model was fine-tuned from [GPorTuguese-2](https://huggingface.co/pierreguillou/gpt2-small-portuguese) on Colab Pro+ enviroment.

<!--- 
## Intended uses & limitations

### How to use

### Limitations and bias

## Training data

## Training procedure

### Preprocessing

### BibTeX entry and citation info
-->

## Evaluation results

| Loss     | Perplexity | Training Duration |
|:--------:|:----------:|:-----------------:|
|3,301     | 27,15      | 06:45:09          |