Commit
•
0bf48bc
1
Parent(s):
624c809
Update README.md
Browse filesedited description indicating its demo status
README.md
CHANGED
@@ -1 +1,14 @@
|
|
1 |
gpt2-turkish-wiki
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
gpt2-turkish-wiki
|
2 |
+
|
3 |
+
Current version is demo only with 250mb trained wikipedia text in Turkish.
|
4 |
+
|
5 |
+
Using modified https://github.com/piegu/fastai-projects/blob/master/finetuning-English-GPT2-any-language-Portuguese-HuggingFace-fastaiv2_FAST.ipynb
|
6 |
+
|
7 |
+
Inference is not so good at the moment.
|
8 |
+
|
9 |
+
Epoch train_loss valid_loss accuracy perplexity time
|
10 |
+
0 4.373726 5.398773 0.264228 221.134857 02:56
|
11 |
+
1 4.264910 5.344171 0.267870 209.384140 02:54
|
12 |
+
T
|
13 |
+
ODO: Total turkish wikipedia text is 3GB unpacked currently.
|
14 |
+
|