Create README.md
Browse filesAdd an extended description
README.md
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
This is GPT2 (SMALL) compressed via [progressive module replacing](https://arxiv.org/abs/2002.02925).
|
| 2 |
+
|
| 3 |
+
The compression was executed on Bulgarian text from [OSCAR](https://oscar-corpus.com/post/oscar-2019/), [Chitanka](https://chitanka.info/) and [Wikipedia](https://bg.wikipedia.org/).
|