File size: 448 Bytes
7c389a6 9331e4e 7c389a6 cd25885 7c389a6 98f490e 7c389a6 9331e4e 7c389a6 a120b1d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
---
language:
- uk
- en
tags:
- t5
---
The aim is to compress the mT5-base model to leave only the Ukrainian language and some basic English.
Reproduced the similar result (but with another language) from [this](https://towardsdatascience.com/how-to-adapt-a-multilingual-t5-model-for-a-single-language-b9f94f3d9c90) medium article.
Results:
- 582M params -> 244M params (58%)
- 250K tokens -> 30K tokens
- 2.2GB size model -> 0.95GB size model |