This is a smaller version of the facebook/mbart-large-50 with only Russian and English embeddings left.
sentencepiece vocabulary was shrinked from 250k to 25k (most common 10k English tokens and most common 15k Russian tokens). The creation of this model is heavily based on David Dale's method described here, but with some specific to MBart additions.
- Downloads last month
- 678