Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

Vocabulary Trimmed lmqg/mt5-small-jaquad-qg: vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-5000

This model is a trimmed version of lmqg/mt5-small-jaquad-qg by vocabtrimmer, a tool for trimming vocabulary of language models to compress the model size. Following table shows a summary of the trimming process.

lmqg/mt5-small-jaquad-qg vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-5000
parameter_size_full 300,165,504 49,184,128
parameter_size_embedding 256,103,424 5,122,048
vocab_size 250,101 5,002
compression_rate_full 100.0 16.39
compression_rate_embedding 100.0 2.0

Following table shows the parameter used to trim vocabulary.

language dataset dataset_column dataset_name dataset_split target_vocab_size min_frequency
ja vocabtrimmer/mc4_validation text ja validation 5000 2
Downloads last month
1