Edit model card

This is a Shrinked and Fine-tuned version of https://huggingface.co/cnicu/t5-small-booksum

See https://ziade.org/2024/01/27/compressing-t5-models-for-summarization/ for the rationale.

Accuracy after shrinking:

rouge-1 Accuracy:

  • F1 Accuracy: 95.99%
  • Precision Accuracy: 85.37%
  • Recall Accuracy: 95.73%

rouge-2 Accuracy:

  • F1 Accuracy: 99.54%
  • Precision Accuracy: 97.14%
  • Recall Accuracy: 99.54%

rouge-l Accuracy: - F1 Accuracy: 96.76% - Precision Accuracy: 84.41% - Recall Accuracy: 96.36%

Downloads last month
16
Safetensors
Model size
38.5M params
Tensor type
F32
·