Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings
Authors: name: Gili Goldin; name: Shuly Wintner
Published: 2024-07-30 06:29:01

Abstract: We present Knesset-DictaBERT, a large Hebrew language model fine-tuned on the
Knesset Corpus, which comprises Israeli parliamentary proceedings. The model is
based on the DictaBERT architecture and demonstrates significant improvements
in understanding parliamentary language according to the MLM task. We provide a
detailed evaluation of the model's performance, showing improvements in
perplexity and accuracy over the baseline DictaBERT model.