metadata

language: he
thumbnail: https://avatars1.githubusercontent.com/u/3617152?norod.jpg
widget:
  - text: 'מתמטיקה:'
  - text: עליית המכונות
  - text: ויקיפדיה העברית
  - text: האירוויזיון הוא
  - text: דוד בן-גוריון היה
license: mit

hebrew-bad_wiki-gpt_neo-tiny

Hebrew nonsense generation model which produces really bad wiki-abstract text. This model was fined tuned upon hebrew-gpt_neo-tiny which was previously trained using EleutherAI's gpt-neo. Fine-tuning on the wiki-absract text was done using @minimaxir's aitextgen.

Datasets

Hebrew Wikipedia Dump (hewiki abstract) from May 2020