Hugging Face's logo

jonfd
/
convbert-base-igc-is

Feature Extraction Transformers PyTorch TensorFlow
Icelandic convbert Inference Endpoints
Model card Files Community
convbert-base-igc-is / README.md
Jón Daðason
Adding model
9b780a1
preview code
|
raw history blame contribute delete
No virus
667 Bytes
metadata
language:
  - is
license: cc-by-4.0
datasets:
  - igc

Icelandic ConvBERT-Base

This model was pretrained on the Icelandic Gigaword Corpus, which contains approximately 1.69B tokens, using default settings. The model uses a WordPiece tokenizer with a vocabulary size of 32,105.

Acknowledgments

This research was supported with Cloud TPUs from Google's TPU Research Cloud (TRC).

This project was funded by the Language Technology Programme for Icelandic 2019-2023. The programme, which is managed and coordinated by Almannarómur, is funded by the Icelandic Ministry of Education, Science and Culture.