norbert2 / README.md
Andrey Kutuzov
Formatting
f970042
|
raw
history blame
1.36 kB
metadata
language: 'no'
license: cc-by-4.0
pipeline_tag: fill-mask
tags:
  - norwegian
  - bert
thumbnail: https://raw.githubusercontent.com/ltgoslo/NorBERT/main/Norbert.png

Quickstart

Release 2.0 (February 7, 2022)

Trained on the very large corpus of Norwegian (C4 + NCC, about 15 billion word tokens). Features a 50 000 words vocabulary and was trained using Whole Word Masking.

Download the model here:

  • Cased Norwegian BERT Base 2.0 (NorBERT 2): 221.zip

More about NorBERT training corpora, training procedure and evaluation benchmarks: http://norlm.nlpl.eu/

Associated code: https://github.com/ltgoslo/NorBERT

Check this paper for more details:

Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen. Large-Scale Contextualised Language Modelling for Norwegian, NoDaLiDa'21 (2021)

NorBERT was trained as a part of NorLM, a joint initiative of the projects EOSC-Nordic (European Open Science Cloud), coordinated by the Language Technology Group (LTG) at the University of Oslo.

The computations were performed on resources provided by UNINETT Sigma2 - the National Infrastructure for High Performance Computing and Data Storage in Norway.