---
license: mit
datasets:
- Riksarkivet/mini_cleaned_diachronic_swe
language:
- sv
metrics:
- perplexity
pipeline_tag: fill-mask
widget:
  - text: Det vore [MASK] häller nödvändigt att bita af tungan än berättat hvad jag varit med om.

train-eval-index:
- config: Riksarkivet/mini_cleaned_diachronic_swe
  task: fill-mask
  task_id: fill-mask
  splits:
    eval_split: test
  col_mapping:
    text: text

model-index:
- name: bert-base-cased-swe-1800
  results:
  - task:
      type: fill-mask
      name: fill-mask
    dataset:
      name: Riksarkivet/mini_cleaned_diachronic_swe
      type: Riksarkivet/mini_cleaned_diachronic_swe
      split: test
    metrics:
    - type: perplexity
      value: 3.42
      name: Perplexity
---

# Historical Swedish Bert Model

A historical Swedish Bert model is released from the National Swedish Archives to better generalise to Swedish historical text. Researches are well-aware that the Swedish language has been subject to change over time which means that present-day point-of-view models less ideal candidates for the job. 
However, this model can be used to interpret and analyse historical textual material and be fine-tuned for different downstream tasks.

## Model Dscription



## Acknowledgements

We gratefully acknowledge the HPC RIVR consortium (https://www.hpc-rivr.si) and EuroHPC JU (https://eurohpc-ju.europa.eu) for funding this research by providing computing resources of the HPC system Vega at the Institute of Information Science (https://www.izum.si).