Back to all models

Unable to determine this model’s pipeline type. Check the docs .

Monthly model downloads

jannesg/bertsson jannesg/bertsson
86 downloads
last 30 days

pytorch

tf

Contributed by

jannesg Jannes Germishuys
1 model

How to use this model directly from the 🤗/transformers library:

			
Copy to clipboard
from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("jannesg/bertsson") model = AutoModel.from_pretrained("jannesg/bertsson")

BERTSSON Models

The models are trained on:

  • Government Text
  • Swedish Literature
  • Swedish News

Corpus size: Roughly 6B tokens.

The following models are currently available:

  • bertsson - A BERT base model trained with the same hyperparameters as first published by Google.

All models are cased and trained with whole word masking.

Stay tuned for evaluations.