---
language:
- nl
thumbnail: >-
  https://raw.githubusercontent.com/hghcomphys/hghcomphys.github.io/master/assets/urls/GEOBERTJE.png
tags:
- GEOBERTje
---

<!-- # GEOBERTje -->
<img src="https://raw.githubusercontent.com/hghcomphys/hghcomphys.github.io/master/assets/urls/GEOBERTJE.png" width="500">
A domain-adapted language model trained on geological borehole descriptions in the Dutch language from Flanders region in Belgium.


How to use GEOBERTje as a pipeline:
```python
from transformers import pipeline

pipe = pipeline("fill-mask", model="hghcomphys/geobertje-base-dutch-uncased")
pipe("grijs fijn zand met enkele [MASK]")
```


Load model directly:
```python
from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("hghcomphys/geobertje-base-dutch-uncased")
model = AutoModel.from_pretrained("hghcomphys/geobertje-base-dutch-uncased")
```