---
language: vi

datasets:
- oscar

---

# NlpHUST/roberta-base-vn

## Model description

This is a Vietnamese RoBERTa base model pretrained on Vietnamese Oscar dataset.

## How to use

You can use this model for masked language modeling as follows:
```python
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("NlpHUST/roberta-base-vn")
model = AutoModelForMaskedLM.from_pretrained("NlpHUST/roberta-base-vn")

You can fine-tune this model on downstream tasks.