File size: 924 Bytes
fb0d7e1
 
 
19b3c82
fb0d7e1
 
 
 
19b3c82
fb0d7e1
 
19b3c82
fb0d7e1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
---
language: id
tags:
  - tiny-roberta-indonesia
license: mit
datasets:
  - wikipedia
widget:
  - text: "ikiryo adalah <mask> hantu dalam mitologi jepang."
---

# Indonesian tiny-RoBERTa
## How to Use

### As Masked Language Model
```python
from transformers import pipeline

pretrained_name = "akahana/tiny-roberta-indonesia"

fill_mask = pipeline(
    "fill-mask",
    model=pretrained_name,
    tokenizer=pretrained_name
)

fill_mask("ikiryo adalah <mask> hantu dalam mitologi jepang.")
```

### Feature Extraction in PyTorch
```python
from transformers import RobertaModel, RobertaTokenizerFast

pretrained_name = "akahana/tiny-roberta-indonesia"
model = RobertaModel.from_pretrained(pretrained_name)
tokenizer = RobertaTokenizerFast.from_pretrained(pretrained_name)

prompt = "ikiryo adalah <mask> hantu dalam mitologi jepang."
encoded_input = tokenizer(prompt, return_tensors='pt')
output = model(**encoded_input)
```