Hugging Face's logo

flax-community
/
roberta-base-thai

Fill-Mask
Transformers
PyTorch
TensorBoard
roberta
Inference Endpoints
Model card Files Metrics Community
roberta-base-thai

Commit History

use proper tokenizer.json and change to batch_size=256
de940b9

sakares commited on

train with 10K batch_size
89c14b0

sakares commited on

remove old tokenizer.json. it's not trained properly
a615d86

sakares commited on

change config and fix training tokenizer script
13d02d7

sakares commited on

remove tfevents
70b401c

sakares commited on

rename previous tfevents
d12a293

sakares commited on

add 4th tfevents
8dc7108

sakares commited on

increaaase bs=128 and change dtype to fp32
2071335

sakares commited on

remove old model
8887f4f

sakares commited on

change to proper vocab_size
9fa8adc

sakares commited on

update pt model
d6a778b

sakares commited on

add pt model from 15K trained steps
1aa50f9

sakares commited on

update rule
5a8de81

sakares commited on

update evnt
24b543a

sakares commited on

update event
578dba5

sakares commited on

update event
2c966a4

sakares commited on

Saving weights and logs of step 15000
8664a01

sakares commited on

check event
d74794e

sakares commited on

Saving weights and logs of step 10000
908d1a5

sakares commited on

update event
be4ec62

sakares commited on

update tfevent
e60615a

sakares commited on

Saving weights and logs of step 5000
acba88d

sakares commited on

update event
14c6643

sakares commited on

Create Thai Tokenizer script
5ad5b72

sakares commited on

check event
e76044d

sakares commited on

init tfevents for experiment#3
bbeb147

sakares commited on

remove old exp&model and lower steps to save
64934c7

sakares commited on

fix script
9c0b789

sakares commited on

make it resumable training
51e884f

sakares commited on

Saving weights and logs of step 10000
3040f73

sakares commited on

update event
a9d2138

sakares commited on

update tfevent
f8a3350

sakares commited on

update event
bae02ca

sakares commited on

remove old event
23b10e3

sakares commited on

add experiment_2 tfevents
e0c32ef

sakares commited on

update script
8976790

sakares commited on

update script regarding to https://github.com/huggingface/transformers/pull/12608
6aba5c0

sakares commited on

lower lr regarding explode gradient. also new seed number
b0729e9

sakares commited on

Merge branch 'main' of https://huggingface.co/flax-community/roberta-base-thai into main
bfd5d73

sakares commited on

update tfevents
0d2b32a

sakares commited on

update event
d9006b0

sakares commited on

update event
33260f5

sakares commited on

update event
0b153f6

sakares commited on

update tfevents
e0cfb09

sakares commited on

update tfevents
70ff567

sakares commited on

update tfevents
0ea0736

sakares commited on

add tfevents
e55fc80

sakares commited on

switch back to batch_size = 32
9307a78

sakares commited on

change saving and eval steps
e73a28c

sakares commited on