distilbert-fa-pos-lscp-500k / train /dataset_config.yaml
pooya-mohammadi's picture
Hezar: Upload training files
7c54978
raw
history blame contribute delete
No virus
214 Bytes
name: sequence_labeling
config_type: dataset
task: sequence_labeling
path: hezarai/lscp-500k
tokenizer_path: hezarai/bert-base-fa
tags_field: pos_tags
tokens_field: tokens
ignore_index: -100
label_all_tokens: true