QA_HUIT
Collection
10 items • Updated
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Fine-tuned from vinai/bartpho-syllable-base for Vietnamese
question answering on BaoNhan/FAIR_Dataset_QA.
syllable| Metric | Value |
|---|---|
| Exact_Match | 29.93 |
| Token_F1 | 43.32 |
| ROUGE_1_F1 | 43.32 |
| ROUGE_2_F1 | 36.30 |
| ROUGE_L_F1 | 40.85 |
| BLEU | 15.54 |
| chrF | 28.30 |
| BERTScore_F1 | 87.81 |
predict.py is included in this repo:
python predict.py --model BaoNhan/vi-qa-bartpho-syllable-base-ctx --mode syllable --use_context --context "..." \
--question "Viet Nam co bao nhieu tinh thanh?"
A paper describing this benchmark is in preparation. If you use this code or the released checkpoints, please cite it once it is available — the entry below is a placeholder and will be updated with the final venue, authors, and year.
@misc{TODO_citation_key,
title = {TODO: paper title},
author = {TODO: author list},
year = {TODO},
howpublished = {TODO: venue / arXiv preprint},
note = {Preprint in preparation},
url = {https://github.com/chaubaonhan/QA_Huit}
}