Update README.md
Browse files
README.md
CHANGED
|
@@ -19,4 +19,22 @@ widget:
|
|
| 19 |
|
| 20 |
---
|
| 21 |
|
| 22 |
-
# GPT2 QA - Persian
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
---
|
| 21 |
|
| 22 |
+
# GPT2 QA - Persian
|
| 23 |
+
It is a new approach to using GPT2 in other downstream NLP tasks like QA. The model was trained on PersianQA and evaluated on PersianQA and PersiNLU (Reading Comprehension).
|
| 24 |
+
|
| 25 |
+
## Dataset
|
| 26 |
+
- [PersianQA](https://github.com/sajjjadayobi/PersianQA)
|
| 27 |
+
- [ParsiNLU](https://github.com/persiannlp/parsinlu)
|
| 28 |
+
|
| 29 |
+
## Evaluation
|
| 30 |
+
|
| 31 |
+
The following table summarizes the scores obtained by the model.
|
| 32 |
+
|
| 33 |
+
| Dataset | F1 Score (%) | Exact Match (%) | Total (#) |
|
| 34 |
+
|:---------:|:------------:|:---------------:|:---------:|
|
| 35 |
+
| ParsNLU | 46.95 | 20.39 | 564 |
|
| 36 |
+
| PersianQA | 45.93 | 23.19 | 651 |
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
## How to use
|
| 40 |
+
TODO (will be filled shortly)...
|