gardarjuto
commited on
Commit
•
b9777d9
1
Parent(s):
fa8bb65
fix: description text
Browse files- src/about.py +1 -1
src/about.py
CHANGED
@@ -66,7 +66,7 @@ A machine-translated version of the ARC-Challenge multiple-choice question-answe
|
|
66 |
- Link to dataset: https://huggingface.co/datasets/mideind/icelandic-arc-challenge
|
67 |
|
68 |
### WikiQA-IS
|
69 |
-
The Icelandic WikiQA dataset is a collection of 1.
|
70 |
They were collected by making GPT-4o generate questions and anwswers
|
71 |
given Icelandic Wikipedia articles as context. All examples were then manually verified and corrected where necessary. For evaluation, we prompt GPT-4o to
|
72 |
compare the generated answer to the original answer for semantic similarity and rate the answer on the following scale: (0, "poor"), (1, "fair"), (2, "excellent").
|
|
|
66 |
- Link to dataset: https://huggingface.co/datasets/mideind/icelandic-arc-challenge
|
67 |
|
68 |
### WikiQA-IS
|
69 |
+
The Icelandic WikiQA dataset is a collection of 1.9k question-answer pairs from the Icelandic Wikipedia, meant to evaluate models' knowledge of Icelandic culture and history.
|
70 |
They were collected by making GPT-4o generate questions and anwswers
|
71 |
given Icelandic Wikipedia articles as context. All examples were then manually verified and corrected where necessary. For evaluation, we prompt GPT-4o to
|
72 |
compare the generated answer to the original answer for semantic similarity and rate the answer on the following scale: (0, "poor"), (1, "fair"), (2, "excellent").
|