gardarjuto commited on
Commit
b9777d9
1 Parent(s): fa8bb65

fix: description text

Browse files
Files changed (1) hide show
  1. src/about.py +1 -1
src/about.py CHANGED
@@ -66,7 +66,7 @@ A machine-translated version of the ARC-Challenge multiple-choice question-answe
66
  - Link to dataset: https://huggingface.co/datasets/mideind/icelandic-arc-challenge
67
 
68
  ### WikiQA-IS
69
- The Icelandic WikiQA dataset is a collection of 1.1k question-answer pairs from the Icelandic Wikipedia, meant to evaluate models' knowledge of Icelandic culture and history.
70
  They were collected by making GPT-4o generate questions and anwswers
71
  given Icelandic Wikipedia articles as context. All examples were then manually verified and corrected where necessary. For evaluation, we prompt GPT-4o to
72
  compare the generated answer to the original answer for semantic similarity and rate the answer on the following scale: (0, "poor"), (1, "fair"), (2, "excellent").
 
66
  - Link to dataset: https://huggingface.co/datasets/mideind/icelandic-arc-challenge
67
 
68
  ### WikiQA-IS
69
+ The Icelandic WikiQA dataset is a collection of 1.9k question-answer pairs from the Icelandic Wikipedia, meant to evaluate models' knowledge of Icelandic culture and history.
70
  They were collected by making GPT-4o generate questions and anwswers
71
  given Icelandic Wikipedia articles as context. All examples were then manually verified and corrected where necessary. For evaluation, we prompt GPT-4o to
72
  compare the generated answer to the original answer for semantic similarity and rate the answer on the following scale: (0, "poor"), (1, "fair"), (2, "excellent").