TASK DEFINITION: In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.
PROBLEM: We deployed the task on Amazon Mechanical Turk (AMT). To see how reasoning varies across workers, we hire 3 crowdworkers per one instance. We hire reliable crowdworkers with $\ge 5,000$ HITs experiences and an approval rate of $\ge $ 99.0%, and pay ¢20 as a reward per instance.

SOLUTION: Did they use any crowdsourcing platform?

PROBLEM: The Hausa data used in this paper is part of the LORELEI language pack. It consists of Broad Operational Language Translation (BOLT) data gathered from news sites, forums, weblogs, Wikipedia articles and twitter messages. We use a split of 10k training and 1k test instances. The Yorùbá NER data used in this work is the annotated corpus of Global Voices news articles recently released by BIBREF22. The dataset consists of 1,101 sentences (26k tokens) divided into 709 training sentences, 113 validation sentences and 279 test sentences based on 65%/10%/25% split ratio.

SOLUTION: How much labeled data is available for these two languages?

PROBLEM: The involved algorithms are detailed as follows.

CNN-C denotes the CNN with (Chinese) character embedding.

CNN-W denotes the CNN with (Chinese) word embedding.

CNN-Lex-C denotes the algorithm which also integrates polar words in CNN which is proposed by Shin et al. BIBREF24 . The (Chinese) character embedding is used.

CNN-Lex-W denotes the algorithm which also integrates polar words in CNN which is proposed by Shin et al. BIBREF24 . The (Chinese) word embedding is used.

Bi-LSTM-C denotes the BI-LSTM with (Chinese) character embedding.

Bi-LSTM-W denotes the Bi-LSTM with (Chinese) word embedding.

Lex-rule denotes the rule-based approach shows in Fig. 1. This approach is unsupervised.

BOW denotes the conventional algorithm which is based of bag-of-words features.

SOLUTION:
What are the other models they compare to?