In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.

[Q]: A meta-research study found only 1 in 9 qualitative papers in Human-Computer Interaction reported inter-rater reliability metrics BIBREF31. Another related area are meta-research and methods papers focused on identifying or preventing low-effort responses from crowdworkers — sometimes called “spam” or “random” responses, or alternatively ”fraudsters” or ”cheaters.” Rates of “self-agreement” are often used, determining if the same person labels the same item differently at a later stage. 
 Question: What are the key issues around whether the gold standard data produced in such an annotation is reliable? 
[A]:  only 1 in 9 qualitative papers in Human-Computer Interaction reported inter-rater reliability metrics low-effort responses from crowdworkers


[Q]: Compared to the in-context-parsing-based system, the combination with exact string matching yields a gain in recall of over 6%, and the combination with inflectional string matching yields an even bigger gain of almost 8%, at precision losses of 0.6% and 0.8%, respectively. 
 Question: What compleentary PIE extraction methods are used to increase reliability further?
[A]: exact string matching inflectional string matching


[Q]: Statistical analysis of tweets ::: Unigram, Bigram an Trigram word frequency analysis
Three forms of tokens of words have been considered for the study viz. unigram, bigram and trigram. 
 Question: Which word frequencies reflect on the psychology of the twitter users, according to the authors?
[A]:
unigram, bigram and trigram