Given the task definition and input, reply with output. In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

Crowd workers were asked to mark whether a triple was correct, namely, did the triple reflect the consequence of the sentence.
Question: What is the role of crowd-sourcing?
Crowd workers were asked to mark whether a triple was correct, namely, did the triple reflect the consequence of the sentence.