Question: What is the role of crowd-sourcing?
Answer: Crowd workers were asked to mark whether a triple was correct, namely, did the triple reflect the consequence of the sentence.