Task: Question Answering
Input (English): We feed these representations into a clustering algorithm that produces exactly eleven clusters of five cities each and evaluate them against both Calvino's original labels and crowdsourced human judgments. While the overall correlation with Calvino's labels is low, both computers and humans can reliably identify some thematic groups associated with concrete objects. 
 Question: How do they obtain human judgements?
Output (English): Using crowdsourcing