How reliable are annotations via crowdsourcing: a study about inter-annotator agreement for multi-label image annotation
The MIR flickr retrieval evaluation