semvec/pypi-packages huggingface dataset:
CrowdTruth 2.1
Disagreement based metrics for the processing and evaluation of crowdsourced annotations
License: Apache 2.0
Keywords: CrowdTruth,crowdsourcing,disagreement,metrics,crowdflower,amazon mechanical turk

CrowdTruth is an approach to machine-human computing for collecting annotation data on text, images and videos. The approach is focussed specifically on collecting annotation data by capturing and interpreting inter-annotator disagreement.