SemEval-2 Task 8 focuses on Multi-way classification of semantic relations between pairs of nominals. The task was designed to compare different approaches to semantic relation classification and to provide a standard testbed for future research. This paper defines the task, describes the training and test data and the process of their creation, lists the participating systems (10 teams, 28 runs), and discusses their results.
SemEval-2 had a shared task, Multi-Way Classification of Semantic Relations Between Pairs of Nominals REF , which does include a Member-Collection relation, and is somewhat different to the ACE/MUC RE paradigm.
SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations between Pairs of Nominals
Workshop on Semantic Evaluations (SemEval)
Computer Science