DOI: 10.35111/tj1h-js83
title: TAC KBP English Event Nugget Detection and Coreference - Comprehensive Training and Evaluation Data 2014-2015

description: <h3>Introduction</h3><br>
<p>TAC KBP English Event Nugget Detection and Coreference - Comprehensive Training and Evaluation Data 2014-2015 was developed by the Linguistic Data Consortium (LDC) and contains training and evaluation data produced in support of the TAC KBP English Event Nugget Detection and Coreference tasks in <a href="https://tac.nist.gov/2014/KBP/Event/index.html">2014</a> and <a href="http://cairo.lti.cs.cmu.edu/kbp/2015/event/index">2015</a>.</p><br>
<p>Text Analysis Conference (<a href="https://tac.nist.gov/">TAC</a>) is a series of workshops organized by the National Institute of Standards and Technology (<a href="https://www.nist.gov/">NIST</a>). TAC was developed to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. Through its various evaluations, the Knowledge Base Population (KBP) track of TAC encouraged the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base.</p><br>
<p>The goal of the Event Nugget track was to evaluate system performance on the detection and coreference of sets of attributes referencing events in unstructured text. Event Nuggets consist of a mention of the event from the text and labels to indicate event type, subtype, and realis (an indication of whether an event has actually occurred or not). More information about the Event Nugget track and other TAC KBP evaluations can be found on the <a href="https://tac.nist.gov/">NIST TAC website</a>.</p><br>
<h3>Data</h3><br>
<p>Source data is English newswire and discussion forum text collected by LDC. This release includes source documents, gold standard event nugget annotations in multiple formats, coreference information for the nuggets, and tokenized source documents.</p><br>
<p>A summary of the data is below:</p><br>
<table border="1" summary="summary of data by year, source docs and nuggets"><br>
<tbody><br>
<tr><br>
<td>Year</td><br>
<td>Source Docs</td><br>
<td>Nuggets</td><br>
</tr><br>
<tr><br>
<td>2014</td><br>
<td>351</td><br>
<td>10,719</td><br>
</tr><br>
<tr><br>
<td>2015</td><br>
<td>360</td><br>
<td>12,976</td><br>
</tr><br>
</tbody><br>
</table><br>
<h3>Acknowledgement</h3><br>
<p>This material is based on research sponsored by Air Force Research Laboratory and Defense Advance Research Projects Agency under agreement number FA8750-13-2-0045. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright notation thereon. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of Air Force Research Laboratory and Defense Advanced Research Projects Agency or the U.S. Government.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2020T13.txt">Source (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2020T13.ann">Brat format annotation (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2020T13.hopper.ann">Brat format hopper (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2020T13.event_nuggets.xml">XML format annotation (XML)</a></li><br>
<li><a href="desc/addenda/LDC2020T13.event_hoppers.xml">XML format hopper (XML)</a></li><br>
<li><a href="desc/addenda/LDC2020T13.tab">Tokenized Source (TXT)</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2003, 2009, 2010 Agence France Press, © 2009, 2010 The Associated Press, © 2010 Central News Agency (Taiwan), © 2009, 2010, 2013 New York Times, © 2010 The Washington Post News Service with Bloomberg News, © 2009, 2010 Xinuha News Agency, © 2003, 2009, 2010, 2013, 2014, 2015, 2016, 2020 Trustees of the University of Pennsylvania