DOI: 10.35111/29hc-f004
title: LORELEI Kinyarwanda Incident Language Pack

description: <h3>Introduction</h3><br>
<p>LORELEI Kinyarwanda Incident Language Pack was developed by the Linguistic Data Consortium and is comprised of approximately 11.9 million words of Kinyarwanda monolingual text, 35,000 words of English monolingual text, 3.4 million words of parallel and comparable Kinyarwanda-English text, and 50,000 words each of English and Kinyarwanda data annotated for Entity Discovery and Linking and Situation Frames. It contains all of the text data, annotations, supplemental resources and related software tools for the Kinyarwanda language that were used in the <a href="https://www.nist.gov/itl/iad/mig/lorehlt-evaluations">DARPA LORELEI / LoReHLT 2018 Evaluation</a>.</p><br>
<p>The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation.</p><br>
<p>The evaluation protocol was based on a scenario in which an unforeseen event triggered a need for humanitarian and logistical support in a region where the incident language had received little or no attention in natural language processing (NLP) research. Evaluation participants provided NLP solutions, including information extraction and machine translation, based on limited resources and with very little time for development.</p><br>
<h3>Data</h3><br>
<p>Kinyarwanda is spoken mainly in Rwanda, where it is the official language, the Democratic Republic of the Congo and Uganda. Data was collected in the following genres: news, social network, weblog, newsgroup, discussion forum, and reference material.</p><br>
<p>Entity detection and linking annotation identified entities to be detected by systems for scoring purposes. Situation frame analysis was designed to extract basic information about needs and relevant issues for planning a disaster response effort.</p><br>
<p>Also included in this release are lexical and grammatical resources as well as three tools: two to recreate original source data from the processed XML material and the other to condition text data users download from Twitter.</p><br>
<p>Monolingual, parallel and comparable text are presented in XML with associated dtds. Entity Detection and Linking and Situation Frame annotation data is presented as tab delimited files. All text is UTF-8 encoded.</p><br>
<p>The knowledge base for entity linking annotation for this corpus and all LORELEI Representative Language and Incident Language Packs is available separately as <a href="../../../LDC2020T10">LORELEI Entity Detection and Linking Knowledge Base (LDC2020T10)</a>.</p><br>
<h3>Acknowledgement</h3><br>
<p>This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA.</p><br>
<h3>Samples</h3><br>
<p>Please view these samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2022T01.kin.ltf.xml">Kinyarwanda LTF XML</a></li><br>
<li><a href="desc/addenda/LDC2022T01.kin.psm.xml">Kinyarwanda PSM XML</a></li><br>
<li><a href="desc/addenda/LDC2022T01.eng.ltf.xml">English LTF XML</a></li><br>
<li><a href="desc/addenda/LDC2022T01.eng.psm.xml">English PSM XML</a></li><br>
<li><a href="desc/addenda/LDC2022T01.entity.tab">Entity Table (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2022T01.issues.tab">Issues Table (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2022T01.needs.tab">Needs Table (TXT)</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2017-2018 24.com, © 2018 ABC, © 2017-2018 Africanews, © 2017 AFRICAN PEOPLE'S VOICE, © 2016 AKARERE KA GATSIBO, © 2018 AKARERE KA GICUMBI, © 2018 AKARERE KA NGORORERO, © 2018 AKARERE KA NGOMA, © 2016 Al Jazeera Media Network, © 2017-2018 AllAfrica, © 2015-2017 Ayyaantuu.org, © 2018 BBC, © 2016 bilisummaa, © 2019 bwiza, © 2017 Cable News Network. Turner Broadcasting System, Inc., © 2017-2018 Ebenezer Media Group Ltd, © 2017 eNews Channel Africa, © 2017-2018 euronews, © 2015-2016 FloodList, © 2016 France 24, © 2016 Free RWANDA, © 2015 Guardian News and Media Limited or its affiliated companies, © 2015-2018 IGIHE Ltd, © 2016 Independent Media and affiliated companies, © 2016 ingenzinyayo.com, © 2018 The inspirer Ltd, © 2016-2017 Intara y'Iburasirazuba, © 2016, 2018 Intyoza, © 2016 Inyarwanda Ltd, © 2015-2016, 2018 INYENYERI NEWS, © 2017 ISANGO STAR, © 2015-2016 Izuba Rirashe, © 2016 Karen Organization of Minnesota, © 2011-2018 Kigali Today, © 2015-2017 KT PRESS, © 2017 Mail & Guardian Online, © 2014-2018 Makuruki, © 2015 MARYLAND DENTAL ACTION COALITION, © 2015 MDA, © 2016 Ministry of Disaster Management and Refugee Affairs (MIDIMAR), © 2015-2017 Ministry of Foreign Affairs of Ukraine, © 2017-2018 Mount Carmel Health System, © 2018 Muhabura.com, © 2016-2017 Nation Media Group, © 2017-2018 Nationwide Children's Hospital, © 2017 New Vision, © 2017 New York Times, © 2017-2018 OhioHealth, © 2018 Okay Africa, © 2016 Panorama, © 2016 paxpress.org, © 2018 Philadelphia Media Network (Digital), LLC, © 2017 Quartz Media LLC, © 2018 RBA, © 2018 RDN LTD, © 2016-2017 Rugali, © 2016 Rwanda News Agency, © 2018 Scientific American, a Division of Nature America, Inc., © 2015 Siloam Health, © 2018 SMW Communications LTD, © 2017 Tele10 Group, © 2016-2017 The National Radio Company of Ukraine, © 2016 The New Times Rwanda, © 2017-2018 The Ohio State University, © 2018 tiso blackstar group (Pty) Ltd, © 2017-2018 TouchRwanda.com, © 2018 TURKUVAZ COMMUNICATION AND PUBLICATION CORPORATION, © 2018 TV1, © 2014 - 2017 Ubukungu, © 2016 UMUCYO.rw, © 2016 umurashi.rw,© 2016, 2018 Umuryango, © 2017 Umwezi.net, © 2011-2017 Umuseke, © 2015 University of Louisville, © 1995-2018 University of Washington, © 2015 U.S. Committee for Refugees and Immigrants, © 2010-2018 Watch Tower Bible and Tract Society of Pennsylvania,© 2017-2018 Wexner Medical Center, © 2016 XINHUANET.com, © 2018 Yeejo Limited, © 2018, 2020, 2022 Trustees of the University of Pennsylvania