DOI: 10.6084/m9.figshare.8187155
title: Dataset for <i>Vector space model and the usage patterns of Indonesian denominal verbs</i>

description: <b>Preface</b><br>This is the data repository for the paper accepted for publication in NUSA's special issue on Linguistic studies using large annotated corpora (co-edited by Hiroki Nomoto and David Moeljadi).<br><b>How to cite the dataset</b><br>If you use, adapt, and/or modify any of the dataset in this repository for your research or teaching purposes (except for the <code>malindo_dbase</code>, see below), please cite as:<br>Rajeg, Gede Primahadi Wijaya; Denistia, Karlina; Musgrave, Simon (2019): Dataset for <i>Vector space model and the usage patterns of Indonesian denominal verbs</i>. figshare. Fileset.<b> </b>https://doi.org/10.6084/m9.figshare.8187155.<br>Alternatively, click on the dark pink <code>Cite</code> button to browse different citation style (default is <code>DataCite</code>).<br><br>The <code>malindo_dbase</code> data in this repository is from Nomoto et al. (2018) (cf the GitHub repository). So please also cite their work if you use it for your research:<br>Nomoto, Hiroki, Hannah Choi, David Moeljadi and Francis Bond. 2018. MALINDO Morph: Morphological dictionary and analyser for Malay/Indonesian. Kiyoaki Shirai (ed.) <i>Proceedings of the LREC 2018 Workshop "The 13th Workshop on Asian Language Resources"</i>, 36-43.<br>Tutorial on how to use the data together with the R Markdown Notebook for the analyses is available on GitHub and figshare:Rajeg, Gede Primahadi Wijaya; Denistia, Karlina; Musgrave, Simon (2019): R Markdown Notebook for <i>Vector space model and the usage patterns of Indonesian denominal verbs</i>. figshare. Software. doi: https://doi.org/10.6084/m9.figshare.9970205<br><b>Dataset description</b><br>1. <code>Leipzig_w2v_vector_full.bin</code> is the vector space model used in the paper. We built it using wordVectors package (Schmidt & Li 2017) via the MonARCH High Performance Computing Cluster (We thank Philip Chan for his help with access to MonARCH).<br>2. Files beginning with <code>ngramexmpl_...</code> are data for the n-grams (i.e. words sequence) of verbs discussed in the paper. The files are in tab-separated format.<br>3. Files beginning with <code>sentence_...</code> are full sentences for the verbs discussed in the paper (in the plain text format and R dataset format [<code>.rds</code>]). Information of the corpus file and sentence number in which the verb is found are included.<br>4. <code>me_parsed_nountaggedbase</code> (in three different file-formats) contains database of the <i>me-</i> words with noun-tagged root that MorphInd identified to occur in three morphological schemas we focus on (<i>me-</i>, <i>me-/-kan</i>, and <i>me-/-i</i>). The database has columns for the verbs' token frequency in the corpus, root forms, MorphInd parsing output, among others.<br>5. <code>wordcount_leipzig_allcorpus</code> (in three different file-formats) contains information on the size of each corpus file used in the paper and from which the vector space model is built.<br>6. <code>wordlist_leipzig_ME_DI_TER_percorpus.tsv</code> is a tab-separated frequency list of words prefixed with <i>me-</i>, <i>di-</i>, and <i>ter-</i> in all thirteen corpus files used. The wordlist is built by first tokenising each corpus file, lowercasing the tokens, and then extracting the words with the corresponding three prefixes using the following regular expressions: - For <i>me-</i>: <code>^(?i)(me)([a-z-]{3,})$</code>- For <i>di-</i>: <code>^(?i)(di)([a-z-]{3,})$</code>- For <i>ter-</i>: <code>^(?i)(ter)([a-z-]{3,})$</code><br>7. <code>malindo_dbase</code> is the MALINDO Morphological Dictionary (see above).<br><b>References</b><br>Schmidt, Ben & Jian Li. 2017. <i>wordVectors: Tools for creating and analyzing vector-space models of texts</i>. R package. http://github.com/bmschmidt/wordVectors.