Package: mmax2conll
mmax2conllScript to convert coreference data in MMAX format toCoNLLformat or raw text files.SeeCoNLL-specification.mdandMMAX-specification.mdfor extensive descriptions of the CoNLL and MMAX formats.Usagemmax2conll.pyBecause the COREA corpus saves its sentence information in the*_words.xmlfiles
but theSoNaR-1corpus saves this separately in*_sentence_level.xmlfiles,
specifying a sentences file is optional.To automatically find all (sub)folders that contain aBasedataandMarkablesfolder as direct children and convert all data in those folders, run:python-mmmax2conllpath/to/config.ymlpath/to/output_dir-dpath/to/some/folder[-dpath/to/another/folder...]To only convert one pair (or triple) of files, run:python-mmmax2conllpath/to/config.ymlpath/to/output.conllpath/to/some_words.xmlpath/to/a_coref_level.xml[path/to/a_sentence_level.xml]mmax2raw.pyTo automatically find all (sub)folders that contain aBasedataandMarkablesfolder as direct children and convert all data in those folders, run:mmax2raw.pypath/to/output_dir-dpath/to/some/folder[-dpath/to/another/folder...]To only convert one file, run:mmax2raw.pypath/to/output.txtpath/to/some_words.xmlColumns of CoNLL outputThese scripts were first used to convert data from theCOREA(Ch.7 p.115 -- 128) dataset to CoNLL and
COREA does not contain the following information:POS tagsconstituency treepredicatesspeaker/author informationnamed entitiesThereforethese scripts strictly do not output data in CoNLL format.
The following values and place-holders are used.ColumnDescriptionValueConform CoNLL specification?1Document IDfile path without extensionYes2Part number0or as extracted from<word>.alpsentfrom MMAX*_words.xmlfiles [1]Yes3Word number<word>.alpposor<word>.posfrom MMAX*_words.xmlfilesYes4Word itselfcontent of<word>tags from MMAX*_words.xmlfilesYes5POS[POS]No6Parse bit*No7Predicate lemma-Yes8Predicate Frameset ID-Yes9Word sense-Yes10Speaker/AuthorUNKNOWN???11Named Entities*Yes-Predicate ArgumentsNone: column(s) left out entirelyYes, conform example in CoNLL 201212Coreferenceextracted from MMAX*_coref_level.xmlfiles (ISSUE! [2])Yes[1]:
The part numbers of DCOI start at 1, where the part numbers in a CoNLL file start at 0.
To keep the origin of the data clear this 1-based part number is not changed,
but instead an empty part 0 is added to those files.[2]:
The reference spans are not closed in the correct order if they end at the same word. The following is an example of output frommmax2conll:(10
            -
      (52|(55
          52)
            -
10)|55)|(133)While pedantically correct would be:(10
            -
      (55|(52
          52)
            -
(133)|55)|10)IssuesSkipping a whole file one any error is too wasteful'on_missing' config key is not validated before usebasedata_dirandmarkables_dirshould not be configuration keysToo many methods inmain.pyare marked as class methodsReferencesChristoph Müller and Michael Strube.Multi-Level Annotation in MMAXIn Proceedings of the 4th SIGDIAL Workshop. 2003.URLhttp://www.speech.cs.cmu.edu/sigdial2003/proceedings/07_LONG_strube_paper.pdfIris Hendrickx, Gosse Bouma, Walter Daelemans and Véronique Hoste.COREA: Coreference Resolution for Extracting Answers for DutchEssential Speech and Language Technology for Dutch, Ch.7, p.115 -- 128. 2013.Editors: Peter Spyns, Jan Odijkhttps://link.springer.com/book/10.1007/978-3-642-30910-610.1007/978-3-642-30910-6SoNaR:https://ivdnt.org/downloads/taalmaterialen/tstc-sonar-corpus