Mining Zenodo: Data extraction and indexing of a research repository
Creators: name: Pastor
Publisher: name: Zenodo
Year: 2019
Subjects: Natural Language Processing
data mining
open-access repository
web application

description: The output of scientific publications is increasing steadily each year. Due to this scientific literature overload, an exhaustive research of a certain topic becomes overwhelming and researchers cannot get a solid grasp of all this valuable knowledge. Natural language processing and text mining have become essential to tackle this issue and provide a solution: a comprehensive, careful and accessible perspective on the knowledge contained in scientific publications. This work aims to take advantage of this opportunity and develop an application to extract and index part of the information contained in Zenodo, an open-access repository developed under the European OpenAIRE program. The work will be based on the employment of the Dr Inventor tool (a text mining framework that enables the automated analysis of scientific publications) to support the extraction of specific information types from Zenodo’s collection of research papers in order to allow semantic indexing, discourse classification and discovery. The application is meant to be a useful and helpful tool to ease the learning experience of researchers, students and more.
description: {"references": ["Ware, M. &amp; Mabe, M. The stm report: An overview of scientific and scholarly journal publishing (2015).", "Kemmer, S. Words in english: Structure. http://www.ruf.rice.edu/ ~kemmer/Words04/structure/index.html.", "JLIS.it, R. Budapest open access initiative (2002). JLIS.it 3 (2012).", "Namboodiri, A. M. &amp; Jain, A. K. Document structure and layout analysis. In Digital Document Processing, 29\u201348 (Springer, 2007).", "pdf2xml. https://github.com/kermitt2/pdf2xml.", "Poppler. https://poppler.freedesktop.org/.", "Pdfbox. https://pdfbox.apache.org/.", "pdf2htmlex. https://github.com/coolwanglu/pdf2htmlEX.", "Pdfx. http://pdfx.cs.man.ac.uk/.", "Cermine. https://github.com/CeON/CERMINE.", "Grobid. https://github.com/kermitt2/grobid.", "Sectlabel. https://github.com/knmnyn/ParsCit/tree/master/bin/ sectLabel.", "Ferr\u00e9s, D., Saggion, H., Ronzano, F. &amp; Bravo, \u00c0. PDFdigest: an adaptable layout-aware PDF-to-XML textual content extractor for scientific articles. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018) (European Languages Resources Association (ELRA), Miyazaki, Japan, 2018). URL https://www.aclweb.org/ anthology/L18-1298.", "C.Mann, W.&amp;Thompson, S. Rethoricalstructuretheory: Towardafunctional theory of text organization. Text 8, 243\u2013281 (1988).", "Teufel, S. et al. Argumentative zoning: Information extraction from scientific text. Ph.D. thesis, Citeseer (1999).", "Ronzano, F. &amp; Saggion, H. Dr. inventor framework: Extracting structured information from scientific publications. In Japkowicz, N. &amp; Matwin, S. (eds.) Discovery Science, 209\u2013220 (Springer International Publishing, Cham, 2015).", "Freecite. http://freecite.library.brown.edu/welcome.", "Cora dataset. https://hpi.de/naumann/projects/repeatability/ datasets/cora-dataset.html.", "Crossref. https://github.com/CrossRef/rest-api-do.", "Bibsonomy. http://www.bibsonomy.org/help/doc/api.html.", "Mate tools. https://code.google.com/archive/p/mate-tools/.", "Fisas, B., Saggion, H. &amp; Ronzano, F. On the discursive structure of computer graphics research papers. Proceedings of the Linguistic Annotation Workshop, NAACL (2015).", "Teufel, S., Siddharthan, A. &amp; Batchelor, C. Towards discipline-independent argumentative zoning: evidence from chemistry and computational linguistics. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3-Volume 3, 1493\u20131502 (Association for Computational Linguistics, 2009).", "Liakata, M., Teufel, S., Siddharthan, A. &amp; Batchelor, C. Corpora for the conceptualisation and zoning of scientific papers (2010)."]}