pwc-archive/papers-with-abstracts huggingface dataset:
Detecting Level of Belief in Chinese and Spanish
Authors: Juan Pablo Colomer, Keyu Lai, Owen Rambow
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12

There has been extensive work on detecting the level of committed belief (also known as {``}factuality{''}) that an author is expressing towards the propositions in his or her utterances. Previous work on English has revealed that this can be done as a sequence tagging task. In this paper, we investigate the same task for Chinese and Spanish, two very different languages from English and from each other.
Negation and Modality in Machine Translation
Authors: Preslav Nakov
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Machine Translation, Negation, Semantic Role Labeling, Sentiment Analysis, Translation

Negation and modality are two important grammatical phenomena that have attracted recent research attention as they can contribute to extra-propositional meaning aspects, among with factuality, attribution, irony and sarcasm. These aspects go beyond analysis such as semantic role labeling, and modeling them is important as a step towards a higher level of language understanding, which is needed for practical applications such as sentiment analysis. In this talk, I will go beyond English, and I will discuss how negation and modality are expressed in other languages. I will also go beyond sentiment analysis and I will present some challenges that the two phenomena pose for machine translation (MT). In particular, I will demonstrate how contemporary MT systems fail on them, and I will discuss some possible solutions.
Problematic Cases in the Annotation of Negation in Spanish
Authors: Salud Mar{\'\i}a Jim{\'e}nez-Zafra, Maite Martin, L. Alfonso Ure{\~n}a-L{\'o}pez, Toni Mart{\'\i}, Mariona Taul{\'e}
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Negation, Negation Detection, Opinion Mining, Question Answering, Sentiment Analysis

This paper presents the main sources of disagreement found during the annotation of the Spanish SFU Review Corpus with negation (SFU ReviewSP -NEG). Negation detection is a challenge in most of the task related to NLP, so the availability of corpora annotated with this phenomenon is essential in order to advance in tasks related to this area. A thorough analysis of the problems found during the annotation could help in the study of this phenomenon.
Building a Dictionary of Affixal Negations
Authors: Chantal van Son, Emiel van Miltenburg, Roser Morante
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Natural Language Inference, Negation, Question Answering

This paper discusses the need for a dictionary of affixal negations and regular antonyms to facilitate their automatic detection in text. Without such a dictionary, affixal negations are very difficult to detect. In addition, we show that the set of affixal negations is not homogeneous, and that different NLP tasks may require different subsets. A dictionary can store the subtypes of affixal negations, making it possible to select a certain subset or to make inferences on the basis of these subtypes. We take a first step towards creating a negation dictionary by annotating all direct antonym pairs inWordNet using an existing typology of affixal negations. By highlighting some of the issues that were encountered in this annotation experiment, we hope to provide some insights into the necessary steps of building a negation dictionary.
Cancer Hallmark Text Classification Using Convolutional Neural Networks
Authors: Simon Baker, Anna Korhonen, Sampo Pyysalo
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Classification, General Classification, text-classification, Text Classification

Methods based on deep learning approaches have recently achieved state-of-the-art performance in a range of machine learning tasks and are increasingly applied to natural language processing (NLP). Despite strong results in various established NLP tasks involving general domain texts, there is only limited work applying these models to biomedical NLP. In this paper, we consider a Convolutional Neural Network (CNN) approach to biomedical text classification. Evaluation using a recently introduced cancer domain dataset involving the categorization of documents according to the well-established hallmarks of cancer shows that a basic CNN model can achieve a level of performance competitive with a Support Vector Machine (SVM) trained using complex manually engineered features optimized to the task. We further show that simple modifications to the CNN hyperparameters, initialization, and training process allow the model to notably outperform the SVM, establishing a new state of the art result at this task. We make all of the resources and tools introduced in this study available under open licenses from \url{https://cambridgeltl.github.io/cancer-hallmark-cnn/}.
Learning Orthographic Features in Bi-directional LSTM for Biomedical Named Entity Recognition
Authors: Nut Limsopatham, Nigel Collier
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Feature Engineering, named-entity-recognition, Named Entity Recognition, Named Entity Recognition (NER), NER, Word Embeddings

End-to-end neural network models for named entity recognition (NER) have shown to achieve effective performances on general domain datasets (e.g. newswire), without requiring additional hand-crafted features. However, in biomedical domain, recent studies have shown that hand-engineered features (e.g. orthographic features) should be used to attain effective performance, due to the complexity of biomedical terminology (e.g. the use of acronyms and complex gene names). In this work, we propose a novel approach that allows a neural network model based on a long short-term memory (LSTM) to automatically learn orthographic features and incorporate them into a model for biomedical NER. Importantly, our bi-directional LSTM model learns and leverages orthographic features on an end-to-end basis. We evaluate our approach by comparing against existing neural network models for NER using three well-established biomedical datasets. Our experimental results show that the proposed approach consistently outperforms these strong baselines across all of the three datasets.
Building Content-driven Entity Networks for Scarce Scientific Literature using Content Information
Authors: Reinald Kim Amplayo, Min Song
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Articles, Entity Extraction using GAN

This paper proposes several network construction methods for collections of scarce scientific literature data. We define scarcity as lacking in value and in volume. Instead of using the paper{'}s metadata to construct several kinds of scientific networks, we use the full texts of the articles and automatically extract the entities needed to construct the networks. Specifically, we present seven kinds of networks using the proposed construction methods: co-occurrence networks for author, keyword, and biological entities, and citation networks for author, keyword, biological, and topic entities. We show two case studies that applies our proposed methods: CADASIL, a rare yet the most common form of hereditary stroke disorder, and Metformin, the first-line medication to the type 2 diabetes treatment. We apply our proposed method to four different applications for evaluation: finding prolific authors, finding important bio-entities, finding meaningful keywords, and discovering influential topics. The results show that the co-occurrence and citation networks constructed using the proposed method outperforms the traditional-based networks. We also compare our proposed networks to traditional citation networks constructed using enough data and infer that even with the same amount of enough data, our methods perform comparably or better than the traditional methods.
Named Entity Recognition in Swedish Health Records with Character-Based Deep Bidirectional LSTMs
Authors: Simon Almgren, Sean Pavlov, Olof Mogren
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Boundary Detection, Feature Engineering, named-entity-recognition, Named Entity Recognition, Named Entity Recognition (NER), NER

We propose an approach for named entity recognition in medical data, using a character-based deep bidirectional recurrent neural network. Such models can learn features and patterns based on the character sequence, and are not limited to a fixed vocabulary. This makes them very well suited for the NER task in the medical domain. Our experimental evaluation shows promising results, with a 60{\%} improvement in F 1 score over the baseline, and our system generalizes well between different datasets.
Entity-Supported Summarization of Biomedical Abstracts
Authors: Frederik Schulze, Mariana Neves
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Document Summarization, Multi-Document Summarization, named-entity-recognition, Named Entity Recognition, Named Entity Recognition (NER), Question Answering, Text Summarization

The increasing amount of biomedical information that is available for researchers and clinicians makes it harder to quickly find the right information. Automatic summarization of multiple texts can provide summaries specific to the user{'}s information needs. In this paper we look into the use named-entity recognition for graph-based summarization. We extend the LexRank algorithm with information about named entities and present EntityRank, a multi-document graph-based summarization algorithm that is solely based on named entities. We evaluate our system on a datasets of 1009 human written summaries provided by BioASQ and on 1974 gene summaries, fetched from the Entrez Gene database. The results show that the addition of named-entity information increases the performance of graph-based summarizers and that the EntityRank significantly outperforms the other methods with regard to the ROUGE measures.
Fully unsupervised low-dimensional representation of adverse drug reaction events through distributional semantics
Authors: Alicia P{\'e}rez, Arantza Casillas, Koldo Gojenola
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12

Electronic health records show great variability since the same concept is often expressed with different terms, either scientific latin forms, common or lay variants and even vernacular naming. Deep learning enables distributional representation of terms in a vector-space, and therefore, related terms tend to be close in the vector space. Accordingly, embedding words through these vectors opens the way towards accounting for semantic relatedness through classical algebraic operations. In this work we propose a simple though efficient unsupervised characterization of Adverse Drug Reactions (ADRs). This approach exploits the embedding representation of the terms involved in candidate ADR events, that is, drug-disease entity pairs. In brief, the ADRs are represented as vectors that link the drug with the disease in their context through a recursive additive model. We discovered that a low-dimensional representation that makes use of the modulus and argument of the embedded representation of the ADR event shows correlation with the manually annotated class. Thus, it can be derived that this characterization results in to be beneficial for further classification tasks as predictive features.
A Dataset for ICD-10 Coding of Death Certificates: Creation and Usage
Authors: Thomas Lavergne, Aur{\'e}lie N{\'e}v{\'e}ol, Aude Robert, Cyril Grouin, Gr{\'e}goire Rey, Pierre Zweigenbaum
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Named Entity Recognition (NER)

Very few datasets have been released for the evaluation of diagnosis coding with the International Classification of Diseases, and only one so far in a language other than English. This paper describes a large-scale dataset prepared from French death certificates, and the problems which needed to be solved to turn it into a dataset suitable for the application of machine learning and natural language processing methods of ICD-10 coding. The dataset includes the free-text statements written by medical doctors, the associated meta-data, the human coder-assigned codes for each statement, as well as the statement segments which supported the coder{'}s decision for each code. The dataset comprises 93,694 death certificates totalling 276,103 statements and 377,677 ICD-10 code assignments (3,457 unique codes). It was made available for an international automated coding shared task, which attracted five participating teams. An extended version of the dataset will be used in a new edition of the shared task.
A Corpus of Tables in Full-Text Biomedical Research Publications
Authors: Tatyana Shmanina, Ingrid Zukerman, Ai Lee Cheam, Thomas Bochynek, Lawrence Cavedon
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Entity Linking, Named Entity Recognition (NER), Table annotation

The development of text mining techniques for biomedical research literature has received increased attention in recent times. However, most of these techniques focus on prose, while much important biomedical data reside in tables. In this paper, we present a corpus created to serve as a gold standard for the development and evaluation of techniques for the automatic extraction of information from biomedical tables. We describe the guidelines used for corpus annotation and the manner in which they were developed. The high inter-annotator agreement achieved on the corpus, and the generic nature of our annotation approach, suggest that the developed guidelines can serve as a general framework for table annotation in biomedical and other scientific domains. The annotated corpus and the guidelines are available at \url{http://www.csse.monash.edu.au/research/umnl/data/index.shtml}.
Supervised classification of end-of-lines in clinical text with no manual annotation
Authors: Pierre Zweigenbaum, Cyril Grouin, Thomas Lavergne
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: General Classification, Language Modeling, Language Modelling, Relation Extraction

In some plain text documents, end-of-line marks may or may not mark the boundary of a text unit (e.g., of a paragraph). This vexing problem is likely to impact subsequent natural language processing components, but is seldom addressed in the literature. We propose a method which uses no manual annotation to classify whether end-of-lines must actually be seen as simple spaces (soft line breaks) or as true text unit boundaries. This method, which includes self-training and co-training steps based on token and line length features, achieves 0.943 F-measure on a corpus of short e-books with controlled format, F=0.904 on a random sample of 24 clinical texts with soft line breaks, and F=0.898 on a larger set of mixed clinical texts which may or may not contain soft line breaks, a fairly high value for a method with no manual annotation.
BioDCA Identifier: A System for Automatic Identification of Discourse Connective and Arguments from Biomedical Text
Authors: Sindhuja Gopalan, Sobha Lalitha Devi
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Named Entity Recognition (NER), Speech Recognition

This paper describes a Natural language processing system developed for automatic identification of explicit connectives, its sense and arguments. Prior work has shown that the difference in usage of connectives across corpora affects the cross domain connective identification task negatively. Hence the development of domain specific discourse parser has become indispensable. Here, we present a corpus annotated with discourse relations on Medline abstracts. Kappa score is calculated to check the annotation quality of our corpus. The previous works on discourse analysis in bio-medical data have concentrated only on the identification of connectives and hence we have developed an end-end parser for connective and argument identification using Conditional Random Fields algorithm. The type and sub-type of the connective sense is also identified. The results obtained are encouraging.
Data, tools and resources for mining social media drug chatter
Authors: Abeed Sarker, Graciela Gonzalez
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Epidemiology, General Classification, Pharmacovigilance, text-classification, Text Classification

Social media has emerged into a crucial resource for obtaining population-based signals for various public health monitoring and surveillance tasks, such as pharmacovigilance. There is an abundance of knowledge hidden within social media data, and the volume is growing. Drug-related chatter on social media can include user-generated information that can provide insights into public health problems such as abuse, adverse reactions, long-term effects, and multi-drug interactions. Our objective in this paper is to present to the biomedical natural language processing, data science, and public health communities data sets (annotated and unannotated), tools and resources that we have collected and created from social media. The data we present was collected from Twitter using the generic and brand names of drugs as keywords, along with their common misspellings. Following the collection of the data, annotation guidelines were created over several iterations, which detail important aspects of social media data annotation and can be used by future researchers for developing similar data sets. The annotation guidelines were followed to prepare data sets for text classification, information extraction and normalization. In this paper, we discuss the preparation of these guidelines, outline the data sets prepared, and present an overview of our state-of-the-art systems for data collection, supervised classification, and information extraction. In addition to the development of supervised systems for classification and extraction, we developed and released unlabeled data and language models. We discuss the potential uses of these language models in data mining and the large volumes of unlabeled data from which they were generated. We believe that the summaries and repositories we present here of our data, annotation guidelines, models, and tools will be beneficial to the research community as a single-point entry for all these resources, and will promote further research in this area.
Detection of Text Reuse in French Medical Corpora
Authors: Eva D{'}hondt, Cyril Grouin, Aur{\'e}lie N{\'e}v{\'e}ol, Efstathios Stamatatos, Pierre Zweigenbaum
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: De-identification, Optical Character Recognition (OCR)

Electronic Health Records (EHRs) are increasingly available in modern health care institutions either through the direct creation of electronic documents in hospitals{'} health information systems, or through the digitization of historical paper records. Each EHR creation method yields the need for sophisticated text reuse detection tools in order to prepare the EHR collections for efficient secondary use relying on Natural Language Processing methods. Herein, we address the detection of two types of text reuse in French EHRs: 1) the detection of updated versions of the same document and 2) the detection of document duplicates that still bear surface differences due to OCR or de-identification processing. We present a robust text reuse detection method to automatically identify redundant document pairs in two French EHR corpora that achieves an overall macro F-measure of 0.68 and 0.60, respectively and correctly identifies all redundant document pairs of interest.
Negation Detection in Clinical Reports Written in German
Authors: Viviana Cotik, Rol Roller, Feiyu Xu, Hans Uszkoreit, Klemens Budde, Danilo Schmidt
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: Named Entity Recognition (NER), Negation, Negation Detection, Relation Extraction

An important subtask in clinical text mining tries to identify whether a clinical finding is expressed as present, absent or unsure in a text. This work presents a system for detecting mentions of clinical findings that are negated or just speculated. The system has been applied to two different types of German clinical texts: clinical notes and discharge summaries. Our approach is built on top of NegEx, a well known algorithm for identifying non-factive mentions of medical findings. In this work, we adjust a previous adaptation of NegEx to German and evaluate the system on our data to detect negation and speculation. The results are compared to a baseline algorithm and are analyzed for both types of clinical documents. Our system achieves an F1-Score above 0.9 on both types of reports.
Scoring Disease-Medication Associations using Advanced NLP, Machine Learning, and Multiple Content Sources
Authors: D, Bharath ala, Murthy Devarakonda, Mihaela Bornea, Christopher Nielson
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12
Tasks: BIG-bench Machine Learning

Effective knowledge resources are critical for developing successful clinical decision support systems that alleviate the cognitive load on physicians in patient care. In this paper, we describe two new methods for building a knowledge resource of disease to medication associations. These methods use fundamentally different content and are based on advanced natural language processing and machine learning techniques. One method uses distributional semantics on large medical text, and the other uses data mining on a large number of patient records. The methods are evaluated using 25,379 unique disease-medication pairs extracted from 100 de-identified longitudinal patient records of a large multi-provider hospital system. We measured recall (R), precision (P), and F scores for positive and negative association prediction, along with coverage and accuracy. While individual methods performed well, a combined stacked classifier achieved the best performance, indicating the limitations and unique value of each resource and method. In predicting positive associations, the stacked combination significantly outperformed the baseline (a distant semi-supervised method on large medical text), achieving F scores of 0.75 versus 0.55 on the pairs seen in the patient records, and F scores of 0.69 and 0.35 on unique pairs.
Author Name Disambiguation in MEDLINE Based on Journal Descriptors and Semantic Types
Authors: Dina Vishnyakova, Raul Rodriguez-Esteban, Khan Ozol, Fabio Rinaldi
Date: 2016-12-01 00:00:00
Proceeding: WS 2016 12

Author name disambiguation (AND) in publication and citation resources is a well-known problem. Often, information about email address and other details in the affiliation is missing. In cases where such information is not available, identifying the authorship of publications becomes very challenging. Consequently, there have been attempts to resolve such cases by utilizing external resources as references. However, such external resources are heterogeneous and are not always reliable regarding the correctness of information. To solve the AND task, especially when information about an author is not complete we suggest the use of new features such as journal descriptors (JD) and semantic types (ST). The evaluation of different feature models shows that their inclusion has an impact equivalent to that of other important features such as email address. Using such features we show that our system outperforms the state of the art.