M ad D og: A Web-based System for Acronym Identification and Disambiguation (2021)

Abstract: Acronyms and abbreviations are the short-form of longer phrases and they are ubiquitously employed in various types of writing. Despite their usefulness to save space in writing and reader’s time in reading, they also provide challenges for understanding the text especially if the acronym is not defined in the text or if it is used far from its definition in long texts. To alleviate this issue, there are considerable efforts both from the research community and software developers to build systems for identifying acronyms and finding their correct meanings in the text. However, none of the existing works provide a unified solution capable of processing acronyms in various domains and to be publicly available. Thus, we provide the first web-based acronym identification and disambiguation system which can process acronyms from various domains including scientific, biomedical, and general domains. The web-based system is publicly available at http://iq.cs.uoregon.edu:5000 and a demo video is available at https://youtu.be/IkSh7LqI42M . The system source code is also available at https://github.com/amirveyseh/MadDog .

## introduction textual contents such as books, articles, reports, and web-blogs in various domains are replete with phrases that are commonly used by people in that field. in order to save space in text writing and also facilitate communication among people who are already familiar with these phrases, the shorthanded form of long phrases, known as acronyms and abbreviations, are frequently used. however, the use of acronyms could also introduce challenges to understand the text, especially for newcomers. more specifically, two types of challenges might hinder reading text with acronyms. first, in long documents, e.g., a book chapter, an acronym might be defined somewhere in the text and used several times throughout the document. for someone who is not familiar with the definition of the acronym and interested in reading a part of the document, it might be time-consuming to find the definition of the acronym in the document. to solve this problem, an automatic acronym identification tool is required whose goal is to find all acronyms and their definitions that are locally provided in the same document. second, some of the acronyms might not be even defined in the document itself. these acronyms are commonly used by writers in a specific domain. to find the correct meaning of them, a reader must look-up the acronym in a dictionary of acronyms. however, due to the shorter length of acronyms compared to their long-form, multiple phrases might be shortened with the same acronym, thereby, they will be ambiguous. in these cases, a deep understanding of the domain is required to recognize the correct meaning of the acronym among all possible long-forms. to solve this issue, a system capable of disambiguating an acronym based on its context is necessary. each of the aforementioned problems, i.e., acronym identification (ai) and acronym disambiguation (ad), has been extensively studied by the research community or software developers. one of the methods which are widely used in acronym identification research is proposed by @xcite . this is a rule-based model that utilizes character-match between acronym letters and their context to find the acronym and its long-form in text. later, some feature-based models have been also used for acronym identification @xcite . in addition, some of the existing software employs regular expressions for acronym identification in the biomedical domain @xcite . acronym disambiguation is also approached with feature-based models @xcite or more advanced deep learning meth-ods @xcite . the majority of deep models employ word embeddings to compute the similarity between the candidate longform and the acronym context. in addition to the existing research for ad, there is some web-based software that employ dictionary look-up to expand an acronym to its long-form (abbrex2018). note that the methods based on dictionary look-up are not able to disambiguate the acronym if it has multiple meanings. despite the progress made on the ai and ad task in the last two decades, there are some limitations in the prior works that prevent achieving a functional system to be used in practice. more specifically, considering the research on the ad task, all of the prior works employ a small-size dataset covering a few hundred to a few thousand long-forms in a specific domain. therefore, the models trained in these works are not capable to expand all acronyms of a domain or acronyms in other domains other than the one used in the training set. although in the recent work @xcite , authors proposed a big dataset for acronym disambiguation in the medical domain with more than 14 million samples, it is still limited to a specific domain (i.e., medical domain). another limitation in prior works is that they do not provide a unified system capable of performing both tasks in various domains and to be publicly available. to our knowledge, the only exiting web-based system for ai and ad is proposed by @xcite . for acronym identification, this system employs the rule-based model introduced by @xcite . to handle corner cases, they add extra rules in addition to schwartz's rules in their system. unfortunately, they do not provide detailed information about these corner cases and extra rules or any evaluation to assess the performance of the model. for acronym disambiguation, they resort to a statistical model in which a pre-computed vector representation for each candidate long-form is employed to compute the similarity between candidate long-form with the context of the ambiguous acronym represented using another vector. however, there are two limitations with this approach: first, the pre-computed long-form vectors are obtained via only wikipedia, thus limiting this system to the general domain and incapable of disambiguating acronyms in other domains such as scientific papers or biomedical texts; second, the ad model based on the pre-computed vectors is a statistical model and is not benefiting from the advanced deep architectures, thereby it might have inferior performance compared to a deep ad model. to address the shortcomings and limitations of the prior research works or systems for ai and ad, in this work, we introduce a web-based system for acronym identification and disambiguation that is capable of recognizing and expanding acronyms in multiple domains including general (e.g., wikipedia articles), scientific (e.g., computer science papers), biomedical (e.g., medline abstracts), or financial (e.g., financial discussions in reddit). note that the proposed system is capable to identify acronyms and their long-forms in all latin-script languages. more specifically, for acronym identification, we propose a rule-based model by extending the set of rules proposed by @xcite . we empirically show that the proposed model outperforms both the previous rule-based model and also the existing state-ofthe-art deep learning models for acronym identification on the recent benchmark dataset sciai @xcite . next, we use a large dataset created from corpora in various domains for acronym disambiguation to train a deep model for this task. specifically, we employ a sequential deep model to encode the context of the ambiguous acronym and solve the ad task using a feedforward multi-class classifier. we also evaluate the performance of the proposed acronym disambiguation model on the recent benchmark dataset sciad @xcite . to summarize, our contributions are: ## system description the proposed system is a web-based system consisting of two major components: (i) acronym identification which consists of a set of prioritized rules to recognize the mentions of acronyms and their long-forms in the text; (ii) acronym expansion which involves a dictionary look-up to expand acronyms with only one possible long-form and a pre-trained deep learning model to predict the long-form of an ambiguous acronym using its context. the system takes as input a piece of text and returns the text with highlighted acronyms in which the user can click on the acronyms and their long-form will be shown in a pop-up window. the acronym glossary extracted from the text is also shown at the end of the text. note that users can also enable/disable the acronym expansion component. this section studies the details of the aforementioned components. ## evaluation this section provides more insight into the performance of the proposed acronym identification and disambiguation models. to evaluate the performance of the models in comparison with other state-of-the-art ai and ad models, we report the performance of the proposed models on sciai and sciad benchmark datasets @xcite . we also compare the performance of the proposed model with the baselines provided in the recent work @xcite . more specifically, on sciai, we compare our model with rule-based models noa @xcite , ade @xcite and uad @xcite ; and also the feature-based models bioadi @xcite and lncrf @xcite ; and finally the sota deep model lstm-crf @xcite . for evaluation metrics, following prior work, we report precision, recall, and f1 score for the acronym and long-form prediction and also their macro-averaged f1 score. the results are shown in to assess the performance of the proposed acronym disambiguation model, we evaluate its performance on the benchmark dataset sciad and zettlemoyer, 2020), decbae @xcite and gad @xcite . the results are shown in ## related work acronym identification (ai) and acronym disambiguation (ad) are two well-known tasks with several prior works in the past two decades. for ai, both rule-based models @xcite @xcite @xcite @xcite and supervised feature-based or deep learning models @xcite @xcite are utilized. due to the higher accuracy of rule-based models, they are dominantly used in the majority of the related works, especially to automatically create acronym dictionary @xcite @xcite . however, the existing works prepare a small-size dictionary in a specific domain. in contrast, in this work, we first improve the existing rules for acronym identification, then, we use a diverse acronym glossary in our system. for acronym disambiguation, prior works employ either feature-based models @xcite or deep learning methods @xcite @xcite @xcite . in this work, we also employ a sequential deep learning model for ad. however, unlike prior work that proposes an acronym disambiguation model for a specific do-main and limited acronyms, our proposed model covers more acronyms and it is able to expand an acronym in various domains. another common limitation of the existing research-based models for ai and ad is that they do not provide any publicly available system that could be quickly incorporated into a textprocessing application. although there is some software for acronym identification such as expanding biomedical abbreviations using dynamic regular expressions (badrex) @xcite or abbreviation expander (abbrex) (abbrex2018), unfortunately, they are incapable of acronym disambiguation. to our knowledge, the most similar work to ours is proposed by ciosici and assent (2018). specifically, similar to our work, this web-based system is able to identify and expand acronym in text. a rule-based model is employed for ai and this model is also used to create a dictionary of acronyms. for ad, unlike our work that trains a deep model, they use word embedding similarity to predict the most likely expansion. however, there are some limitations to this previous system. firstly, it is restricted to the general domain (i.e., wikipedia) and it covers a limited number of acronyms. second, it does not provide any analysis and evaluations of the performance of the proposed model. lastly, it is not publicly available anymore. the proposed maddog system could be useful for many downstream applications including definition extraction @xcite @xcite , information extraction @xcite or question answering @xcite 5 system deployment maddog is purely written in python 3 and could be run as a flask @xcite server. for text toknization, it employs spacy 2 @xcite . also, the trained acronym expansion model requires pytorch 1.7 and 64 gb of disk space. note that all acronyms with their long-forms are encoded in the trained model so they can perform both the dictionary look-up operation and the disambiguation task. moreover, the trained models could be loaded both on gpu and cpu. ## conclusion in this work, we propose a new web-based system for acronym identification and disambiguation. for ai, we employ a refined set of rules which is shown to be more effective than the previous rule-based and deep learning models. moreover, using a massive acronym disambiguation dataset with more than 46 million records in various domains, we train a supervised model for acronym disambiguation. the experiments on the existing benchmark datasets reveal the efficacy of the proposed ad model. in future, we aim to prepare the proposed model to be integrated into an e-reader where the readers can quickly hover the acronym and find the correct meaning for that. this system could help save time for reading technical documents that are replete with acronyms.