Miracle-dz/UniFAR-FTUs huggingface dataset:
Restricted or Not: A General Training Framework for Neural Machine Translation

Restricted machine translation incorporates human prior knowledge into translation. It restricts the flexibility of the translation to satisfy the demands of translation in specific scenarios. Existing work typically imposes constraints on beam search decoding. Although this can satisfy the requirements overall, it usually requires a larger beam size and far longer decoding time than unrestricted translation, which limits the concurrent processing ability of the translation model in deployment, and thus its practicality. In this paper, we propose a general training framework that allows a model to simultaneously support both unrestricted and restricted translation by adopting an additional auxiliary training process without constraining the decoding process. This maintains the benefits of restricted translation but greatly reduces the extra time overhead of constrained decoding, thus improving its practicality. The effectiveness of our proposed training framework is demonstrated by experiments on both original (WAT21 En\leftrightarrowJa) and simulated (WMT14 En\rightarrowDe and En\rightarrowFr) restricted translation benchmarks.
SyMCoM - Syntactic Measure of Code Mixing A Study Of English-Hindi Code-Mixing

Code mixing is the linguistic phenomenon where bilingual speakers tend to switch between two or more languages in conversations. Recent work on code-mixing in computational settings has leveraged social media code mixed texts to train NLP models. For capturing the variety of code mixing in, and across corpus, Language ID (LID) tags based measures (CMI) have been proposed. Syntactical variety/patterns of code-mixing and their relationship vis-a-vis computational model’s performance is under explored. In this work, we investigate a collection of English(en)-Hindi(hi) code-mixed datasets from a syntactic lens to propose, SyMCoM, an indicator of syntactic variety in code-mixed text, with intuitive theoretical bounds. We train SoTA en-hi PoS tagger, accuracy of 93.4%, to reliably compute PoS tags on a corpus, and demonstrate the utility of SyMCoM by applying it on various syntactical categories on a collection of datasets, and compare datasets using the measure.
Right for the Right Reason: Evidence Extraction for Trustworthy Tabular Reasoning

When pre-trained contextualized embedding-based models developed for unstructured data are adapted for structured tabular data, they perform admirably. However, recent probing studies show that these models use spurious correlations, and often predict inference labels by focusing on false evidence or ignoring it altogether. To study this issue, we introduce the task of Trustworthy Tabular Reasoning, where a model needs to extract evidence to be used for reasoning, in addition to predicting the label. As a case study, we propose a two-stage sequential prediction approach, which includes an evidence extraction and an inference stage. First, we crowdsource evidence row labels and develop several unsupervised and supervised evidence extraction strategies for InfoTabS, a tabular NLI benchmark. Our evidence extraction strategy outperforms earlier baselines. On the downstream tabular inference task, using only the automatically extracted evidence as the premise, our approach outperforms prior benchmarks.
Improving Romanian BioNER Using a Biologically Inspired System

Recognition of named entities present in text is an important step towards information extraction and natural language understanding. This work presents a named entity recognition system for the Romanian biomedical domain. The system makes use of a new and extended version of SiMoNERo corpus, that is open sourced. Also, the best system is available for direct usage in the RELATE platform.
Cross-lingual Semantic Role Labelling with the ValPaL Database Knowledge

Cross-lingual Transfer Learning typically involves training a model on a high-resource sourcelanguage and applying it to a low-resource tar-get language. In this work we introduce a lexi-cal database calledValency Patterns Leipzig(ValPal)which provides the argument patterninformation about various verb-forms in mul-tiple languages including low-resource langua-ges. We also provide a framework to integratethe ValPal database knowledge into the state-of-the-art LSTM based model for cross-lingualsemantic role labelling. Experimental resultsshow that integrating such knowledge resultedin am improvement in performance of the mo-del on all the target languages on which it isevaluated.
black[LSCDiscovery shared task] 
 CoToHiLi at LSCDiscovery: the Role of Linguistic Features in Predicting Semantic Change

This paper presents the contributions of the CoToHiLi team for the LSCDiscovery shared task on semantic change in the Spanish language. We participated in both tasks (graded discovery and binary change, including sense gain and sense loss) and proposed models based on word embedding distances combined with hand-crafted linguistic features, including polysemy, number of neological synonyms, and relation to cognates in English. We find that models that include linguistically informed features combined using weights assigned manually by experts lead to promising results.
On the Limits of Evaluating Embodied Agent Model Generalization Using Validation Sets

Natural language guided embodied task completion is a challenging problem since it requires understanding natural language instructions, aligning them with egocentric visual observations, and choosing appropriate actions to execute in the environment to produce desired changes. We experiment with augmenting a transformer model for this task with modules that effectively utilize a wider field of view and learn to choose whether the next step requires a navigation or manipulation action. We observed that the proposed modules resulted in improved, and in fact state-of-the-art performance on an unseen validation set of a popular benchmark dataset, ALFRED. However, our best model selected using the unseen validation set underperforms on the unseen test split of ALFRED, indicating that performance on the unseen validation set may not in itself be a sufficient indicator of whether model improvements generalize to unseen test sets. We highlight this result as we believe it may be a wider phenomenon in machine learning tasks but primarily noticeable only in benchmarks that limit evaluations on test splits, and highlights the need to modify benchmark design to better account for variance in model performance.
GNNer: Reducing Overlapping in Span-based NER Using Graph Neural Networks

There are two main paradigms for Named Entity Recognition (NER): sequence labelling and span classification. Sequence labelling aims to assign a label to each word in an input text using, for example, BIO (Begin, Inside and Outside) tagging, while span classification involves enumerating all possible spans in a text and classifying them into their labels. In contrast to sequence labelling, unconstrained span-based methods tend to assign entity labels to overlapping spans, which is generally undesirable, especially for NER tasks without nested entities. Accordingly, we propose GNNer, a framework that uses Graph Neural Networks to enrich the span representation to reduce the number of overlapping spans during prediction. Our approach reduces the number of overlapping spans compared to strong baseline while maintaining competitive metric performance. Code is available at https://github.com/urchade/GNNer.
black[LSCDiscovery shared task] 
 LSCDiscovery: A shared task on semantic change discovery and detection in Spanish

We present the first shared task on semantic change discovery and detection in Spanish. We create the first dataset of Spanish words manually annotated by semantic change using the DURel framewok (Schlechtweg et al., 2018). The task is divided in two phases: 1) graded change discovery, and 2) binary change detection. In addition to introducing a new language for this task, the main novelty with respect to the previous tasks consists in predicting and evaluating changes for all vocabulary words in the corpus. Six teams participated in phase 1 and seven teams in phase 2 of the shared task, and the best system obtained a Spearman rank correlation of 0.735 for phase 1 and an F1 score of 0.735 for phase 2. We describe the systems developed by the competing teams, highlighting the techniques that were particularly useful.
CQG: A Simple and Effective Controlled Generation Framework for Multi-hop Question Generation

Multi-hop question generation focuses on generating complex questions that require reasoning over multiple pieces of information of the input passage. Current models with state-of-the-art performance have been able to generate the correct questions corresponding to the answers. However, most models can not ensure the complexity of generated questions, so they may generate shallow questions that can be answered without multi-hop reasoning. To address this challenge, we propose the CQG, which is a simple and effective controlled framework. CQG employs a simple method to generate the multi-hop questions that contain key entities in multi-hop reasoning chains, which ensure the complexity and quality of the questions. In addition, we introduce a novel controlled Transformer-based decoder to guarantee that key entities appear in the questions. Experiment results show that our model greatly improves performance, which also outperforms the state-of-the-art model about 25% by 5 BLEU points on HotpotQA.
Combine to Describe: Evaluating Compositional Generalization in Image Captioning

Compositionality – the ability to combine simpler concepts to understand & generate arbitrarily more complex conceptual structures – has long been thought to be the cornerstone of human language capacity. With the recent, notable success of neural models in various NLP tasks, attention has now naturally turned to the compositional capacity of these models. In this paper, we study the compositional generalization properties of image captioning models. We perform a set experiments under controlled conditions using model and data ablations, each designed to benchmark a particular facet of compositional generalization: systematicity is the ability of a model to create novel combinations of concepts out of those observed during training, productivity is here operationalised as the capacity of a model to extend its predictions beyond the length distribution it has observed during training, and substitutivity is concerned with the robustness of the model against synonym substitutions. While previous work has focused primarily on systematicity, here we provide a more in-depth analysis of the strengths and weaknesses of state of the art captioning models. Our findings demonstrate that the models we study here do not compositionally generalize in terms of systematicity and productivity, however, they are robust to some degree to synonym substitutions
Probing Multilingual Cognate Prediction Models

Character-based neural machine translation models have become the reference models for cognate prediction, a historical linguistics task. So far, all linguistic interpretations about latent information captured by such models have been based on external analysis (accuracy, raw results, errors). In this paper, we investigate what probing can tell us about both models and previous interpretations, and learn that though our models store linguistic and diachronic information, they do not achieve it in previously assumed ways.
A Graph Enhanced BERT Model for Event Prediction

Predicting the subsequent event for an existing event context is an important but challenging task, as it requires understanding the underlying relationship between events. Previous methods propose to retrieve relational features from event graph to enhance the modeling of event correlation. However, the sparsity of event graph may restrict the acquisition of relevant graph information, and hence influence the model performance. To address this issue, we consider automatically building of event graph using a BERT model. To this end, we incorporate an additional structured variable into BERT to learn to predict the event connections in the training process.Hence, in the test process, the connection relationship for unseen events can be predicted by the structured variable.Results on two event prediction tasks: script event prediction and story ending prediction, show that our approach can outperform state-of-the-art baseline methods.
The NiuTrans’s Submission to the IWSLT22 English-to-Chinese Offline Speech Translation Task

This paper describes NiuTrans’s submission to the IWSLT22 English-to-Chinese (En-Zh) offline speech translation task. The end-to-end and bilingual system is built by constrained English and Chinese data and translates the English speech to Chinese text without intermediate transcription. Our speech translation models are composed of different pre-trained acoustic models and machine translation models by two kinds of adapters. We compared the effect of the standard speech feature (e.g. log Mel-filterbank) and the pre-training speech feature and try to make them interact. The final submission is an ensemble of three potential speech translation models. Our single best and ensemble model achieves 18.66 BLEU and 19.35 BLEU separately on MuST-C En-Zh tst-COMMON set.
Visually Grounded Interpretation of Noun-Noun Compounds in English

Noun-noun compounds (NNCs) occur frequently in the English language. Accurate NNC interpretation, i.e. determining the implicit relationship between the constituents of a NNC, is crucial for the advancement of many natural language processing tasks. Until now, computational NNC interpretation has been limited to approaches involving linguistic representations only. However, much research suggests that grounding linguistic representations in vision or other modalities can increase performance on this and other tasks. Our work is a novel comparison of linguistic and visuo-linguistic representations for the task of NNC interpretation. We frame NNC interpretation as a relation classification task, evaluating on a large, relationally-annotated NNC dataset. We combine distributional word vectors with image vectors to investigate how visual information can help improve NNC interpretation systems. We find that adding visual vectors increases classification performance on our dataset in many cases.
Product Titles-to-Attributes As a Text-to-Text Task

Online marketplaces use attribute-value pairs, such as brand, size, size type, color, etc. to help define important and relevant facts about a listing. These help buyers to curate their search results using attribute filtering and overall create a richer experience. Although their critical importance for listings’ discoverability, getting sellers to input tens of different attribute-value pairs per listing is costly and often results in missing information. This can later translate to the unnecessary removal of relevant listings from the search results when buyers are filtering by attribute values. In this paper we demonstrate using a Text-to-Text hierarchical multi-label ranking model framework to predict the most relevant attributes per listing, along with their expected values, using historic user behavioral data. This solution helps sellers by allowing them to focus on verifying information on attributes that are likely to be used by buyers, and thus, increase the expected recall for their listings. Specifically for eBay’s case we show that using this model can improve the relevancy of the attribute extraction process by 33.2% compared to the current highly-optimized production system. Apart from the empirical contribution, the highly generalized nature of the framework presented in this paper makes it relevant for many high-volume search-driven websites.
Reports of personal experiences and stories in argumentation: datasets and analysis

Reports of personal experiences or stories can play a crucial role in argumentation, as they represent an immediate and (often) relatable way to back up one’s position with respect to a given topic. They are easy to understand and increase empathy: this makes them powerful in argumentation. The impact of personal reports and stories in argumentation has been studied in the Social Sciences, but it is still largely underexplored in NLP. Our work is the first step towards filling this gap: our goal is to develop robust classifiers to identify documents containing personal experiences and reports. The main challenge is the scarcity of annotated data: our solution is to leverage existing annotations to be able to scale-up the analysis. Our contribution is two-fold. First, we conduct a set of in-domain and cross-domain experiments involving three datasets (two from Argument Mining, one from the Social Sciences), modeling architectures, training setups and fine-tuning options tailored to the involved domains. We show that despite the differences among datasets and annotations, robust cross-domain classification is possible. Second, we employ linear regression for performance mining, identifying performance trends both for overall classification performance and individual classifier predictions.
Improving Supervised Drug-Protein Relation Extraction with Distantly Supervised Models

This paper proposes novel drug-protein relation extraction models that indirectly utilize distant supervision data. Concretely, instead of adding distant supervision data to the manually annotated training data, our models incorporate distantly supervised models that are relation extraction models trained with distant supervision data. Distantly supervised learning has been proposed to generate a large amount of pseudo-training data at low cost. However, there is still a problem of low prediction performance due to the inclusion of mislabeled data. Therefore, several methods have been proposed to suppress the effects of noisy cases by utilizing some manually annotated training data. However, their performance is lower than that of supervised learning on manually annotated data because mislabeled data that cannot be fully suppressed becomes noise when training the model. To overcome this issue, our methods indirectly utilize distant supervision data with manually annotated training data. The experimental results on the DrugProt corpus in the BioCreative VII Track 1 showed that our proposed model can consistently improve the supervised models in different settings.
Rift Valley Fever for Host Innate Immunity in Resistance to A New Mouse Model Reveals a Critical Role

Rift Valley fever (RVF) is an arthropod-borne viral disease repeatedly reported in many African countries and, more recently, in Saudi Arabia and Yemen. RVF virus (RVFV) primarily infects domesticated ruminants, resulting in miscarriage in pregnant females and death for newborns and young animals. It also has the ability to infect humans, causing a feverish syndrome, meningoencephalitis, or hemorrhagic fever. The various outcomes of RVFV infection in animals and humans argue for the existence of host genetic determinants controlling the disease. We investigated the susceptibility of inbred mouse strains to infection with the virulent RVFV ZH548 strain. Compared with classical BALB/cByJ mice, wild-derived Mus m. musculus MBT/Pas mice exhibited earlier and greater viremia and died sooner, a result in sharp contrast with their resistance to infection with West Nile virus and inﬂuenza A. Infection of mouse embryonic ﬁbroblasts (MEFs) from MBT/Pas mice with RVFV also resulted in higher viral production. Microarray and quantitative RT-PCR experiments showed that BALB/cByJ MEFs displayed a signiﬁcant activation of the type I IFN pathway. In contrast, MBT/Pas MEFs elicited a delayed and partial type I IFN response to RVFV infection. RNA interference-mediated inhibition of genes that were not induced by RVFV in MBT/Pas MEFs increased viral production in BALB/cByJ MEFs, thus demonstrating their functional importance in limiting viral replication. We conclude that the failure of MBT/Pas murine strain to induce, in due course,
Coupled Simulation of Hydrate-Bearing and Overburden Sedimentary Layers to Study Hydrate Dissociation and Methane Leakage

Methane leakage during natural gas hydrate (NGH) exploitation is one of the important challenges restricting its safe development, which necessitates further investigation. However, only a few experimental studies have been conducted to characterize the relationship between methane (CH4) leakage and NGH exploitation. The CH4 leakage mechanism and controlling factors in the hydrate dissociation process are still unclear. A coupled simulator has been developed to study the CH4 hydrate exploitation and the possible leakage of CH4. The new system overcomes the difficulty of constructing hydrate-free overlying strata and seawater in previous studies and can simulate the in situ natural environment containing hydrate reservoirs, overlying strata and overlying seawater as well. In addition, the simulator integrates the spatial distribution of temperature, pressure and electric resistance in hydrate reservoir systems, and allows for the visual monitoring of the overlying strata and the sampling of overburden gas and liquids. The effectiveness of the coupled simulations was verified through experimental testing. The coupled simulations allowed for the characterization of the CH4 leakage mechanism and can be used to develop safe strategies for NGH exploitation.
Association between Ambient Air Pollution and Emergency Room Visits for Pediatric Respiratory Diseases: The Impact of COVID-19 Pandemic

The level and composition of air pollution have changed during the coronavirus disease 2019 (COVID-19) pandemic. However, the association between air pollution and pediatric respiratory disease emergency department (ED) visits during the COVID-19 pandemic remains unclear. The study was retrospectively conducted between 2017 and 2020 in Kaohsiung, Taiwan, from 1 January 2020 to 1 May 2020, defined as the period of the COVID-19 pandemic, and 1 January 2017 to 31 May 2019, defined as the pre-COVID-19 pandemic period. We enrolled patients under 17 years old who visited the ED in a medical center and were diagnosed with respiratory diseases such as pneumonia, asthma, bronchitis, and acute pharyngitis. Measurements of particulate matter (PM) with aerodynamic diameters of <10 μm (PM10) and < 2.5 μm (PM2.5), nitrogen dioxide (NO2), and Ozone (O3) were collected. During the COVID-19 pandemic, an increase in the interquartile range of PM2.5, PM10, and NO2 levels was associated with increases of 72.5% (95% confidence interval [CI], 50.5–97.7%), 98.0% (95% CI, 70.7–129.6%), and 54.7% (95% CI, 38.7–72.6%), respectively, in the risk of pediatric respiratory disease ED visits on lag 1, which were greater than those in the pre-COVID-19 pandemic period. After adjusting for temperature and humidity, the risk of pediatric respiratory diseases after exposure to PM2.5 (inter p = 0.001) and PM10 (inter p < 0.001) was higher during the COVID-19 pandemic. PM2.5, PM10, and NO2 may play important roles in pediatric respiratory events in Kaohsiung, Taiwan. Compared with the pre-COVID-19 pandemic period, the levels of PM2.5 and PM10 were lower; however, the levels were related to a greater increase in ED during the COVID-19 pandemic.