Miracle-dz/UniFAR-FTUs huggingface dataset:
A Multi-Strategy Approach to Crossword Clue Answer Retrieval and Ranking

English. Crossword clues represent an extremely challenging form of Question Answering, due to their intentional ambiguity. Databases of previously answered clues are a vital source for the retrieval of candidate answers lists in Automatic Crossword Puzzles (CPs) resolution systems. In this paper, we exploit language neural representations for the retrieval and ranking of crossword clues and answers. We assess the performances of several embedding models, both static and contextual, on Italian and English CPs. Results indicate that embeddings usually outperform the baseline. Moreover, the use of embeddings for retrieval allows different ranking strategies, which turned out to be complementary, and lead to better results when used in combination. Italiano. Le domande dei cruciverba rappresentano una forma di Question Answering particolarmente complessa a causa della loro intenzionale ambiguità. I risolutori automatici di cruciverba sfruttano ampiamente basi di dati di domande precedentemente risposte. In questo articolo proponiamo l’uso di embeddings per la ricerca semantica di domande-risposte da tali databases. Le performances sono valutate in cruciverba di lingua sia italiana che inglese, confrontando diversi tipi di embeddings, sia contestuali che statici. I risultati suggeriscono che la ricerca semantica è migliore della baseline. Inoltre, l’utilizzo di embeddings permette di applicare differenti strategie di retrieval, che, Copyright © 2021 for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). migliorano la qualità dei risultati quando usate congiuntamente.
On the Development of Customized Neural Machine Translation Models

Recent advances in neural modeling boosted performance of many machine learning applications. Training neural networks requires large amounts of clean data, which are rarely available; many methods have been designed and investigated by researchers to tackle this issue. As a partner of a project, we were asked to build translation engines for the weather forecast domain, relying on few, noisy data. Step by step, we developed neural translation models, which outperform by far Google Translate. This paper details our approach, that - we think - is paradigmatic for a broader category of applications of machine learning, and as such could be of widespread utility.
Extracting Relations from Italian Wikipedia using Self-Training

In this paper, we describe a supervised approach for extracting relations from Wikipedia. In particular, we exploit a self-training strategy for enriching a small number of manually labeled triples with new self-labeled examples. We integrate the supervised stage in WikiOIE, an existing framework for unsupervised extraction of relations from Wikipedia. We rely on WikiOIE and its unsupervised pipeline for extracting the initial set of unlabelled triples. An evaluation involving different algorithms and parameters proves that self-training helps to improve performance. Finally, we provide a dataset of about three million triples extracted from the Italian version of Wikipedia and perform a preliminary evaluation conducted on a sample dataset, obtaining promising results.
Detecting Age-Related Linguistic Patterns in Dialogue: Toward Adaptive Conversational Systems

This work explores an important dimen-sion of variation in the language used by dialogue participants: their age. While previous work showed differences at various linguistic levels between age groups when experimenting with written discourse data (e.g., blog posts), previous work on dialogue has largely been limited to acoustic information related to voice and prosody. Detecting ﬁne-grained linguistic properties of human dialogues is of crucial importance for developing AI-based conversational systems which are able to adapt to their human interlocutors. We therefore investigate whether, and to what extent, current text-based NLP models can detect such linguistic differences, and what the features driving their predictions are. We show that models achieve a fairly good performance on age-group prediction, though the task appears to be more challenging compared to discourse. Through in-depth analysis of the best models’ errors and the most predictive cues, we show that, in dialogue, differences among age groups mostly concern stylistic and lexical choices. We believe these ﬁndings can inform future work on developing controlled generation models for adaptive conversational systems.
The Attenuating Effect of Low-Intensity Pulsed Ultrasound on Hypoxia-Induced Rat Chondrocyte Damage in TMJ Osteoarthritis Based on TMT Labeling Quantitative Proteomic Analysis

Temporomandibular joint osteoarthritis (TMJOA) is a degenerative disease with a complex and multifactorial etiology. An increased intrajoint pressure or weakened penetration can exacerbate the hypoxic state of the condylar cartilage microenvironment. Our group previously simulated the hypoxic environment of TMJOA in vitro. Low-intensity pulsed ultrasound (LIPUS) stimulation attenuates chondrocyte matrix degradation via a hypoxia-inducible factor (HIF) pathway-associated mechanism, but the mode of action of LIPUS is currently poorly understood. Moreover, most recent studies investigated the pathological mechanisms of osteoarthritis, but no biomarkers have been established for assessing the therapeutic effect of LIPUS on TMJOA with high specificity, which results in a lack of guidance regarding clinical application. Here, tandem mass tag (TMT)-based quantitative proteomic technology was used to comprehensively screen the molecular targets and pathways affected by the action of LIPUS on chondrocytes under hypoxic conditions. A bioinformatic analysis identified 902 and 131 differentially expressed proteins (DEPs) in the <1% oxygen treatment group compared with the control group and in the <1% oxygen + LIPUS stimulation group compared with the <1% oxygen treatment group, respectively. The DEPs were analyzed by gene ontology (GO), KEGG pathway and protein-protein interaction (PPI) network analyses. By acting on extracellular matrix (ECM)-associated proteins, LIPUS increases energy production and activates the FAK signaling pathway to regulate cell biological behaviors. DEPs of interest were selected to verify the reliability of the proteomic results. In addition, this experiment demonstrated that LIPUS could upregulate chondrogenic factors (such as Sox9, Collagen Ⅱ and Aggrecan) and increase the mucin sulfate content. Moreover, LIPUS reduced the hydrolytic degradation of the ECM by decreasing the MMP3/TIMP1 ratio and vascularization by downregulating VEGF. Interestingly, LIPUS improved the migration ability of chondrocytes. In summary, LIPUS can regulate complex biological processes in chondrocytes under hypoxic conditions and alter the expression of many functional proteins, which results in reductions in hypoxia-induced chondrocyte damage. ECM proteins such as thrombospondin4, thrombospondin1, IL1RL1, and tissue inhibitors of metalloproteinase 1 play a central role and can be used as specific biomarkers determining the efficacy of LIPUS and viable clinical therapeutic targets of TMJOA.
Molecular Identity and Location Influence Purkinje Cell Vulnerability in Autosomal-Recessive Spastic Ataxia of Charlevoix-Saguenay Mice

Patterned cell death is a common feature of many neurodegenerative diseases. In patients with autosomal-recessive spastic ataxia of Charlevoix-Saguenay (ARSACS) and mouse models of ARSACS, it has been observed that Purkinje cells in anterior cerebellar vermis are vulnerable to degeneration while those in posterior vermis are resilient. Purkinje cells are known to express certain molecules in a highly stereotyped, patterned manner across the cerebellum. One patterned molecule is zebrin, which is expressed in distinctive stripes across the cerebellar cortex. The different zones delineated by the expression pattern of zebrin and other patterned molecules have been implicated in the patterning of Purkinje cell death, raising the question of whether they contribute to cell death in ARSACS. We found that zebrin patterning appears normal prior to disease onset in Sacs–/– mice, suggesting that zebrin-positive and -negative Purkinje cell zones develop normally. We next observed that zebrin-negative Purkinje cells in anterior lobule III were preferentially susceptible to cell death, while anterior zebrin-positive cells and posterior zebrin-negative and -positive cells remained resilient even at late disease stages. The patterning of Purkinje cell innervation to the target neurons in the cerebellar nuclei (CN) showed a similar pattern of loss: neurons in the anterior CN, where inputs are predominantly zebrin-negative, displayed a loss of Purkinje cell innervation. In contrast, neurons in the posterior CN, which is innervated by both zebrin-negative and -positive puncta, had normal innervation. These results suggest that the location and the molecular identity of Purkinje cells determine their susceptibility to cell death in ARSACS.
Pre- and Postnatal Predator Cues Shape Offspring Anti-predatory Behavior Similarly in the Bank Vole

Prey animals can assess the risks predators present in different ways. For example, direct cues produced by predators can be used, but also signals produced by prey conspecifics that have engaged in non-lethal predator-prey interactions. These non-lethal interactions can thereby affect the physiology, behavior, and survival of prey individuals, and may affect offspring performance through maternal effects. We investigated how timing of exposure to predation-related cues during early development affects offspring behavior after weaning. Females in the laboratory were exposed during pregnancy or lactation to one of three odor treatments: (1) predator odor (PO) originating from their most common predator, the least weasel, (2) odor produced by predator-exposed conspecifics, which we call conspecific alarm cue (CAC), or (3) control odor (C). We monitored postnatal pup growth, and we quantified foraging and exploratory behaviors of 4-week-old pups following exposure of their mothers to each of the three odour treatments. Exposure to odors associated with predation risk during development affected the offspring behavior, but the timing of exposure, i.e., pre- vs. postnatally, had only a weak effect. The two non-control odors led to different behavioral changes: an attraction to CAC and an avoidance of PO. Additionally, pup growth was affected by an interaction between litter size and maternal treatment, again regardless of timing. Pups from the CAC maternal treatment grew faster in larger litters; pups from the PO maternal treatment tended to grow faster in smaller litters. Thus, in rodents, offspring growth and behavior are seemingly influenced differently by the type of predation risk perceived by their mothers.
Choosing the Right Life Partner: Ecological Drivers of Lichen Symbiosis

Lichens are an iconic example of symbiotic systems whose ecology is shaped by the requirements of the symbionts. Previous studies suggest that fungal (mycobionts) as well as photosynthesizing (phycobionts or cyanobionts) partners have a specific range of acceptable symbionts that can be chosen according to specific environmental conditions. This study aimed to investigate the effects of climatic conditions and mycobiont identity on phycobiont distribution within the lichen genera Stereocaulon, Cladonia, and Lepraria. The study area comprised the Canary Islands, Madeira, Sicily, and the Aeolian Islands, spanning a wide range of climatic conditions. These islands are known for their unique and diverse fauna and flora; however, lichen phycobionts have remained unstudied in most of these areas. In total, we genetically analyzed 339 lichen samples. The phycobiont pool differed significantly from that outside the studied area. Asterochloris mediterranea was identified as the most abundant phycobiont. However, its distribution was limited by climatic constraints. Other species of Asterochloris and representatives of the genera Chloroidium, Vulcanochloris, and Myrmecia were also recovered as phycobionts. The selection of symbiotic partners from the local phycobiont pool was driven by mycobiont specificity (i.e., the taxonomic range of acceptable partners) and the environmental conditions, mainly temperature. Interestingly, the dominant fungal species responded differently in their selection of algal symbionts along the environmental gradients. Cladonia rangiformis associated with its phycobiont A. mediterranea in a broader range of temperatures than Stereocaulon azoreum, which favors other Asterochloris species along most of the temperature gradient. Stereocaulon vesuvianum associated with Chloroidium spp. , which also differed in their temperature optima. Finally, we described Stereocaulon canariense as a new endemic species ecologically distinct from the other Stereocaulon species on the Canary Islands.
An External-Validated Algorithm to Predict Postoperative Pneumonia Among Elderly Patients With Lung Cancer After Video-Assisted Thoracoscopic Surgery

The aim of the study was to develop an algorithm to predict postoperative pneumonia among elderly patients with lung cancer after video-assisted thoracoscopic surgery. We analyzed 3,009 patients from the Thoracic Perioperative Database for Geriatrics in our hospital and finally enrolled 1,585 elderly patients (age≧65 years) with lung cancer treated with video-assisted thoracoscopic surgery. The included patients were randomly divided into a training group (n = 793) and a validation group (n = 792). Patients in the training group were used to develop the algorithm after screening up to 30 potential risk factors, and patients in the validation group were used to internally validate the algorithm. External validation of the algorithm was achieved in the external validation dataset after enrolling 165 elderly patients with lung cancer treated with video-assisted thoracoscopic surgery from two hospitals in China. Of all included patients, 9.15% (145/1,585) of patients suffered from postoperative pneumonia in the Thoracic Perioperative Database for Geriatrics, and 10.30% (17/165) of patients had postoperative pneumonia in the external validation dataset. The algorithm consisted of seven variables, including sex, smoking, history of chronic obstructive pulmonary disease (COPD), surgery duration, leukocyte count, intraoperative injection of colloid, and intraoperative injection of hormone. The C-index from the receiver operating characteristic curve (AUROC) was 0.70 in the training group, 0.67 in the internal validation group, and 0.71 in the external validation dataset, and the corresponding calibration slopes were 0.88 (95% confident interval [CI]: 0.37–1.39), 0.90 (95% CI: 0.46–1.34), and 1.03 (95% CI: 0.24–1.83), respectively. The actual probabilities of postoperative pneumonia were 5.14% (53/1031) in the low-risk group, 15.07% (71/471) in the medium-risk group, and 25.30% (21/83) in the high-risk group (p < 0.001). The algorithm can be a useful prognostic tool to predict the risk of developing postoperative pneumonia among elderly patients with lung cancer after video-assisted thoracoscopic surgery.
Altered Cortisol Metabolism Increases Nocturnal Cortisol Bioavailability in Prepubertal Children With Type 1 Diabetes Mellitus

Objective Disturbances in the activity of the hypothalamus-pituitary-adrenal axis could lead to functional alterations in the brain of diabetes patients. In a later perspective of investigating the link between the activity of the hypothalamus-pituitary-adrenal axis and the developing brain in children with diabetes, we assessed here nocturnal cortisol metabolism in prepubertal children with type 1 diabetes mellitus (T1DM). Methods Prepubertal patients (aged 6–12 years) diagnosed with T1DM at least 1 year previously were recruited, along with matched controls. Nocturnal urine samples were collected, with saliva samples taken at awakening and 30 minutes after awakening. All samples were collected at home over 5 consecutive days with no detectable nocturnal hypoglycaemia. The State-Trait Anxiety Inventory (trait scale only) and Child Depression Inventory were also completed. Glucocorticoid metabolites in the urine, salivary cortisol (sF) and cortisone (sE) were measured by liquid chromatography–tandem mass spectrometry. Metabolic data were analysed by logistic regression, adjusting for sex, age, BMI and trait anxiety score. Results Urine glucocorticoid metabolites were significantly lower in T1DM patients compared to controls. 11β-hydroxysteroid dehydrogenase type 1 activity was significantly higher, while 11β-hydroxysteroid dehydrogenase type 2, 5(α+β)-reductase and 5α-reductase levels were all lower, in T1DM patients compared to controls. There was a significant group difference in delta sE level but not in delta sF level between the time of awakening and 30 minutes thereafter. Conclusions Our findings suggest that altered nocturnal cortisol metabolism and morning HPA axis hyperactivity in children with T1DM leads to greater cortisol bioavailability and lower cortisol production as a compensatory effect. This altered nocturnal glucocorticoid metabolism when cortisol production is physiologically reduced and this HPA axis hyperactivity question their impact on brain functioning.
Theoretical Insight Into Diamond Doping and Its Possible Effect on Diamond Tool Wear During Cutting of Steel

Natural diamond tools experience wear during cutting of steel. As reported in our previous work, Ga doping of diamond has an effect on suppressing graphitization of diamond which is a major route of wear. We investigate interstitial and substitutional dopants of different valence and different ionic radii (Ga, B, and He) to achieve a deeper understanding of inhibiting graphitization. In this study, ab initio calculations are used to explore the effects of three dopants that might affect the diamond wear. We consider mechanical effects via possible solution strengthening and electronic effects via dopant-induced modifications of the electronic structure. We find that the bulk modulus difference between pristine and doped diamond is clearly related to strain energies. Furthermore, boron doping makes the resulting graphite with stable sp2 hybridization more perfect than diamond, but Ga-doped diamond needs 2.49 eV to form the two graphene-like layers than only one layer, which would result in the suppressed graphitization and reduced chemical wear of the diamond tool.
A Link Between Methylglyoxal and Heart Failure During HIV-1 Infection

Early-onset heart failure (HF) continues to be a major cause of morbidity and mortality in people living with human immunodeficiency virus type one (HIV-1) infection (PLWH), yet the molecular causes for this remain poorly understood. Herein NOD.Cg-PrkdcscidIl2rgtm1Wjl/SzJ humanized mice (Hu-mice), plasma from PLWH, and autopsied cardiac tissues from deceased HIV seropositive individuals were used to assess if there is a link between the glycolysis byproduct methylglyoxal (MG) and HF in the setting of HIV-1 infection. At five weeks post HIV infection, Hu-mice developed grade III-IV diastolic dysfunction (DD) with an associated two-fold increase in plasma MG. At sixteen-seventeen weeks post infection, cardiac ejection fraction and fractional shortening also declined by 26 and 35%, and plasma MG increased to four-fold higher than uninfected controls. Histopathological and biochemical analyses of cardiac tissues from Hu-mice 17 weeks post-infection affirmed MG increase with a concomitant decrease in expression of the MG-degrading enzyme glyoxalase-1 (Glo1). The endothelial cell marker CD31 was found to be lower, and coronary microvascular leakage and myocardial fibrosis were prominent. Increasing expression of Glo1 in Hu-mice five weeks post-infection using a single dose of an engineered AAV2/9 (1.7 × 1012 virion particles/kg), attenuated the increases in plasma and cardiac MG levels. Increasing Glo1 also blunted microvascular leakage, fibrosis, and HF seen at sixteen weeks post-infection, without changes in plasma viral loads. In plasma from virally suppressed PLWH, MG was also 3.7-fold higher. In autopsied cardiac tissues from seropositive, HIV individuals with low viral log, MG was 4.2-fold higher and Glo1 was 50% lower compared to uninfected controls. These data show for the first time a causal link between accumulation of MG and HF in the setting of HIV infection.
A Methodological Framework to Capture Neuromuscular Fatigue Mechanisms Under Stress

Neuromuscular fatigue is exacerbated under stress and is characterized by shorter endurance time, greater perceived effort, lower force steadiness, and higher electromyographic activity. However, the underlying mechanisms of fatigue under stress are not well-understood. This review investigated existing methods of identifying central mechanisms of neuromuscular fatigue and the potential mechanisms of the influence of stress on neuromuscular fatigue. We found that the influence of stress on the activity of the prefrontal cortex, which are also involved in exercise regulation, may contribute to exacerbated fatigue under stress. We also found that the traditional methods involve the synchronized use of transcranial magnetic stimulation, peripheral nerve stimulation, and electromyography to identify the contribution of supraspinal fatigue, through measures such as voluntary activation, motor evoked potential, and silent period. However, these popular techniques are unable to provide information about neural alterations upstream of the descending drive that may contribute to supraspinal fatigue development. To address this gap, we propose that functional brain imaging techniques, which provide insights on activation and information flow between brain regions, need to be combined with the traditional measures of measuring central fatigue to fully understand the mechanisms behind the influence of stress on fatigue.
The Behavioral Inhibition System/Behavioral Activation System Scales: Measurement Invariance Across Gender in Chinese University Students

Objectives: To identify the optimal factor structure of the behavioral inhibition system/behavioral activation system (BIS/BAS) scales and to examine measurement invariance (MI) of the scales across gender among a sample of Chinese undergraduate students. Methods: Convenience sampling was employed to recruit 1,085 subjects. Participants completed the Chinese version of the BIS/BAS scales. A confirmatory factor analysis (CFA) of competing models was conducted to determine the optimal factor model, followed by a test of MI across gender based on the optimal model. Results: A single-group CFA indicated that the modified four-factor structure fits best in the total sample. Multiple-group CFAs demonstrated that configural invariance, weak invariance, strong invariance, and strict invariance models of the four-factor structure of the BIS/BAS scales were all acceptable. Conclusion: The four-factor structure of the Chinese version of the BIS/BAS scales possesses MI across gender.