Reviewerly/exHarmony huggingface dataset:
Attributes-Guided and Pure-Visual Attention Alignment for Few-Shot Recognition

The purpose of few-shot recognition is to recognize novel categories with a limited number of labeled examples in each class. To encourage learning from a supplementary view, recent approaches have introduced auxiliary semantic modalities into effective metric-learning frameworks that aim to learn a feature similarity between training samples (support set) and test samples (query set). However, these approaches only augment the representations of samples with available semantics while ignoring the query set, which loses the potential for the improvement and may lead to a shift between the modalities combination and the pure-visual representation. In this paper, we devise an attributes-guided attention module (AGAM) to utilize human-annotated attributes and learn more discriminative features. This plug-and-play module enables visual contents and corresponding attributes to collectively focus on important channels and regions for the support set. And the feature selection is also achieved for query set with only visual information while the attributes are not available. Therefore, representations from both sets are improved in a fine-grained manner. Moreover, an attention alignment mechanism is proposed to distill knowledge from the guidance of attributes to the pure-visual branch for samples without attributes. Extensive experiments and analysis show that our proposed module can significantly improve simple metric-based approaches to achieve state-of-the-art performance on different datasets and settings.
Utilizing imbalanced electronic health records to predict acute kidney injury by ensemble learning and time series model

Abstract Background Acute Kidney Injury (AKI) is a shared complication among Intensive Care Unit (ICU), marked by high cost, high morbidity and high mortality. As the early prediction of AKI is critical for patients’ outcomes and data mining is such a powerful prediction tool, many AKI prediction models based on machine learning methods have been proposed. Our motivation is inspired by the fact that the incidence of AKI is a changing temporal sequence affected by the joint action of patients’ daily drug combinations and their physiological indexes. However, most existing models have not considered such a temporal correlation. Besides, due to great challenges caused by sparse, high-dimensional and highly imbalanced clinical data, it is hard to achieve ideal performance. Methods We develop a fast, simple and less-costly model based on an ensemble learning algorithm, named Ensemble Time Series Model (ETSM). Besides benefiting from vital signs and laboratory results as explicit indicators, ETSM explores the effect of drug combinations as possible implicit indicators for the AKI prediction. The model transforms temporal medication information into a multidimensional vector to consider and measure drug cumulative effects that may cause AKI. Results We compare ETSM with state-of-the-art models on ICUC and MIMIC III datasets. On the basis of the experimental results, our model obtains satisfactory performance (ICUC: AUC 24 hours ahead: 0.81, 48 hours ahead: 0.78; MIMIC III: AUC 24 hours ahead: 0.95, 48 hours ahead: 0.95). Meanwhile, we compare the effects of different sampling and feature generation methods on the model performance. In the ablation study, we validate that medication information improves model performance (24 hours ahead: AUC increased from 0.74 to 0.81). We also find that the model’s performance is closely related to the balanced level of the derivation dataset. The optimal ratio of major class size to minor class size for the model is found for AKI prediction. Conclusions ETSM is an effective method for the early prediction of AKI. The model verifies that AKI incidence is related to the clinical medication. In comparison with other prediction methods, ETSM provides comparable performance results and better interpretability.
Construction of Chinese Smart Water Conservancy Platform Based on the Blockchain: Technology Integration and Innovation Application

Blockchain technology has triggered a new round of technological innovation and industrial change. Promoting the deep integration of blockchain technology and smart water conservancy has become an essential part of the digital transformation of the Chinese smart water conservancy industry. On the basis of the analysis of the framework of the smart water conservancy system and the technology infrastructure model of the blockchain, a conceptual model of a smart water conservancy information sharing platform is established. The platform has four-in-one and multicentralized participants including government departments, water conservancy enterprises, the public, and third-party maintenance, and the design of “alliance chain + private chain” dual chain smart contract. Moreover, the multidimensional scenarios of smart water conservancy innovation applications incorporating blockchain platform technology are addressed. Then, the water rights trading market is taken as an example to propose an innovative development path with consensus mechanisms, smart contracts, asymmetric encryption, and information source tracing. Although there may be some questions and challenges related to smart water conservancy and blockchain technology, this paper can provide a reference for the sustainable development of the smart water conservancy industry due to its fundamental societal contributions.
Semantic Mask for Transformer Based End-to-End Speech Recognition

Attention-based encoder-decoder model has achieved impressive results for both automatic speech recognition (ASR) and text-to-speech (TTS) tasks. This approach takes advantage of the memorization capacity of neural networks to learn the mapping from the input sequence to the output sequence from scratch, without the assumption of prior knowledge such as the alignments. However, this model is prone to overfitting, especially when the amount of training data is limited. Inspired by SpecAugment and BERT, in this paper, we propose a semantic mask based regularization for training such kind of end-to-end (E2E) model. The idea is to mask the input features corresponding to a particular output token, e.g., a word or a word-piece, in order to encourage the model to fill the token based on the contextual information. While this approach is applicable to the encoder-decoder framework with any type of neural network architecture, we study the transformer-based model for ASR in this work. We perform experiments on Librispeech 960h and TedLium2 data sets, and achieve the state-of-the-art performance in the scope of attention based E2E models.
New Checkable Conditions for Moment Determinacy of Probability Distributions

We have analyzed some conditions which are essentially involved in deciding whether or not a probability distribution is unique (moment-determinate) or nonunique (moment-indeterminate) by its moments. We suggest new conditions concerning both absolutely continuous and discrete distributions. By using the new conditions, which are easily checkable, we either establish new results or extend previous ones in both the Hamburger case (distributions on the whole real line) and the Stieltjes case (distributions on the positive half-line). Specific examples illustrate the results as well as the relationship between the new conditions and previously available conditions.
Elastic parameter server load distribution in deep learning clusters

In distributed DNN training, parameter servers (PS) can become performance bottlenecks due to PS stragglers, caused by imbalanced parameter distribution, bandwidth contention, or computation interference. Few existing studies have investigated efficient parameter (aka load) distribution among PSs. We observe significant training inefficiency with the current parameter assignment in representative machine learning frameworks (e.g., MXNet, TensorFlow), and big potential for training acceleration with better PS load distribution. We design PSLD, a dynamic parameter server load distribution scheme, to mitigate PS straggler issues and accelerate distributed model training in the PS architecture. An exploitation-exploration method is carefully designed to scale in and out parameter servers and adjust parameter distribution among PSs on the go. We also design an elastic PS scaling module to carry out our scheme with little interruption to the training process. We implement our module on top of open-source PS architectures, including MXNet and BytePS. Testbed experiments show up to 2.86x speed-up in model training with PSLD, for different ML models under various straggler settings.
Evaluating the Calibration of Knowledge Graph Embeddings for Trustworthy Link Prediction

Little is known about the trustworthiness of predictions made by knowledge graph embedding (KGE) models. In this paper we take initial steps toward this direction by investigating the calibration of KGE models, or the extent to which they output confidence scores that reflect the expected correctness of predicted knowledge graph triples. We first conduct an evaluation under the standard closed-world assumption (CWA), in which predicted triples not already in the knowledge graph are considered false, and show that existing calibration techniques are effective for KGE under this common but narrow assumption. Next, we introduce the more realistic but challenging open-world assumption (OWA), in which unobserved predictions are not considered true or false until ground-truth labels are obtained. Here, we show that existing calibration techniques are much less effective under the OWA than the CWA, and provide explanations for this discrepancy. Finally, to motivate the utility of calibration for KGE from a practitioner’s perspective, we conduct a unique case study of human-AI collaboration, showing that calibrated predictions can improve human performance in a knowledge graph completion task.
Fast Generation of Chance-Constrained Flight Trajectory for Unmanned Vehicles

In this article, a fast chance-constrained trajectory generation strategy incorporating convex optimization and convex approximation of chance constraints is designed so as to solve the unmanned vehicle path planning problem. A path-length-optimal unmanned vehicle trajectory optimization model is constructed with the consideration of the pitch angle constraint, the curvature radius constraint, the probabilistic control actuation constraint, and the probabilistic collision avoidance constraint. Subsequently, convexification technique is introduced to convert the nonlinear problem formulation into a convex form. To deal with the probabilistic constraints in the optimization model, convex approximation techniques are introduced such that the probabilistic constraints are replaced by deterministic ones while simultaneously preserving the convexity of the optimization model. Numerical results, obtained from a number of case studies, validate the effectiveness and reliability of the proposed approach. A number of comparative studies were also performed. The results confirm that the proposed design is able to produce more optimal flight paths and achieve enhanced computational performance than other chance-constrained optimization approaches investigated in this article.
The Demonization of Islam through Social Media: A Case Study of #Stopislam in Instagram

This article studies the process of demonization, its consequences, and how social media contribute to the formalization of its axiology. The demonization of societies aims to create social subjects that fit into the idea of the “other” by exposing them to compulsory invisibility. This research’s main objective was to examine how demonization is used as a weapon of oppression to devalue specific individuals through the hashtag #StopIslam and Instagram’s role in this process. The methodology used for this purpose has consisted of an empirical and quantitative analysis of the most recent (1 January 2020–31 July 2020) posts on Instagram with #StopIslam, analyzing the images and the content. The study has determined how, through social media manipulation, erroneous ideas are transmitted that prevent the Islamic collective’s integration, especially in European countries. The conclusions will reflect hate speech and how the Islamic world’s demonization results in the Muslim community’s stigmatization, racism, and Islamophobia. Although there are different articles related to demonization and hate speech, there are not many scientific resources that explain these variables on Instagram and how it affects the inclusion of the Muslim community in Europe, significantly when the time spent on the Internet is growing.
Clinical Temporal Relation Extraction with Probabilistic Soft Logic Regularization and Global Inference

There has been a steady need in the medical community to precisely extract the temporal relations between clinical events. In particular, temporal information can facilitate a variety of downstream applications such as case report retrieval and medical question answering. Existing methods either require expensive feature engineering or are incapable of modeling the global relational dependencies among the events. In this paper, we propose a novel method, Clinical Temporal ReLation Exaction with Probabilistic Soft Logic Regularization and Global Inference (CTRL-PG) to tackle the problem at the document level. Extensive experiments on two benchmark datasets, I2B2-2012 and TB-Dense, demonstrate that CTRL-PG significantly outperforms baseline methods for temporal relation extraction.
Reservoir computing quality: connectivity and topology

Abstract We explore the effect of connectivity and topology on the dynamical behaviour of Reservoir Computers. At present, considerable effort is taken to design and hand-craft physical reservoir computers. Both structure and physical complexity are often pivotal to task performance, however, assessing their overall importance is challenging. Using a recently developed framework, we evaluate and compare the dynamical freedom (referring to quality) of neural network structures, as an analogy for physical systems. The results quantify how structure affects the behavioural range of networks. It demonstrates how high quality reached by more complex structures is often also achievable in simpler structures with greater network size. Alternatively, quality is often improved in smaller networks by adding greater connection complexity. This work demonstrates the benefits of using dynamical behaviour to assess the quality of computing substrates, rather than evaluation through benchmark tasks that often provide a narrow and biased insight into the computing quality of physical systems.
ALT at SemEval-2020 Task 12: Arabic and English Offensive Language Identification in Social Media

This paper describes the systems submitted by the Arabic Language Technology group (ALT) at SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media.We focus on sub-task A (Offensive Language Identification) for two languages: Arabic and English.Our efforts for both languages achieved more than 90% macro-averaged F1-score on the official test set.For Arabic, the best results were obtained by a system combination of Support Vector Machine, Deep Neural Network, and fine-tuned Bidirectional Encoder Representations from Transformers (BERT).For English, the best results were obtained by fine-tuning BERT.
Specification and Automated Analysis of Inter-Parameter Dependencies in Web APIs

Web services often impose inter-parameter dependencies that restrict the way in which two or more input parameters can be combined to form valid calls to the service. Unfortunately, current specification languages for web services like the OpenAPI Specification (OAS) provide no support for the formal description of such dependencies, which makes it hardly possible to automatically discover and interact with services without human intervention. In this article, we present an approach for the specification and automated analysis of inter-parameter dependencies in web APIs. We first present a domain-specific language, called <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Inter-parameter Dependency Language</i> (IDL), for the specification of dependencies among input parameters in web services. Then, we propose a mapping to translate an IDL document into a constraint satisfaction problem (CSP), enabling the automated analysis of IDL specifications using standard CSP-based reasoning operations. Specifically, we present a catalogue of seven analysis operations on IDL documents allowing to compute, for example, whether a given request satisfies all the dependencies of the service. Finally, we present a tool suite including an editor, a parser, an OAS extension, a constraint programming-aided library, and a test suite supporting IDL specifications and their analyses. Together, these contributions pave the way for a new range of specification-driven applications in areas such as code generation and testing.
Deep-Learning Based Label-Free Classification of Activated and Inactivated Neutrophils for Rapid Immune State Monitoring

The differential count of white blood cells (WBCs) is one widely used approach to assess the status of a patient's immune system. Currently, the main methods of differential WBC counting are manual counting and automatic instrument analysis with labeling preprocessing. But these two methods are complicated to operate and may interfere with the physiological states of cells. Therefore, we propose a deep learning-based method to perform label-free classification of three types of WBCs based on their morphologies to judge the activated or inactivated neutrophils. Over 90% accuracy was finally achieved by a pre-trained fine-tuning Resnet-50 network. This deep learning-based method for label-free WBC classification can tackle the problem of complex instrumental operation and interference of fluorescent labeling to the physiological states of the cells, which is promising for future point-of-care applications.
Deep Attention-Based Imbalanced Image Classification

Class imbalance is a common problem in real-world image classification problems, some classes are with abundant data, and the other classes are not. In this case, the representations of classifiers are likely to be biased toward the majority classes and it is challenging to learn proper features, leading to unpromising performance. To eliminate this biased feature representation, many algorithm-level methods learn to pay more attention to the minority classes explicitly according to the prior knowledge of the data distribution. In this article, an attention-based approach called deep attention-based imbalanced image classification (DAIIC) is proposed to automatically pay more attention to the minority classes in a data-driven manner. In the proposed method, an attention network and a novel attention augmented logistic regression function are employed to encapsulate as many features, which belongs to the minority classes, as possible into the discriminative feature learning process by assigning the attention for different classes jointly in both the prediction and feature spaces. With the proposed object function, DAIIC can automatically learn the misclassification costs for different classes. Then, the learned misclassification costs can be used to guide the training process to learn more discriminative features using the designed attention networks. Furthermore, the proposed method is applicable to various types of networks and data sets. Experimental results on both single-label and multilabel imbalanced image classification data sets show that the proposed method has good generalizability and outperforms several state-of-the-art methods for imbalanced image classification.
Rethinking Embedding Coupling in Pre-trained Language Models

We re-evaluate the standard practice of sharing weights between input and output embeddings in state-of-the-art pre-trained language models. We show that decoupled embeddings provide increased modeling flexibility, allowing us to significantly improve the efficiency of parameter allocation in the input embedding of multilingual models. By reallocating the input embedding parameters in the Transformer layers, we achieve dramatically better performance on standard natural language understanding tasks with the same number of parameters during fine-tuning. We also show that allocating additional capacity to the output embedding provides benefits to the model that persist through the fine-tuning stage even though the output embedding is discarded after pre-training. Our analysis shows that larger output embeddings prevent the model's last layers from overspecializing to the pre-training task and encourage Transformer representations to be more general and more transferable to other tasks and languages. Harnessing these findings, we are able to train models that achieve strong performance on the XTREME benchmark without increasing the number of parameters at the fine-tuning stage.
GenDet: Meta Learning to Generate Detectors From Few Shots

Object detection has made enormous progress and has been widely used in many applications. However, it performs poorly when only limited training data is available for novel classes that the model has never seen before. Most existing approaches solve few-shot detection tasks implicitly without directly modeling the detectors for novel classes. In this article, we propose GenDet, a new meta-learning-based framework that can effectively generate object detectors for novel classes from few shots and, thus, conducts few-shot detection tasks explicitly. The detector generator is trained by numerous few-shot detection tasks sampled from base classes each with sufficient samples, and thus, it is expected to generalize well on novel classes. An adaptive pooling module is further introduced to suppress distracting samples and aggregate the detectors generated from multiple shots. Moreover, we propose to train a reference detector for each base class in the conventional way, with which to guide the training of the detector generator. The reference detectors and the detector generator can be trained simultaneously. Finally, the generated detectors of different classes are encouraged to be orthogonal to each other for better generalization. The proposed approach is extensively evaluated on the ImageNet, VOC, and COCO data sets under various few-shot detection settings, and it achieves new state-of-the-art results.