Reviewerly/exHarmony huggingface dataset:
Explainable artificial intelligence model to predict acute critical illness from electronic health records

Abstract Acute critical illness is often preceded by deterioration of routinely measured clinical parameters, e.g., blood pressure and heart rate. Early clinical prediction is typically based on manually calculated screening metrics that simply weigh these parameters, such as early warning scores (EWS). The predictive performance of EWSs yields a tradeoff between sensitivity and specificity that can lead to negative outcomes for the patient. Previous work on electronic health records (EHR) trained artificial intelligence (AI) systems offers promising results with high levels of predictive performance in relation to the early, real-time prediction of acute critical illness. However, without insight into the complex decisions by such system, clinical translation is hindered. Here, we present an explainable AI early warning score (xAI-EWS) system for early detection of acute critical illness. xAI-EWS potentiates clinical translation by accompanying a prediction with information on the EHR data explaining it.
Federated learning with hierarchical clustering of local updates to improve training on non-IID data

Federated learning (FL) is a well established method for performing machine learning tasks over massively distributed data. However in settings where data is distributed in a non-iid (not independent and identically distributed) fashion - as is typical in real world situations - the joint model produced by FL suffers in terms of test set accuracy and/or communication costs compared to training on iid data. We show that learning a single joint model is often not optimal in the presence of certain types of non-iid data. In this work we present a modification to FL by introducing a hierarchical clustering step (FL+HC) to separate clusters of clients by the similarity of their local updates to the global joint model. Once separated, the clusters are trained independently and in parallel on specialised models. We present a robust empirical analysis of the hyperparameters for FL+HC for several iid and non-iid settings. We show how FL+HC allows model training to converge in fewer communication rounds (significantly so under some non-iid settings) compared to FL without clustering. Additionally, FL+HC allows for a greater percentage of clients to reach a target accuracy compared to standard FL. Finally we make suggestions for good default hyperparameters to promote superior performing specialised models without modifying the the underlying federated learning communication protocol.
Rethinking Spatial Dimensions of Vision Transformers

Vision Transformer (ViT) extends the application range of transformers from language processing to computer vision tasks as being an alternative architecture against the existing convolutional neural networks (CNN). Since the transformer-based architecture has been innovative for computer vision modeling, the design convention towards an effective architecture has been less studied yet. From the successful design principles of CNN, we investigate the role of spatial dimension conversion and its effectiveness on transformer-based architecture. We particularly attend to the dimension reduction principle of CNNs; as the depth increases, a conventional CNN increases channel dimension and decreases spatial dimensions. We empirically show that such a spatial dimension reduction is beneficial to a transformer architecture as well, and propose a novel Pooling-based Vision Transformer (PiT) upon the original ViT model. We show that PiT achieves the improved model capability and generalization performance against ViT. Throughout the extensive experiments, we further show PiT outperforms the baseline on several tasks such as image classification, object detection, and robustness evaluation. Source codes and ImageNet models are available at https://github.com/naver-ai/pit.
Detecting Coherent Groups in Crowd Scenes by Multiview Clustering

Detecting coherent groups is fundamentally important for crowd behavior analysis. In the past few decades, plenty of works have been conducted on this topic, but most of them have limitations due to the insufficient utilization of crowd properties and the arbitrary processing of individuals. In this study, a Multiview-based Parameter Free framework (MPF) is proposed. Based on the L1-norm and L2-norm, we design two versions of the multiview clustering method, which is the main part of the proposed framework. This paper presents the contributions on three aspects: (1) a new structural context descriptor is designed to characterize the structural properties of individuals in crowd scenes; (2) a self-weighted multiview clustering method is proposed to cluster feature points by incorporating their orientation and context similarities; and (3) a novel framework is introduced for group detection, which is able to determine the group number automatically without any parameter or threshold to be tuned. The effectiveness of the proposed framework is evaluated on real-world crowd videos, and the experimental results show its promising performance on group detection. In addition, the proposed multiview clustering method is also evaluated on a synthetic dataset and several standard benchmarks, and its superiority over the state-of-the-art competitors is demonstrated.
Review of blockchain-based distributed energy: Implications for institutional development

The future of energy is complex, with fluctuating renewable resources in increasingly distributed systems. It is suggested that blockchain technology is a timely innovation with potential to facilitate this future. Peer-to-peer (P2P) microgrids can support renewable energy as well as economically empower consumers and prosumers. However, the rapid development of blockchain and prospects for P2P energy networks is coupled with several grey areas in the institutional landscape. The purpose of this paper is to holistically explore potential challenges of blockchain-based P2P microgrids, and propose practical implications for institutional development as well as academia. An analytical framework for P2P microgrids is developed based on literature review as well as expert interviews. The framework incorporates 1) Technological, 2) Economic, 3) Social, 4) Environmental and 5) Institutional dimensions. Directions for future work in practical and academic contexts are identified. It is suggested that bridging the gap from technological to institutional readiness would require the incorporation of all dimensions as well as their inter-relatedness. Gradual institutional change leveraging community-building and regulatory sandbox approaches are proposed as potential pathways in incorporating this multi-dimensionality, reducing cross-sectoral silos, and facilitating interoperability between current and future systems. By offering insight through holistic conceptualization, this paper aims to contribute to expanding research in building the pillars of a more substantiated institutional arch for blockchain in the energy sector.
Blockchain Inspired RFID-Based Information Architecture for Food Supply Chain

In this paper, we propose a blockchain inspired Internet-of-Things architecture for creating a transparent food supply chain. The architecture uses a proof-of-object-based authentication protocol, which is analogous to the cryptocurrency's proof-of-work protocol. The complete architecture was realized by integrating a radio frequency identification (RFID)-based sensor at the physical layer and blockchain at the cyber layer. The RFID provides a unique identity of the product and the sensor data, which helps in real time quality monitoring. For this purpose, a small feature size 900-MHz RFID coupled sensor was fabricated and demonstrated for real time sensor data acquisition. The blockchain architecture aids in creating a tamper-proof digital database of the food packages at each instance. A detailed security analysis was performed to investigate the vulnerability of the proposed architecture under different types of cyber attacks.
A Neural Model for Generating Natural Language Summaries of Program Subroutines

Source code summarization -- creating natural language descriptions of source code behavior -- is a rapidly-growing research topic with applications to automatic documentation generation, program comprehension, and software maintenance. Traditional techniques relied on heuristics and templates built manually by human experts. Recently, data-driven approaches based on neural machine translation have largely overtaken template-based systems. But nearly all of these techniques rely almost entirely on programs having good internal documentation; without clear identifier names, the models fail to create good summaries. In this paper, we present a neural model that combines words from code with code structure from an AST. Unlike previous approaches, our model processes each data source as a separate input, which allows the model to learn code structure independent of the text in code. This process helps our approach provide coherent summaries in many cases even when zero internal documentation is provided. We evaluate our technique with a dataset we created from 2.1m Java methods. We find improvement over two baseline techniques from SE literature and one from NLP literature.
Augmented reality in support of intelligent manufacturing – A systematic literature review

Industry increasingly moves towards digitally enabled ‘smart factories’ that utilise the internet of things (IoT) to realise intelligent manufacturing concepts like predictive maintenance or extensive machine to machine communication. A core technology to facilitate human integration in such a system is augmented reality (AR), which provides people with an interface to interact with the digital world of a smart factory. While AR is not ready yet for industrial deployment in some areas, it is already used in others. To provide an overview of research activities concerning AR in certain shop floor operations, a total of 96 relevant papers from 2011 to 2018 are reviewed. This paper presents the state of the art, the current challenges, and future directions of manufacturing related AR research through a systematic literature review and a citation network analysis. The results of this review indicate that the context of research concerning AR gets increasingly broader, especially by addressing challenges when implementing AR solutions.
Deep Learning-Based End-to-End Wireless Communication Systems With Conditional GANs as Unknown Channels

In this article, we develop an end-to-end wireless communication system using deep neural networks (DNNs), where DNNs are employed to perform several key functions, including encoding, decoding, modulation, and demodulation. However, an accurate estimation of instantaneous channel transfer function, i.e., channel state information (CSI), is needed in order for the transmitter DNN to learn to optimize the receiver gain in decoding. This is very much a challenge since CSI varies with time and location in wireless communications and is hard to obtain when designing transceivers. We propose to use a conditional generative adversarial net (GAN) to represent channel effects and to bridge the transmitter DNN and the receiver DNN so that the gradient of the transmitter DNN can be back-propagated from the receiver DNN. In particular, a conditional GAN is employed to model the channel effects in a data-driven way, where the received signal corresponding to the pilot symbols is added as a part of the conditioning information of the GAN. To address the curse of dimensionality when the transmit symbol sequence is long, convolutional layers are utilized. From the simulation results, the proposed method is effective on additive white Gaussian noise (AWGN) channels, Rayleigh fading channels, and frequency-selective channels, which opens a new door for building data-driven DNNs for end-to-end communication systems.
Dynamic Refinement Network for Oriented and Densely Packed Object Detection

Object detection has achieved remarkable progress in the past decade. However, the detection of oriented and densely packed objects remains challenging because of following inherent reasons: (1) receptive fields of neurons are all axis-aligned and of the same shape, whereas objects are usually of diverse shapes and align along various directions; (2) detection models are typically trained with generic knowledge and may not generalize well to handle specific objects at test time; (3) the limited dataset hinders the development on this task. To resolve the first two issues, we present a dynamic refinement network that consists of two novel components, i.e., a feature selection module (FSM) and a dynamic refinement head (DRH). Our FSM enables neurons to adjust receptive fields in accordance with the shapes and orientations of target objects, whereas the DRH empowers our model to refine the prediction dynamically in an object-aware manner. To address the limited availability of related benchmarks, we collect an extensive and fully annotated dataset, namely, SKU110K-R, which is relabeled with oriented bounding boxes based on SKU110K. We perform quantitative evaluations on several publicly available benchmarks including DOTA, HRSC2016, SKU110K, and our own SKU110K-R dataset. Experimental results show that our method achieves consistent and substantial gains compared with baseline approaches. Our source code and dataset will be released to encourage follow-up research.
JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detection

This paper proposes a novel joint learning and densely-cooperative fusion (JL-DCF) architecture for RGB-D salient object detection. Existing models usually treat RGB and depth as independent information and design separate networks for feature extraction from each. Such schemes can easily be constrained by a limited amount of training data or over-reliance on an elaborately-designed training process. In contrast, our JL-DCF learns from both RGB and depth inputs through a Siamese network. To this end, we propose two effective components: joint learning (JL), and densely-cooperative fusion (DCF). The JL module provides robust saliency feature learning, while the latter is introduced for complementary feature discovery. Comprehensive experiments on four popular metrics show that the designed framework yields a robust RGB-D saliency detector with good generalization. As a result, JL-DCF significantly advances the top-1 D3Net model by an average of ~1.9% (S-measure) across six challenging datasets, showing that the proposed framework offers a potential solution for real-world applications and could provide more insight into the cross-modality complementarity task. The code will be available at https://github.com/kerenfu/JLDCF/.
Research trends in the use of augmented reality in science education: Content and bibliometric mapping analysis

The aim of this study was to reveal research trends over the last six years by content analysis and to examine bibliometric results of articles related to the use of augmented reality (AR) in science education. For bibliometric mapping analysis, a total of 147 articles were accessed and for content analysis, a total of 79 articles published between 2013 and 2018 years were included from the Web of Science. From this, a total of 62 articles were selected for analysis. Our results revealed that mobile learning, science education, science learning and e-learning were the most used keywords in articles, while the focus of more recent articles tended to be on mobile learning. The results showed that recent articles have mostly focused on mobile learning and e-learning environments. The most-used words in the abstracts were education, knowledge, science education, experiment and effectiveness. It is evident that recent articles have focused mostly on students' knowledge and achievement. Azuma, Dunleavy and Klopfer are the most cited authors in this field. This is not surprising as they are probably the leading authors on AR in the literature. The most cited journals are Computers & Education, Journal of Science Education & Technology, Educational Technology and Society, Computers in Human Behavior, and British Journal of Educational Technology. These are the most prominent journals on the use of technology in education. Content analysis results showed that “Learning/Academic Achievement”, “Motivation” and “Attitude” have been the most examined variables in the articles. Since academic achievement is highly influenced by motivation and attitude, it is understandable that these variables are considered together in reviewed studies. It was found that mobile applications and marker-based materials on paper have been the most-favored types of materials for AR because these types of materials are easy to use and they can be developed easily and practically. Quantitative studies were the most used research design type but there have been only a limited number of qualitative studies in the last six years. This may be due to the increased tendency to use quantitative and mixed studies in recent years.
Human Memory Update Strategy: A Multi-Layer Template Update Mechanism for Remote Visual Monitoring

In the era of rapid development of artificial intelligence, the integration of multimedia and human-artificial intelligence has become an important research hotspot. Especially in the multimedia environment, effective remote visual monitoring has become the exploration direction of many scholars. The use of traditional correlation filtering (CF) algorithm for real-time monitoring in the context of multimedia is a practical strategy. However, most existing filtering-based visual monitoring algorithms still have the problem of insufficient robustness and effectiveness. Therefore, by considering the strategy of updating human memory, this paper proposes a multi-layer template update mechanism to achieve effective monitoring in a multimedia environment. In this strategy, the weighted template of the high-confidence matching memory is used as the confidence memory, and the unweighted template of the low-confidence matching memory is used as the cognitive memory. Through the alternate use of confidence memory, matching memory, and cognitive memory, it is ensured that the target will not be lost during the monitoring process. Experimental results show that this strategy does not affect the speed (still real-time) and improves the robustness in the multimedia background.
Deep learning and its application in geochemical mapping

Machine learning algorithms have been applied widely in the fields of natural science, social science and engineering. It can be expected that machine learning approaches especially deep learning algorithms will help geoscientists to discover mineral deposits through processing of various geoscience datasets. This study reviews the state-of-the-art application of deep learning algorithms for processing geochemical exploration data and mining the geochemical patterns. Deep learning algorithms can deal with complex and nonlinear problems and, therefore, can enhance the identification of geochemical anomalies and the recognition of hidden patterns. Applied geochemistry needs more applications of machine learning and/or deep learning algorithms.
An efficient chaotic mutative moth-flame-inspired optimizer for global optimization tasks

Moth-flame optimization algorithm (MFO) is a new nature-inspired meta-heuristic based on the navigation routine of moths in the environment known as transverse orientation. For some complex optimization tasks, especially high dimensional and multimodal problems, the conventional MFO may face problems in the convergence trends or be trapped into the local and deceptive optima. Therefore, in this study, two strategies have been introduced into the conventional MFO to get a more stable sense of balance between the exploration and exploitation propensities. First, Gaussian mutation is employed to increase the population diversity of MFO. Then, a chaotic local search is applied to the flame updating process of MFO for better exploiting the locality of the solutions. The proposed CLSGMFO approach was compared against a wide range of well-known classical metaheuristic algorithms (MAs) and various advanced MAs using 23 classical benchmark functions. It was shown that the designed CLSGMFO can outperform most of the popular MAs in terms of solution quality and convergence speed. Moreover, based on CLSGMFO, a hybrid kernel extreme learning machine model, which is called CLSGMFO-KELM, is established to deal with financial stress prediction scenarios. To investigate the effectiveness of the CLSGMFO-KELM model, the proposed hybrid system was tested on two widely used financial datasets and compared against a broad array of popular classifiers. The results demonstrate that the proposed learning scheme can offer a superior kernel extreme learning machine model with excellent predictive performance. Accordingly, the proposed CLSGMFO can serve as an effective and efficient computer-aided tool for financial prediction.
Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module

Although successful detection of malignant tumors from histopathological images largely depends on the long-term experience of radiologists, experts sometimes disagree with their decisions. Computer-aided diagnosis provides a second option for image diagnosis, which can improve the reliability of experts' decision-making. Automatic and precision classification for breast cancer histopathological image is of great importance in clinical application for identifying malignant tumors from histopathological images. Advanced convolution neural network technology has achieved great success in natural image classification, and it has been used widely in biomedical image processing. In this paper, we design a novel convolutional neural network, which includes a convolutional layer, small SE-ResNet module, and fully connected layer. We propose a small SE-ResNet module which is an improvement on the combination of residual module and Squeeze-and-Excitation block, and achieves the similar performance with fewer parameters. In addition, we propose a new learning rate scheduler which can get excellent performance without complicatedly fine-tuning the learning rate. We use our model for the automatic classification of breast cancer histology images (BreakHis dataset) into benign and malignant and eight subtypes. The results show that our model achieves the accuracy between 98.87% and 99.34% for the binary classification and achieve the accuracy between 90.66% and 93.81% for the multi-class classification.