Reviewerly/exHarmony huggingface dataset:
Multi-feature fusion network for road scene semantic segmentation

Road scene semantic segmentation often requires a deeper neural network to obtain higher accuracy, which makes the segmentation model more complex and slower. In this paper, we use shallow neural networks to achieve semantic segmentation for intelligent transportation system. Specifically, we propose a lightweight semantic segmentation model. First, the image features are extracted by using a simple superimposed convolutional layer and the three branches of ResNet and optimized by the attention mechanism. Then element multiplication and feature fusion are performed. Finally, the segmentation mask is obtained. Fewer convolutional layers and ResNet will not take up a lot of resources, we use the main resources to calculate the fusion between features. Experiments show that our method achieves high accuracy and comparable speed on the Cityscapes and CamVid datasets. On the Cityscapes dataset, our method achieves 75.0% mIoU, which is 0.2% higher than the better-performing BiSeNet.
KonVid-150k: A Dataset for No-Reference Video Quality Assessment of Videos in-the-Wild

Video quality assessment (VQA) methods focus on particular degradation types, usually artificially induced on a small set of reference videos. Hence, most traditional VQA methods under-perform in-the-wild. Deep learning approaches have had limited success due to the small size and diversity of existing VQA datasets, either artificial or authentically distorted. We introduce a new in-the-wild VQA dataset that is substantially larger and diverse: KonVid-150k. It consists of a coarsely annotated set of 153,841 videos having five quality ratings each, and 1,596 videos with a minimum of 89 ratings each. Additionally, we propose new efficient VQA approaches (MLSP-VQA) relying on multi-level spatially pooled deep-features (MLSP). They are exceptionally well suited for training at scale, compared to deep transfer learning approaches. Our best method, MLSP-VQA-FF, improves the Spearman rank-order correlation coefficient (SRCC) performance metric on the commonly used KoNViD-1k in-the-wild benchmark dataset to 0.82. It surpasses the best existing deep-learning model (0.80 SRCC) and hand-crafted feature-based method (0.78 SRCC). We further investigate how alternative approaches perform under different levels of label noise, and dataset size, showing that MLSP-VQA-FF is the overall best method for videos in-the-wild. Finally, we show that the MLSP-VQA models trained on KonVid-150k sets the new state-of-the-art for cross-test performance on KoNViD-1k and LIVE-Qualcomm with a 0.83 and 0.64 SRCC, respectively. For KoNViD-1k this inter-dataset testing outperforms intra-dataset experiments, showing excellent generalization.
Thermal Infrared Image Colorization for Nighttime Driving Scenes With Top-Down Guided Attention

Benefitting from insensitivity to light and high penetration of foggy environments, infrared cameras are widely used for sensing in nighttime traffic scenes. However, the low contrast and lack of chromaticity of thermal infrared (TIR) images hinder the human interpretation and portability of high-level computer vision algorithms. Colorization to translate a nighttime TIR image into a daytime color (NTIR2DC) image may be a promising way to facilitate nighttime scene perception. Despite recent impressive advances in image translation, semantic encoding entanglement and geometric distortion in the NTIR2DC task remain under-addressed. Hence, we propose a toP-down attEntion And gRadient aLignment based generative adversarial network, referred to as PearlGAN. A top-down guided attention module and an elaborate attentional loss are first designed to reduce the semantic encoding ambiguity during translation. Then, a structured gradient alignment loss is introduced to encourage edge consistency between the translated and input images. In addition, pixel-level annotation is carried out on a subset of FLIR and KAIST datasets to evaluate the semantic preservation performance of multiple translation methods. Furthermore, a new metric is devised to evaluate the geometric consistency in the translation process. Extensive experiments demonstrate the superiority of the proposed PearlGAN over other image translation methods for the NTIR2DC task. The source code and labeled segmentation masks will be available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/FuyaLuo/PearlGAN/</uri> .
Society 5.0 publication mapping using a scientometric perspective

Abstract Society 5.0 initiated by the Japanese nation seeks to enhance the standard of living of the society with an IoT-based smart society and an entrepreneurial spirit. This research aims to study the map of international publications in the field of Society 5.0 using a scientometrics perspective. The research conducts a scientometrics method and analyzed research data using the analyze search results service from Scopus and the VOSviewer application. Research data on 57 academic documents published from 2017 to 2019 obtained from the Scopus database. The results show an increase in the number of international publications in Society 5.0 each year. However, there were no research institutions and individual researchers with the most publications in the field of Society 5.0. The most countries, subject areas, and type documents in Society 5.0 publications were Japan, computer science, and article. There was one collaborative pattern of researchers in the field of Society 5.0. This study proposes a convergence axis classification consisting of society 5.0 publications to characterize the body of knowledge generated from three years of publications: computer science, society, economics, industry, technology, and IoT.
Device-independent quantum key distribution from generalized CHSH inequalities

Device-independent quantum key distribution aims at providing security guarantees even when using largely uncharacterised devices. In the simplest scenario, these guarantees are derived from the CHSH score, which is a simple linear combination of four correlation functions. We here derive a security proof from a generalisation of the CHSH score, which effectively takes into account the individual values of two correlation functions. We show that this additional information, which is anyway available in practice, allows one to get higher key rates than with the CHSH score. We discuss the potential advantage of this technique for realistic photonic implementations of device-independent quantum key distribution.
Smoothed dilated convolutions for improved dense prediction

Dilated convolutions, also known as atrous convolutions, have been widely explored in deep convolutional neural networks (DCNNs) for various dense prediction tasks. However, dilated convolutions suffer from the gridding artifacts, which hampers the performance. In this work, we propose two simple yet effective degridding methods by studying a decomposition of dilated convolutions. Unlike existing models, which explore solutions by focusing on a block of cascaded dilated convolutional layers, our methods address the gridding artifacts by smoothing the dilated convolution itself. In addition, we point out that the two degridding approaches are intrinsically related and define separable and shared (SS) operations, which generalize the proposed methods. We further explore SS operations in view of operations on graphs and propose the SS output layer, which is able to smooth the entire DCNNs by only replacing the output layer. We evaluate our degridding methods and the SS output layer thoroughly, and visualize the smoothing effect through effective receptive field analysis. Results show that our methods degridding yield consistent improvements on the performance of dense prediction tasks, while adding negligible amounts of extra training parameters. And the SS output layer improves the performance by 3.3% and contains only 9% training parameters of the original output layer.
LSTM with bio inspired algorithm for action recognition in sports videos

Nowadays, Sport-related movement recognition plays an essential part in the wellbeing of people's lives. The mention of human movements and gestures is often studied in sports to help analyze, guide, and evaluate activity. The automatic detection of sports-related signals helps find the injuries or indirect physical issues in the human body. Action recognition patterns with complicated motion status and periodicity in sports games can help to more accurately estimate the duration of successful action states. Actions are recognized by identifying the activity in a clip. Quality evaluation of action assigns a quantitative score based on the performance of the action. Based on the score, the action states are analyzed. The main issue of sports game identification correctly tracks the behavior of sportspeople. In this paper, Long Short Term Memory networks (LSTM) with a Bio-inspired Algorithm (BIA) framework have been proposed to recognize the action of a sportsperson and motivate a person to improve sports skills. Action recognition and classification can also be used to produce matching or practice output statistics automatically. The proposed LSTM-BIA utilizes predefined actions by modeling the monitoring effects with discriminative temporal signals. It uses the Spatial pyramid pooling SPP-net to obtain the robust characteristic of each frame's tracked area. The new SPP-net network structure will produce an adjusted description irrespective of the scale and resolution of the object. It could be used for identification and entity recognition and enables variable-length image input into CNN. The experimental results show that the proposed method can evaluate the actual action of sportspersons with high accuracy when compared to other methods.
Mobile-assisted and gamification-based language learning: a systematic literature review

Learning a new language is a challenging task. In many countries, students are encouraged to learn an international language at school level. In particular, English is the most widely used international language and is being taught at the school level in many countries. The ubiquity and accessibility of smartphones combined with the recent developments in mobile application and gamification in teaching and training have paved the way for experimenting with language learning using mobile phones. This article presents a systematic literature review of the published research work in mobile-assisted language learning. To this end, more than 60 relevant primary studies which have been published in well-reputed venues have been selected for further analysis. The detailed analysis reveals that researchers developed many different simple and gamified mobile applications for learning languages based on various theories, frameworks, and advanced tools. Furthermore, the study also analyses how different applications have been evaluated and tested at different educational levels using different experimental settings while incorporating a variety of evaluation measures. Lastly, a taxonomy has been proposed for the research work in mobile-assisted language learning, which is followed by promising future research challenges in this domain.
A deep learning based automatic defect analysis framework for In-situ TEM ion irradiations

Videos captured using Transmission Electron Microscopy (TEM) can encode details regarding the morphological and temporal evolution of a material by taking snapshots of the microstructure sequentially. However, manual analysis of such video is tedious, error-prone, unreliable, and prohibitively time-consuming if one wishes to analyze a significant fraction of frames for even videos of modest length. In this work, we developed an automated TEM video analysis system for microstructural features based on the advanced object detection model called YOLO and tested the system on an in-situ ion irradiation TEM video of dislocation loops formed in a FeCrAl alloy. The system provides analysis of features observed in TEM including both static and dynamic properties using the YOLO-based defect detection module coupled to a geometry analysis module and a dynamic tracking module. Results show that the system can achieve human comparable performance with an F1 score of 0.89 for fast, consistent, and scalable frame-level defect analysis. This result is obtained on a real but exceptionally clean and stable data set and more challenging data sets may not achieve this performance. The dynamic tracking also enabled evaluation of individual defect evolution like per defect growth rate at a fidelity never before achieved using common human analysis methods. Our work shows that automatically detecting and tracking interesting microstructures and properties contained in TEM videos is viable and opens new doors for evaluating materials dynamics.
Multiclass diagnosis of stages of Alzheimer's disease using linear discriminant analysis scoring for multimodal data

Alzheimer's disease (AD) is a progressive neurodegenerative disease, and mild cognitive impairment (MCI) is a transitional stage between normal control (NC) and AD. A multiclass classification of AD is a difficult task because there are multiple similarities between neighboring groups. The performance of classification can be improved by using multimodal data, but the improvement could be limited with inefficient fusion of multimodal data. This study aims to develop a framework for AD multiclass diagnosis with a linear discriminant analysis (LDA) scoring method to fuse multimodal data more efficiently. Magnetic resonance imaging, positron emission tomography, cerebrospinal fluid biomarkers, and genetic features were first preprocessed by performing age correction, feature selection, and feature reduction. Then, they were individually scored using LDA, and the scores that represent the AD pathological progress in different modalities were obtained. Finally, an extreme learning machine-based decision tree was established to perform multiclass diagnosis using these scores. The experiments were conducted on the AD Neuroimaging Initiative dataset, and accuracies of 66.7% and 57.3% and F1-scores of 64.9% and 55.7% were achieved in three- and four-way classifications, respectively. The results also showed that the proposed framework achieved a better performance than the method that did not score multimodal data and the methods in previous studies, thereby indicating that the LDA scoring strategy is an efficient way for multimodalities fusion in AD multiclass classification.
m-Activity: Accurate and Real-Time Human Activity Recognition Via Millimeter Wave Radar

Natural human activity recognition (HAR) via millimeter wave (mmWave) sensing is a key to the human-computer interaction (HCI), e.g., activity assistance and living state monitoring. Prior work has shown the feasibility of HAR by utilizing mmWave radar, but it falls short of two real-world issues: poor recognition accuracy in the noisy environment and unable to give real-time response due to long latency. In this paper, we propose m-Activity, which can realize HAR while reducing noise caused by environmental multi-path effects, and operate fluently at runtime. m-Activity first distills the human-orientated movements from the noisy background environment and then classify the movements using a custom-designed lightweight neural network called HARnet. To drive the above methods, we propose a simple but efficient response mechanism to enable real-time recognition. We prototype m-Activity on a commodity mmWave radar chip and evaluate its recognition performance over 5 pre-defined human activities within the detection range of 3m, which results in off-line accuracy of 93.25%, and real-time accuracy of 91.52%. Furthermore, we validate m-Activity’s ability under a complex real-world scenario, i.e., fitness center, which is full of severe multi-path effects caused by various strong metal reflectors.
Graph neural network approach for anomaly detection

To ensure the stable long-time operation of satellites, evaluate the satellite status, and improve satellite maintenance efficiency, we propose an anomaly detection method based on graph neural network and dynamic threshold (GNN-DTAN). Firstly, we build the graph neural network model for telemetry data. The graph construction module in the model extracts the relationship between features, and the spatial dependency extraction module and the temporal dependency extraction module extract the spatial and temporal dependencies of the data, respectively. The trained model is then used to predict the data, and the anomaly score between the predicted and actual values is calculated. Finally, the wavelet variance is used to analyze the data period. A dynamic threshold method based on the period time window is used to detect anomalies in the data set. Experimental results of satellite power system telemetry data show that the proposed algorithm's accuracy reaches more than 98%, with good effectiveness and robustness.
Using Synthetic Audio to Improve the Recognition of Out-of-Vocabulary Words in End-to-End Asr Systems

Today, many state-of-the-art automatic speech recognition (ASR) systems apply all-neural models that map audio to word sequences trained end-to-end along one global optimisation criterion in a fully data driven fashion. These models allow high precision ASR for domains and words represented in the training material but have difficulties recognising words that are rarely or not at all represented during training, i.e. trending words and new named entities. In this paper, we use a text-to-speech (TTS) engine to provide synthetic audio for out-of-vocabulary (OOV) words. We aim to boost the recognition accuracy of a recurrent neural network transducer (RNN-T) on OOV words by using the extra audio-text pairs, while maintaining the performance on the non-OOV words. Different regularisation techniques are explored and the best performance is achieved by fine-tuning the RNN-T on both original training data and extra synthetic data with elastic weight consolidation (EWC) applied on the encoder. This yields a 57% relative word error rate (WER) reduction on utterances containing OOV words without any degradation on the whole test set.
How to issue a central bank digital currency

With the emergence of Bitcoin and recently proposed stablecoins from BigTechs, such as Diem (formerly Libra), central banks face growing competition from private actors offering their own digital alternative to physical cash. We do not address the normative question whether a central bank should issue a central bank digital currency (CBDC) or not. Instead, we contribute to the current research debate by showing how a central bank could do so, if desired. We propose a token-based system without distributed ledger technology and show how earlier-deployed, software-only electronic cash can be improved upon to preserve transaction privacy, meet regulatory requirements in a compelling way, and offer a level of quantum-resistant protection against systemic privacy risk. Neither monetary policy nor financial stability would be materially affected because a CBDC with this design would replicate physical cash rather than bank deposits.
Computational Options for Standard Errors and Test Statistics with Incomplete Normal and Nonnormal Data in SEM

(2022). Computational Options for Standard Errors and Test Statistics with Incomplete Normal and Nonnormal Data in SEM. Structural Equation Modeling: A Multidisciplinary Journal: Vol. 29, No. 2, pp. 163-181.
A Critical Overview of Privacy in Machine Learning

This article reviews privacy challenges in machine learning and provides a critical overview of the relevant research literature. The possible adversarial models are discussed, a wide range of attacks related to sensitive information leakage is covered, and several open problems are highlighted.
Container Placement and Migration in Edge Computing: Concept and Scheduling Models

Containers are a form of software virtualization, rapidly becoming the de facto way of providing edge computing services. Research on container-based edge computing is plentiful, and this has been buoyed by the increasing demand for single digit, milliseconds latency computations. A container scheduler is part of the architecture that is used to manage and orchestrate multiple container-based applications on heterogenous computing nodes. The scheduler decides how incoming computing requests are allocated to containers, which edge nodes the containers are placed on, and where already deployed containers are migrated to. This paper aims to clarify the concept of container placement and migration in edge servers and the scheduling models that have been developed for this purpose. The study illuminates the frameworks and algorithms upon which the scheduling models are built. To convert the problem to one that can be solved using an algorithm, the container placement problem in mostly abstracted using multi-objective optimization models or graph network models. The scheduling algorithms are predominantly heuristic-based algorithms, which are able to arrive at sub-optimal solutions very quickly. There is paucity of container scheduling models that consider distributed edge computing tasks. Research in decentralized scheduling systems is gaining momentum and the future outlook is in scheduling containers for mobile edge nodes.
AI in patient flow: applications of artificial intelligence to improve patient flow in NHS acute mental health inpatient units

Growing demand for mental health services, coupled with funding and resource limitations, creates an opportunity for novel technological solutions including artificial intelligence (AI). This study aims to identify issues in patient flow on mental health units and align them with potential AI solutions, ultimately devising a model for their integration at service level.Following a narrative literature review and pilot interview, 20 semi-structured interviews were conducted with AI and mental health experts. Thematic analysis was then used to analyse and synthesise gathered data and construct an enhanced model.Predictive variables for length-of-stay and readmission rate are not consistent in the literature. There are, however, common themes in patient flow issues. An analysis identified several potential areas for AI-enhanced patient flow. Firstly, AI could improve patient flow by streamlining administrative tasks and optimising allocation of resources. Secondly, real-time data analytics systems could support clinician decision-making in triage, discharge, diagnosis and treatment stages. Finally, longer-term, development of solutions such as digital phenotyping could help transform mental health care to a more preventative, personalised model.Recommendations were formulated for NHS trusts open to adopting AI patient flow enhancements. Although AI offers many promising use-cases, greater collaborative investment and infrastructure are needed to deliver clinically validated improvements. Concerns around data-use, regulation and transparency remain, and hospitals must continue to balance guidelines with stakeholder priorities. Further research is needed to connect existing case studies and develop a framework for their evaluation.