Reviewerly/exHarmony huggingface dataset:
Optimizing ADWIN for steady streams

With the ever-growing data generation rates and stringent constraints on the latency of analyzing such data, stream analytics is overtaking. Learning from data streams, aka online machine learning, is no exception. However, online machine learning comes with many challenges for the different aspects of the learning process, starting from the algorithm design to the evaluation method. One of these challenges is the ability of a learning system to adapt to the change in data distribution, known as concept drift, to maintain the accuracy of the predictions. Over time, several drift detection approaches have been proposed. A prominent approach is adaptive windowing (ADWIN) which can detect changes in features data distribution without explicit feedback on the correctness of the prediction. Several variants for ADWIN have been proposed to enhance its runtime performance, w.r.t throughput, and latency. However, the drift detection accuracy of these variants was not compared with the original algorithm. Moreover, there is no study concerning the memory consumption of the variants and the original algorithm. Additionally, the evaluation was done on synthetic datasets with a considerable number of drifts not covering all types of drifts or steady streams, those that do not have drifts at all or almost negligible drifts.
Question answering system based on military knowledge graph

In the field of military equipment knowledge, there are a large number of equipment models, weapon types, operating parameters and other time-frequency domain and airspace data information, which potentially contains a lot of valuable information. At present, in the face of these massive domain knowledge, combat related personnel cannot efficiently acquire the key knowledge, which means that they cannot provide effective guidance according to the potential key knowledge. In order to solve this problem, based on the investigation and analysis of the construction methods of the existing knowledge graph, this paper mined and extracted the knowledge of military equipment, instantiated and correlated different weapons and equipment, and constructed the knowledge graph of military equipment and question answering system. The construction of military equipment knowledge graph and question answering system can not only deeply study the key technical difficulties of domain graph, but also has strong strategic support significance for the development of related fields.
Semantic Modeling and Pixel Discrimination for Image Manipulation Detection

Image manipulation methods, such as the copy-move, splicing, and removal methods, have become increasingly mature and changed the common perception of “seeing is believing.” The credibility of digital media has been seriously damaged with the development of image manipulation methods. Most image manipulation detection methods detect traces of tampering pixel by pixel. As a result, the detected manipulation areas are separated, which results in insufficient consideration of content manipulation at the object level. In this paper, the detection of image manipulation areas based on forgery object detection and pixel discrimination is proposed. Specifically, the pixel-level detection branch resamples features and uses an LSTM to detect manipulations, such as resampling, rotation, and cropping. The goal of the forgery object detection branch, which is based on Faster R-CNN, is to extract the regions of interest and analyze the regions with high contrast as well as the forgery objects of the image. Furthermore, the fused heatmaps of the two branches are integrated with the object detection results. The noise in the heatmaps is shielded based on the forgery object information of the region proposal network. Experimental results on multiple standard forgery datasets have demonstrated the superiority of our proposed method compared with the state-of-the-art methods.
Monitoring Volcanic and Tectonic Sandbox Analogue Models Using the Kinect v2 Sensor

Abstract The measurement of surface deformation in analogue models of volcanic and tectonic processes is an area in continuous development. Properly quantifying topography change in analogue models is key for a useful comparison between experiment results and nature. The aim of this work is to evaluate the capabilities of the simple and cheap Microsoft® Kinect v2 sensor for monitoring analogue models made of granular materials. Microsoft® Kinect v2 is a video‐gaming RedGreenBlue‐Depth device combining an optical camera and an infrared distance measurement sensor. The precision of the device for model topography measurements has been quantified using 64 experiments, with variable granular materials materials and distance to the model. Additionally, we tested the capabilities of averaging several distance images to increase the precision. We have developed a specific software to facilitate the acquisition and processing of the Kinect v2 data in experiment monitoring. Our results show that measurement precision is material dependent: with clear‐colored and fine‐grained materials, a precision ∼1.0 mm for digital elevation models with a 1.6 mm pixel size can be obtained. We show that by averaging ≥5 consecutive images the distance precision can reach values as low as 0.5 mm. To show the Kinect v2 capabilities, we present monitoring results from case study experiments modeling tectonics and volcano deformation. The Kinect v2 achieves lower spatial resolutions and precision than more sophisticated techniques such as photogrammetry. However, Kinect v2 provides a cheap, straightforward and powerful tool for monitoring the topography changes in sandbox analogue models.
3D map reconstruction using a monocular camera for smart cities

Abstract Large-scale high-resolution three-dimensional (3D) maps play a vital role in the development of smart cities. In this work, a novel deep learning-based multi-view-stereo method is proposed for reconstructing the 3D maps in large-scale urban environments by exploiting a monocular camera. Compared with other existing works, the proposed method can perform 3D depth estimation more efficiently in terms of computational complexity and graphics processing unit memory usage. As a result, the proposed method can practically perform depth estimation for each pixel before generating 3D maps for even large-scale scenes. Extensive experiments on the well-known DTU dataset and real-life data collected on our campus confirm the good performance of the proposed method.
Computational English Online Teaching Monitoring System Based on Deep Learning Algorithm

In order to improve the monitoring effect of English online teaching, this paper combines the deep learning algorithm to construct the English online teaching monitoring system and conduct real-time supervision of the English online teaching process. Furthermore, by altering the original DCGAN, this research seeks to apply the approach of constructing a deep convolutional adversarial network to tackle the issue of small-sample target recognition in a given scene and develop an appropriate learning model. According to the results of the experimental research, the English online teaching monitoring system proposed in this paper, which is based on the deep learning algorithm, can play an important role in online English teaching monitoring and effectively improve the efficiency of online English management.
Do explicit review strategies improve code review performance? Towards understanding the role of cognitive load

Abstract Code review is an important process in software engineering – yet, a very expensive one. Therefore, understanding code review and how to improve reviewers’ performance is paramount. In the study presented in this work, we test whether providing developers with explicit reviewing strategies improves their review effectiveness and efficiency. Moreover, we verify if review guidance lowers developers’ cognitive load. We employ an experimental design where professional developers have to perform three code review tasks. Participants are assigned to one of three treatments: ad hoc reviewing, checklist, and guided checklist. The guided checklist was developed to provide an explicit reviewing strategy to developers. While the checklist is a simple form of signaling (a method to reduce cognitive load), the guided checklist incorporates further methods to lower cognitive demands of the task such as segmenting and weeding. The majority of the participants are novice reviewers with low or no code review experience. Our results indicate that the guided checklist is a more effective aid for a simple review,while the checklist supports reviewers’ efficiency and effectiveness in a complex task. However, we did not identify a strong relationship between the guidance provided and code review performance. The checklist has the potential to lower developers’ cognitive load, but higher cognitive load led to better performance possibly due to the generally low effectiveness and efficiency of the study participants. Data and materials: 10.5281/zenodo.5653341 . Registered report: 10.17605/OSF.IO/5FPTJ .
Intelligent Aging Home Control Method and System for Internet of Things Emotion Recognition

To solve a series of pension problems caused by aging, based on the emotional recognition of the Internet of Things, the control method and system research of smart homes are proposed. This article makes a detailed analysis and research on the necessity, feasibility, and how to realize speech emotion recognition technology in smart families, introduces the definition and classification of emotion, and puts forward five main emotions to be recognized in speech emotion recognition based on smart family environment. Then, based on this, it analyses the acquisition methods of emotional speech data. On this premise, this article discusses and analyses the related problems of voice data acquisition in smart homes, such as the voice characteristics and acquisition methods, puts forward three rules for voice text design, and determines the relatively suitable hybrid recording acquisition method applied in a smart home environment. At the same time, the design and establishment process of intelligent family emotional speech database is described in detail. The related problems of feature extraction in speech emotion recognition are studied. Starting from the definition of feature extraction, this article expounds on the necessity of feature extraction in the process of recognition and analyses the characteristics of the speech signals. For the specific environment of the smart family, the speech signal required to be processed needs to be close to the auditory characteristics of the human ears, and the speech signal contains enough information. Finally, the Mel frequency cepstrum coefficient (MFCC) is selected as the feature parameter applied in this article, and the extraction process of MFCC is introduced in detail.
Multi-Attention Residual Network for Image Super Resolution

Recently, many studies have shown that deep convolutional neural network can achieve superior performance in image super resolution (SR). The majority of current CNN-based SR methods tend to use deeper architecture to get excellent performance. However, with the growing depth and width of network, the hierarchical features from low-resolution (LR) images cannot be exploited effectively. On the other hand, most models lack the ability of discriminating different types of information and treating them equally, which results in limiting the representational capacity of the models. In this study, we propose the multi-attention residual network (MARN) to address these problems. Specifically, we propose a new multi-attention residual block (MARB), which is composed of attention mechanism and multi-scale residual network. At the beginning of each residual block, the channel importance of image features is adaptively recalibrated by attention mechanism. Then, we utilize convolutional kernels of different sizes to adaptively extract the multi-attention features on different scales. At the end of blocks, local multi-attention features fusion is applied to get more effective hierarchical features. After obtaining the outputs of each MARB, global hierarchical feature fusion jointly fuses all hierarchical features for reconstructing images. Our extensive experiments show that our model outperforms most of the state-of-the-art methods.
Camera domain adaptation based on cross-patch transformers for person re-identification

As an essential task applied to video surveillance, person re-identification (Re-ID) suffers from variations across different cameras. In this paper we propose an effective transformer-based Re-ID framework for learning the identity-discriminative and camera-invariant feature representations. In contrast to the recent direction of using generative models to augment training data and enhance the invariance to input variations, we show that explicitly designing a novel adversarial loss from the perspective of feature representation learning helps to penalize the distribution discrepancy across multiple camera domains effectively. Recently, the pure transformer model has gained much attention due to its strong representation capabilities. We employ a pure transformer encoder to extract a global feature vector for the patch tokens of each person image. Notably, a novel cross-patch encoder is introduced to obtain structural information between image patches. Extensive experiments on three challenging datasets demonstrate the effectiveness and superiority of the proposed learning framework.
Distance education for pupils with intellectual disabilities – teachers’ experiences

Due to COVID-19, schools closed in Finland for eight weeks in the spring of 2020, and teaching was conducted using distance education. Teachers used their professional agency to ensure a continuation of their students' learning. This study focuses on the experiences of teachers who taught pupils with intellectual disabilities during the distance education period. The research question is: What kind of experiences did the teachers have with distance education? The data were collected via an electronic questionnaire and analysed using qualitative content analysis. The results were examined using teachers' professional agency as a theoretical lens. The results showed that teachers encountered many challenges and emotions at the beginning, but during distance education, they learnt new ways to teach and support pupils and families. Teachers' agency was spread between supporting the agency of pupils and guardians. These are discussed in the article.
Virtual Breathalyzer: Towards the Detection of Intoxication Using Motion Sensors of Commercial Wearable Devices

Driving under the influence of alcohol is a widespread phenomenon in the US where it is considered a major cause of fatal accidents. In this research, we present Virtual Breathalyzer, a novel approach for detecting intoxication from the measurements obtained by the sensors of smartphones and wrist-worn devices. We formalize the problem of intoxication detection as the supervised machine learning task of binary classification (drunk or sober). In order to evaluate our approach, we conducted a field experiment and collected 60 free gait samples from 30 patrons of three bars using a Microsoft Band and Samsung Galaxy S4. We validated our results against an admissible breathalyzer used by the police. A system based on this concept successfully detected intoxication and achieved the following results: 0.97 AUC and 0.04 FPR, given a fixed TPR of 1.0. Our approach can be used to analyze the free gait of drinkers when they walk from the car to the bar and vice versa, using wearable devices which are ubiquitous and more widespread than admissible breathalyzers. This approach can be utilized to alert people, or even a connected car, and prevent people from driving under the influence of alcohol.
An improved algorithm for superresolution reconstruction of ancient murals with a generative adversarial network based on asymmetric pyramid modules

Abstract Ancient Chinese murals are true portrayals of ancient Chinese life, but well-preserved murals are rare. Therefore, ancient mural preservation and repair are critical. To address the poor superresolution reconstruction of mural images with unclear textures and fuzzy details, we developed an improved generative adversarial network (GAN) algorithm based on asymmetric pyramid modules for ancient mural superresolution reconstruction. Asymmetric pyramid modules, which are composed of a series of dense compression units, were used to learn image features. To analyze the reconstructed image features, a perceptual loss function was integrated to optimize the model performance. The use of the improved algorithm for low-resolution mural images increased the image resolution while preserving their original feature details and textures, and the improvement effect was visually observed in terms of indices such as the peak signal-to-noise ratio and structural similarity. Compared with other superresolution-related algorithms, the proposed model increased the peak signal-to-noise ratio by 0.20–6.66 dB. The GAN-based mural superresolution reconstruction algorithm proposed in this study effectively improved the performance of reconstructed high-resolution mural images, which increases the significance of the reconstructed image for future research.
A novel multi-exposure fusion approach for enhancing visual semantic segmentation of autonomous driving

Visual semantic segmentation is a key technology to realize scene understanding for autonomous driving and its accuracy is affected by the light changes in images. This paper proposes a novel multi-exposure fusion approach to visual semantic enhancement of autonomous driving. Firstly, a multi-exposure image sequence is aligned to construct a stable image input. Secondly, high contrast regions of multi-exposure image sequences are evaluated by context aggregation network (CAN) to predict image weight map. Finally, the high-quality image is generated by weighted fusion of multi-exposure image sequences. The proposed approach is validated by using Cityscapes’ HDR dataset and real environment data. The experimental results show that the proposed method effectively restores lost features in the light changing images and enhances accuracy of subsequent semantic segmentation.
Quantum Stream Cipher Based on Holevo–Yuen Theory

In this review paper, we first introduce the basic concept of quantum computer-resistant cryptography, which is the cornerstone of security technology for the network of a new era. Then, we will describe the positioning of mathematical cryptography and quantum cryptography, that are currently being researched and developed. Quantum cryptography includes QKD and quantum stream cipher, but we point out that the latter is expected as the core technology of next-generation communication systems. Various ideas have been proposed for QKD quantum cryptography, but most of them use a single-photon or similar signal. Then, although such technologies are applicable to special situations, these methods still have several difficulties to provide functions that surpass conventional technologies for social systems in the real environment. Thus, the quantum stream cipher has come to be expected as one promising countermeasure, which artificially creates quantum properties using special modulation techniques based on the macroscopic coherent state. In addition, it has the possibility to provide superior security performance than one-time pad cipher. Finally, we introduce detailed research activity aimed at putting the quantum stream cipher into practical use in social network technology.
Method of modification of self-adaptive software systems based on ontology

The approaches and methods of implementing self-adaptive software systems have been analyzed. Based on the assessment of the scientific problem, an ontological model of self-adaptive systems has been designed. The constructed model allows to take into account specifics of the subject area during system adaptation. The method of modification of functional characteristics and graphic interface of self-adaptive systems based on ontology is proposed. The developed method allows to generate personalized settings with the possibility of further adapting the system based on the information about user needs, new requirements, and the runtime environment. The use of the ontological model and the adaptation method have been analyzed, and the directions for their improvement have been determined.
Exploring different interaction among features for CTR prediction

Advertising Click-Through Rate (CTR) prediction is a relatively successful application in the field of recommendation system. Improving the accuracy of advertising click-through rate can not only make the user experience better, but also give more benefits to advertising platforms and advertisers. It can be seen from the research status that the interaction between learning features has become a very important part of the advertising CTR prediction model. Although the existing CTR prediction models based on deep learning have achieved good results, some models only consider a single interaction mode and lack the diversity of feature interaction. To resolve this problem, this paper proposes a CTR prediction model based on multi-feature interaction, called EDIF, which aims to enhance the diversity of feature interaction. Firstly, the model learns multiple different embedding vectors for each feature in the embedding layer, which reflects the correlation between features; secondly, in the interaction of high-order features, the embedding vectors of each feature are added and pooled to form the aggregation vector of the whole feature as the input, which reflects the integrity of the feature; finally, after the feature embedding operation, the model introduces two layers in parallel: compressed excitation network layer and explicit high-order interaction layer, which improves the ability of feature interaction. We have done a lot of experiments on two public data sets, Avazu and Criteo. The results show that the model effect of this paper has great advantages over the latest model.
Emotion Analysis Method of Teaching Evaluation Texts Based on Deep Learning in Big Data Environment

Accurate emotion analysis of teaching evaluation texts can help teachers effectively improve the quality of education and teaching. In order to improve the precision and accuracy of emotion analysis, this paper proposes an emotion recognition and analysis method based on deep learning model. First, LTP tool is used to effectively process the teaching evaluation texts data set to improve the completeness and reliability of the data. Based on bidirectional long short-term memory (BiLSTM) network, an emotion analysis model is constructed to enhance the long-term memory ability of the model, so as to learn the emotion feature information more fully. On the basis of this model, the attention interaction mechanism module is introduced to pay attention to the important information in the attribute sequence, mine the deeper emotion feature information, and further ensure the accuracy of emotion recognition of teaching evaluation texts. Experimental simulation results show that the accuracy and precision of emotion recognition of the proposed method are 0.9123 and 0.8214, which can meet the needs of accurate emotion analysis of complex teaching evaluation texts.