Reviewerly/exHarmony huggingface dataset:
Improvements to adversarial training for text classification tasks

Authors:
raw_author_name: Jia-long he
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, China
raw_author_name: Xiao-Lin zhang
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, China
raw_author_name: Yong-Ping wang
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, China
raw_author_name: Li-xin liu
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, China
raw_author_name: En-Hui xu
raw_affiliation_string: China Nanhu Academy of Electronics and Information Technology, Jiaxing, China

Abstract: Although deep learning models show powerful performance, they are still easily deceived by adversarial samples. Some methods for generating adversarial samples have the drawback of high time loss, which is problematic for adversarial training, and the existing adversarial training methods are difficult to adapt to the dynamic nature of the model, so it is still challenging to study an efficient adversarial training method. In this paper, we propose an adversarial training method, the core of which is the improved adversarial sample generation method AGFAT for adversarial training and the improved dynamic adversarial training method AGFAT-DAT. AGFAT uses a word frequency-based approach to identify significant words, filter replacement candidates, and use an efficient semantic constraint module as a means to reduce the time of adversarial sample generation; AGFAT-DAT is a dynamic adversarial training approach that uses a cyclic attack on the model after adversarial training and generates adversarial samples for adversarial training again. It is demonstrated that the proposed method can significantly reduce the generation time of adversarial samples, and the adversarial-trained model can also effectively defend against other types of word-level adversarial attacks.
AVID: A speech database for machine learning studies on vocal intensity

Authors:
raw_author_name: Paavo Alku
raw_affiliation_string: Department of Information and Communications Engineering, Aalto University, Finland
raw_author_name: Manila Kodali
raw_affiliation_string: Department of Information and Communications Engineering, Aalto University, Finland
raw_author_name: Sudarsana Reddy Kadiri
raw_affiliation_string: Department of Information and Communications Engineering, Aalto University, Finland

Abstract: Vocal intensity, which is quantified typically with the sound pressure level (SPL), is a key feature of speech. To measure SPL from speech recordings, a standard calibration tone (with a reference SPL of 94 dB or 114 dB) needs to be recorded together with speech. However, most of the popular databases that are used in areas such as speech and speaker recognition have been recorded without calibration information by expressing speech on arbitrary amplitude scales. Therefore, information about vocal intensity of the recorded speech, including SPL, is lost. In the current study, we introduce a new open and calibrated speech/electroglottography (EGG) database named Aalto Vocal Intensity Database (AVID). AVID includes speech and EGG produced by 50 speakers (25 males, 25 females) who varied their vocal intensity in four categories (soft, normal, loud and very loud). Recordings were conducted using a constant mouth-to-microphone distance and by recording a calibration tone. The speech data was labelled sentence-wise using a total of 19 labels that support the utilisation of the data in machine learing (ML) -based studies of vocal intensity based on supervised learning. In order to demonstrate how the AVID data can be used to study vocal intensity, we investigated one multi-class classification task (classification of speech into soft, normal, loud and very loud intensity classes) and one regression task (prediction of SPL of speech). In both tasks, we deliberately warped the level of the input speech by normalising the signal to have its maximum amplitude equal to 1.0, that is, we simulated a scenario that is prevalent in current speech databases. The results show that using the spectrogram feature with the support vector machine classifier gave an accuracy of 82% in the multi-class classification of the vocal intensity category. In the prediction of SPL, using the spectrogram feature with the support vector regressor gave an mean absolute error of about 2 dB and a coefficient of determination of 92%. We welcome researchers interested in classification and regression problems to utilise AVID in the study of vocal intensity, and we hope that the current results could serve as baselines for future ML studies on the topic.
Single image super-resolution based on Bendlets analysis and structural dictionary learning

Authors:
raw_author_name: Kexin Meng
raw_affiliation_string: College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
raw_author_name: Min Zhao
raw_affiliation_string: College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China
raw_author_name: Piercarlo Cattani
raw_affiliation_string: Department of Computer, Control and Management Engineering, University of Rome “La Sapienza”, Roma 00185, Italy

Abstract: High-resolution biological tissue slice images provide opportunities for more precise observation and analysis of histopathological features. These images typically consist of enclosed contours, and Bendlets transform is an effective means to approximate such structures. In this study, we leverage Bendlet transform to incorporate multi-level image data, thereby establishing a multi-scale pyramid feature set. This approach aids in achieving a sparser representation of image textures and structures. We apply Bendlets transform to extract multi-frequency wavelet subband features and formulate structured dictionaries for both high and low resolutions based on these features. After creating these dictionaries, we compute sparse representation coefficients using the low-resolution dictionary and subsequently integrate them with the high-resolution dictionary to generate high-resolution subbands. Ultimately, through the process of inverse wavelet transformation, we completed the reconstruction of high-resolution images. This method not only significantly enhances the restoration of image details and clarity but also effectively preserves the overall structural characteristics of the original images.
Color crosstalk compensation method for color phase-shifting fringe projection profilometry based on phase correction matrix

Authors:
raw_author_name: Bin Liu
raw_affiliation_string: Tsinghua University
raw_author_name: Chunliu Wang
raw_author_name: Guanhao Wu
raw_affiliation_string: Tsinghua University

Abstract: Color phase-shifting fringe projection profilometry is one of the single-shot three-dimensional shape measurement techniques. The color crosstalk of the projector-camera system yields undesired phase errors when using phase-shifting method. In this paper, a color crosstalk compensation method based on phase correction matrix is proposed. In this method, the phase correction matrix is established to compensate the deviations between the actual phase-shift values in the acquired fringes and the standard ones in the ideal fringes. Only two fringe patterns are utilized to obtain the phase correction matrix. The quadratic equations for calculating the actual phase-shift values of the fringes in the three color channels are derived. The actual phase-shift values and the corresponding standard ones are employed to form the equilibrium equations for computing the phase correction coefficients in the matrix. Experimental results demonstrate the feasibility of the proposed method and it can effectively reduce the induced overall phase error caused by the color crosstalk.
RANGO: A Novel Deep Learning Approach to Detect Drones Disguising from Video Surveillance Systems

Authors:
raw_author_name: Jin Han
raw_affiliation_string: College of Computer Science and Engineering Shandong University of Science and Technology, Qingdao, China
raw_author_name: Yun-feng Ren
raw_affiliation_string: College of Computer Science and Engineering Shandong University of Science and Technology, Qingdao, China
raw_author_name: Alessandro Brighente
raw_affiliation_string: Department of Mathematics, University of Padova, Padua, Italy
raw_author_name: Mauro Conti
raw_affiliation_string: Department of Mathematics, University of Padova, Padua, Italy

Abstract: Video surveillance systems provide means to detect the presence of potentially malicious drones in the surroundings of critical infrastructures. In particular, these systems collect images and feed them to a deep-learning classifier able to detect the presence of a drone in the input image. However, current classifiers are not efficient in identifying drones that disguise themselves with the image background, e.g., hiding in front of a tree. Furthermore, video-based detection systems heavily rely on the image’s brightness, where darkness imposes significant challenges in detecting drones. Both these phenomena increase the possibilities for attackers to get close to critical infrastructures without being spotted and hence be able to gather sensitive information or cause physical damages, possibly leading to safety threats. In this article, we propose RANGO, a drone detection arithmetic able to detect drones in challenging images where the target is difficult to distinguish from the background. RANGO is based on a deep learning architecture that exploits a Preconditioning Operation (PREP) that highlights the target by the difference between the target gradient and the background gradient. The idea is to highlight features that will be useful for classification. After PREP, RANGO uses multiple convolution kernels to make the final decision on the presence of the drone. We test RANGO on a drone image dataset composed of multiple already-existing datasets to which we add samples of birds and planes. We then compare RANGO with multiple currently existing approaches to show its superiority. When tested on images with disguising drones, RANGO attains an increase of 6.6% mean Average Precision (mAP) compared to YOLOv5 solution. When tested on the conventional dataset, RANGO improves the mAP by approximately 2.2%, thus confirming its effectiveness also in the general scenario.
Multimodal consistency-specificity fusion based on information bottleneck for sentiment analysis

Authors:
raw_author_name: Wei Liu
raw_affiliation_string: School of Management Science and Engineering, Anhui University of Finance & Economics, Bengbu, 233030, China
raw_author_name: Sun Zhang
raw_affiliation_string: School of Management Science and Engineering, Anhui University of Finance & Economics, Bengbu, 233030, China

Abstract: Sentiment analysis, a subtask of affective computing, endows machines with the ability to sense and comprehend emotions. Recently, research attention has shifted from traditional isolated modality to ubiquitous multi-modalities, requiring to model the complex relationships between modalities and extract the task-relevant information. However, current methods only focus on modality consistency neglecting the complementary relationship and specificity information within each modality. Furthermore, most studies regard multimodal fusion as a mere process of information integration without considering the control of information flow. We propose a variational model that explicitly decomposes unimodal representations into two types, capturing consistency and specificity information, respectively. Following the information bottleneck principle, the implementation optimizes the fusion representation by maximizing its mutual information with consistency and specificity representations while minimizing mutual information with raw inputs. With information integrity constraints and task label supervision, the fusion representation preserves task-relevant information and discards irrelevant noise. Finally, quantitative and qualitative experiments on two benchmark datasets show that our method achieves competitive performance compared to recent baselines, for multimodal sentiment analysis.
DRC: Chromatic aberration intensity priors for underwater image enhancement

Authors:
raw_author_name: Qian Liu
raw_affiliation_string: Dalian Maritime University, College of Information Science and Technology, Dalian, 116026, China
raw_author_name: Zongxin He
raw_affiliation_string: Huizhou University, College of Computer Science and Technology, Hui Zhou, 516007, China
raw_author_name: Dehuan Zhang
raw_affiliation_string: Dalian Maritime University, College of Information Science and Technology, Dalian, 116026, China
raw_author_name: Weishi Zhang
raw_affiliation_string: Dalian Maritime University, College of Information Science and Technology, Dalian, 116026, China
raw_author_name: Zifan Lin
raw_affiliation_string: Department of Electrical and Electronic Engineering, University of Western Australia, Perth, WA6009, Australia
raw_author_name: Ferdous Sohel
raw_affiliation_string: School of Information Technology, Murdoch University, Murdoch, WA6150, Australia

Abstract: Underwater imaging technology is a crucial tool for monitoring marine flora and fauna. However, selective light absorption and scattering properties of water make underwater imagery frequently appear blurred and exhibit color biases, hindering the extraction of vital aquacultural insights. To address this challenge, we propose a method, namely DRC, which is a holistic approach to enhancing underwater image clarity and color fidelity. This method comprises three integral components: D-procedure, R-procedure, and C-procedure. The D-procedure intricately accounts for the trichromatic underwater attenuation dynamics, formulating a chromatic aberration intensity prior. This prior counters the disparities in degradation levels seen in conventional single-channel prior depth estimations, achieving a dynamic depth representation approaching binocular image precision. The R-procedure, utilizing an adaptive dark-pixel prior, pinpoints corresponding points across varied depth zones to counteract backscattering, thereby mitigating the image's hazy appearance. The C-procedure bolsters image luminance and color fidelity through opponent channel rectification and amalgamates pronounced image contrasts and intricate details via Gaussian pyramid fusion. The method was tested on several publicly available datasets and compared with nine popular underwater image enhancement techniques. Both subjective and objective assessments underscore the superiority of our DRC method over existing underwater image enhancement techniques.
Adaptive knowledge distillation and integration for weakly supervised referring expression comprehension

Authors:
raw_author_name: Jinpeng Mi
raw_affiliation_string: Institute of Machine Intelligence, University of Shanghai for Science and Technology, China
raw_author_name: Stefan Wermter
raw_affiliation_string: Knowledge Technology, Department of Informatics, University of Hamburg, Germany
raw_author_name: Jianwei Zhang
raw_affiliation_string: Technical Aspects of Multimodal Systems, Department of Informatics, University of Hamburg, Germany

Abstract: Weakly supervised referring expression comprehension (REC) aims to ground target objects in images according to given referring expressions, while the mappings between image regions and referring expressions are unavailable during the model training phase. Existing models typically reconstruct the multimodal relationships to ground targets by utilizing off-the-shelf information, and ignore to further exploit helpful knowledge to enhance the model performance. To address this issue, we propose an adaptive knowledge distillation architecture to enrich the predominant pattern of weakly supervised REC and transfer the target-aware and interaction-aware knowledge from a pre-trained teacher grounder to enhance the grounding performance of the student model. Specifically, in order to encourage the teacher to impart more reliable knowledge, we present a Knowledge Confidence-Based Adaptive Temperature (KCAT) learning approach to learn optimal temperatures to transfer the target-aware and interaction-aware knowledge with higher prediction confidence. Moreover, to urge the student to absorb more helpful knowledge, we introduce a Student Competency-Based Adaptive Weight (SCAW) learning strategy to dynamically integrate the distilled target-aware and interaction-aware knowledge to enhance the student's grounding certainty. We conduct extensive experiments on three benchmark datasets, RefCOCO, RefCOCO+, and RefCOCOg, to validate the proposed approach. Experimental results demonstrate that our approach achieves superior performance over state-of-the-art methods with the aid of adaptive knowledge distillation and integration. The code and trained models are available at: https://github.com/dami23/WREC_AdaptiveKD.
MFQS: Multichannel Floating-Point Quantum Representation of Digital Signals

Authors:
raw_author_name: Meiyu Xu
raw_affiliation_string: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China
raw_author_name: Youlin Shang
raw_affiliation_string: School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471000, China

Abstract: A novel multichannel floating-point quantum representation of digital signals (or simply MFQS) is proposed in this paper. The MFQS model uses three entangled qubit sequences where real amplitude values, channel, and position can be stored. The amplitude is represented by a (p + q)-bit floating-point number based on the Institute of Electrical and Electronics Engineers (IEEE-754) standard, including one sign qubit, p qubits exponent, and q − 1 qubits mantissa. We present two MFQS models including 1D signals (MFQS1 model) and 2D signals (MFQS2 model), and give the model preparation procedure and the corresponding complexity analysis. In addition, the MFQS model provides some operations, including signal merging, addition, reversal, and channel merging, swap, and reversal. Then, we design the quantum circuits that manipulate these basic operations, which provide the necessary building blocks for future applications of quantum signal processing. Compared to available quantum signal representations, the proposed MFQS provides highly accurate predictions in many real-world scenarios.
Sampling Cardinality-Based Feature Models

Authors:
raw_author_name: Ina Schaefer
raw_affiliation_string: TVA, Karlsruhe Institute of Technology, Germany
raw_author_name: Malte Lochau
raw_affiliation_string: MBE, University of Siegen, Germany

Abstract: The goal of sample-based testing of variant-rich software systems is to reduce usually very large configuration spaces to significantly smaller, yet still representative subsets of configurations to be tested for quality assurance. Recent sampling techniques and tools are restricted to finite-dimensional, Boolean configuration spaces specified by a feature model. However, in many modern application domains like cloud computing and cyber-physical systems, customers not only decide about the presence or absence of features in a configuration but also about the multiplicity (number of instances) of configurable resources. Cardinality-based feature models extend Boolean feature models by cardinality annotations and respective constraints to enable multiple, and even potentially a-priori unbounded, copies of features and their respective sub-trees. The resulting infinite and inherently non-convex configuration spaces are no longer tractable by established sampling criteria and corresponding sampling algorithms for Boolean feature models like pairwise feature interaction coverage. In this paper, we first revisit the subtleties of the configuration semantics of cardinality-based feature models. We propose novel sampling criteria explicitly taking multiplicity of feature selections into account. Finally, we present evaluation results gained from applying our tool implementation to a collection of example models, showing applicability of the proposed approach.
From Decision Models To User-Guiding Configurators Using SMT

Authors:
raw_author_name: Martina Seidl
raw_affiliation_string: Institute for Symbolic Artificial Intelligence, Johannes Kepler University, Austria

Abstract: As decision models for the correct derivation of customizable products grow ever more complex, user-facing configurators are developed to manage this complexity by emulating the models as closely as possible. By design, decision models closely resemble the structures of configurators. Therefore, a classical configurator that implements a decision model often copies the model's (linear) ordering of decisions. To enable users to jump into arbitrary points of a decision model, non-linear analysis is necessary. We present a novel way of automatically encoding a complex decision model into Satisfiability Modulo Theories (SMT) formulas, which are then solved by an SMT solver. Users interact with a configurator front-end, which internally calls an incremental SMT solver that returns open choices. In this paper, we present the architecture of our framework, introduce a general direct SMT encoding of decision models, and illustrate with a small case study the potential of our approach for product configuration and reconfiguration. Our approach successfully converts a legacy ordered decision model from an industrial application into a fully interactive configurator.
UnWise: High T-Wise Coverage from Uniform Sampling

Authors:
raw_author_name: Tobias Heß
raw_affiliation_string: Institute of Software Engineering and Programming Languages, University of Ulm, Germany
raw_author_name: Sebastian Krieter
raw_affiliation_string: Institute of Software Engineering and Programming Languages, University of Ulm, Germany
raw_author_name: Thomas Thüm
raw_affiliation_string: Institute of Software Engineering and Programming Languages, University of Ulm, Germany

Abstract: Configuration spaces of industrial product lines are typically too large to be tested exhaustively. Therefore, testing in practice is often carried out on samples, sets of configurations which satisfy the requirements of the testing scenario. For t-wise sampling, the objective is to cover all t-wise interactions between configurable options with as few configurations as possible. However, a trade-off needs to be made between t, sampling time, sample size, and achieved coverage. In addition, it is infeasible for larger systems to even compute the set of all 2-wise interactions in practicable time. In this work, we reevaluate the performance of uniform samplers in terms of 2-wise coverage and come to a more positive result than previous research. We also present completion and reduction algorithms that greatly improve said performance. As a baseline for comparison, we additionally evaluate the two state-of-the-art dedicated t-wise samplers Baital and YASA. In doing so, we are the first to evaluate and compare these samplers on a large set of industrial feature models.