Reviewerly/exHarmony huggingface dataset:
Efficient shallow learning mechanism as an alternative to deep learning

Authors:
raw_author_name: Ofek Tevet
raw_affiliation_string: Department of Physics, Bar-Ilan University, Ramat-Gan 52900, Israel
raw_author_name: Ronit D. Gross
raw_affiliation_string: Department of Physics, Bar-Ilan University, Ramat-Gan 52900, Israel
raw_author_name: Shiri Hodassman
raw_affiliation_string: Department of Physics, Bar-Ilan University, Ramat-Gan 52900, Israel
raw_author_name: Yarden Tzach
raw_affiliation_string: Department of Physics, Bar-Ilan University, Ramat-Gan 52900, Israel
raw_author_name: Yuval Meir
raw_affiliation_string: Department of Physics, Bar-Ilan University, Ramat-Gan 52900, Israel
raw_author_name: Ido Kanter
raw_affiliation_string: Gonda Interdisciplinary Brain Research Center, Bar-Ilan University, Ramat-Gan 52900, Israel

Abstract: Deep learning architectures comprising tens or even hundreds of convolutional and fully-connected hidden layers differ greatly from the shallow architecture of the brain. Here, we demonstrate that by increasing the relative number of filters per layer of a generalized shallow architecture, the error rates decay as a power law to zero. Additionally, a quantitative method to measure the performance of a single filter, shows that each filter identifies small clusters of possible output labels, with additional noise selected as labels outside the clusters. This average noise per filter also decays for a given generalized architecture as a power law with an increasing number of filters per layer, forming the underlying mechanism of efficient shallow learning. The results are supported by the training of the generalized LeNet-3, VGG-5, and VGG-16 on CIFAR-100 and suggest an increase in the noise power law exponent for deeper architectures. The presented underlying shallow learning mechanism calls for its further quantitative examination using various databases and shallow architectures.
A corpus-based Japanese translation model using fuzzy semantic optimal control technique

Authors:
raw_author_name: Zhiyu Fu
raw_affiliation_string: Zhijiang College of Zhejiang University of Technology, Shaoxing, China
raw_author_name: Zhihui Fu
raw_affiliation_string: Zhejiang Business College, Hangzhou, China

Abstract: Textural translations from diverse foreign languages require reference corpora for providing error-free readability. This applies to any foreign language example English or any other language translation to Japanese. Therefore Japanese corpus repository verifies the consistency of the translated texts, words, and sentences for its readability. This article introduces a Semantic Translation Model (STM) using Fuzzy Control (FC) for supporting the aforementioned fact. The proposed model analyzes the translated word semantics based on its sentence occurrence and meaning. These two factors are analyzed using two-level fuzzy control; the first level identifies the word placement/occurrence-based readability and the second level identifies the meaning retention. If any inconsistency is observed in the first level, the second is not carried out preventing readability errors. The fuzzy control process relies on near-to-same Japanese corpus inputs for improving readability. If the case fails then a new word replacement or displacement of the semantics is enforced. Therefore the fuzzy control levels are expanded based on different word occurrences, preventing time complexity.
DiffTAD: Denoising diffusion probabilistic models for vehicle trajectory anomaly detection

Authors:
raw_author_name: Chaoneng Li
raw_affiliation_string: Xi'an Key Laboratory of Big Data and Intelligent Vision, Xidian University, Xi'an 710071, China
raw_author_name: Guanwen Feng
raw_affiliation_string: Xi'an Key Laboratory of Big Data and Intelligent Vision, Xidian University, Xi'an 710071, China
raw_author_name: Yunan Li
raw_affiliation_string: Xi'an Key Laboratory of Big Data and Intelligent Vision, Xidian University, Xi'an 710071, China
raw_author_name: Ruyi Liu
raw_affiliation_string: Xi'an Key Laboratory of Big Data and Intelligent Vision, Xidian University, Xi'an 710071, China
raw_author_name: Qiguang Miao
raw_affiliation_string: Xi'an Key Laboratory of Big Data and Intelligent Vision, Xidian University, Xi'an 710071, China
raw_author_name: Liang Chang
raw_affiliation_string: Guangxi Key Laboratory of Trusted Software, Guilin University of Electronic Technology, Guilin 541004, China

Abstract: Vehicle trajectory anomaly detection plays an essential role in the fields of traffic video surveillance, autonomous driving navigation, and taxi fraud detection. Deep generative models have been shown to be promising solutions for anomaly detection, avoiding the costs involved in manual labeling. However, existing popular generative models such as Generative Adversarial Networks (GANs) and Variational AutoEncoders (VAEs) are often plagued by training instability, mode collapse, and poor sample quality. To resolve the dilemma, we present DiffTAD, a novel vehicle trajectory anomaly detection framework based on the emerging diffusion models. DiffTAD formalizes anomaly detection as a noisy-to-normal process that progressively adds noise to the vehicle trajectory until the path is corrupted to pure Gaussian noise. The core idea of our framework is to devise deep neural networks to learn the reverse of the diffusion process and to detect anomalies by comparing the difference between a query trajectory and its reconstruction. DiffTAD is a parameterized Markov chain trained with variational inference and allows the mean square error to optimize the reweighted variational lower bound. In addition, DiffTAD integrates decoupled Transformer-based temporal and spatial encoders to model the temporal dependencies and spatial interactions among vehicles in the diffusion models. Experiments on the real-world trajectory dataset TRAFFIC demonstrate that our DiffTAD achieves significant improvements over existing state-of-the-art methods, with the maximum enhancements reaching 25.87% and 35.59% in terms of AUC and F1. While on the synthetic datasets CROSS, SynTra, and MAAD, the maximum improvements in AUC/F1 are 27.47%/38.56%, 25.38%/31.42%, and 58.22%/50.04%, respectively.
RGMU: A High-flexibility and Low-cost Reconfigurable Galois Field Multiplication Unit Design Approach for CGRCA

Authors:
raw_author_name: Yanjiang Liu
raw_affiliation_string: Information Engineering University, China

Abstract: Finite field multiplication is a non-linear transformation operator that appears in the majority of symmetric cryptographic algorithms. Numerous specified finite field multiplication units have been proposed as a fundamental module in the coarse-grained reconfigurable cipher logic array to support more cryptographic algorithms; however, it will introduce low flexibility and high overhead, resulting in reduced performance of the coarse-grained reconfigurable cipher logic array. In this article, a high-flexibility and low-cost reconfigurable Galois field multiplication unit (RGMU) is proposed to balance the tradeoffs between the function, delay, and area. All the finite field multiplication operations, including maximum distance separable matrix multiplication, parallel update of Fibonacci linear feedback shift register, parallel update of Galois linear feedback shift register, and composite field multiplication, are analyzed and two basic operation components are abstracted. Further, a reconfigurable finite field multiplication computational model is established to demonstrate the efficacy of reconfigurable units and guide the design of RGMU with high performance. Finally, the overall architecture of RGMU and two multiplication circuits are introduced. Experimental results show that the RGMU can not only reduce the hardware overhead and power consumption but also has the unique advantage of satisfying all the finite field multiplication operations in symmetric cryptography algorithms.
Modeling of Aquila Optimizer with Hybrid ResNet-DenseNet enabled Breast Cancer Classification on Histopathological Images

Authors:
raw_author_name: R.K. Chandana Mani
raw_affiliation_string: School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
raw_author_name: J. Kamalakannan
raw_affiliation_string: School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India

Abstract: Breast cancer (BC) is the most common cancer amongst women that threatens the health of women, initial diagnosis of BC becomes essential. Though there were several means to diagnose BC, the standard way is pathological analysis. Precise diagnosis of BC necessitates experienced histopathologists and needs more effort and time for completing this task. Recently, machine learning (ML) was successfully implemented in text classification, image recognition, and object recognition. With the emergence of computer aided diagnoses (CAD) technology, ML was effectively implemented for BC diagnosis. Histopathological image classification depends on deep learning (DL), particularly convolution neural network (CNN), which frequently needs a large amount of labelled training models, whereas the labelled data was hard to obtain. This study develops an Aquila Optimizer(AO) with Hybrid ResNet-DenseNet Enabled Breast Cancer Classification on Histopathological Images (AOHRD-BC2HI). The proposed AOHRD-BC2HI technique inspects the histopathological images for the diagnosis of breast cancer. To accomplish this, the presented AOHRD-BC2HI technique uses hybridization of Resnet with Densenet (HRD) model for feature extraction. Moreover, the HRD method can be enforced for feature extracting procedure in which the DenseNet (feature value memory by concatenation) and ResNet (refinement of feature value by addition) were interpreted. For BC detection and classification, the DSAE model is utilized. The AO algorithm is exploited to improve the detection performance of DSAE model. The experimental validation of the presented AOHRD-BC2HI approach is tested using benchmark dataset and the results are investigated under distinct measures.Also the proposed model achieved the accuracy of 96%. The comparative result reports the improved performance of the presented AOHRD-BC2HI technique over other recent methods.
A domain generalized person re-identification algorithm based on meta-bond domain alignment☆

Authors:
raw_author_name: Baohua Zhang
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou 014010, Inner Mongolia, China
raw_author_name: Dongyang Wu
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou 014010, Inner Mongolia, China
raw_author_name: Xiaoqi Lu
raw_affiliation_string: School of Information Engineering, Mongolia Industrial University, Huhehaote 010051, Inner Mongolia, China
raw_author_name: Yongxiang Li
raw_affiliation_string: College of Energy and Transportation Engineering, Inner Mongolia Agricultural University, Huhehaote 010051, Inner Mongolia, China
raw_author_name: Yu Gu
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou 014010, Inner Mongolia, China
raw_author_name: Jianjun Li
raw_affiliation_string: College of Energy and Transportation Engineering, Inner Mongolia Agricultural University, Huhehaote 010051, Inner Mongolia, China; School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou 014010, Inner Mongolia, China
raw_author_name: Jingyu Wang
raw_affiliation_string: School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou 014010, Inner Mongolia, China

Abstract: Domain Generalization (DG) model is an important tool to improve the robustness of person re-identification algorithm, but the domain gap makes it difficult to transfer knowledge cross-domain effectively. To solve the above problems, this paper proposes a generalization model based on a Meta-Bond Domain Alignment (M−BDA) model. To learn a generalizable model, a meta-learning strategy is introduced to simulate the training–testing process of the domain generalization. Then a bond-domain module is constructed in the training to align the source domain, which can reduce the domain gap between the source domain and the target domain, and facilitate the knowledge transfer. Finally, the bond-domain loss is counted on the feature space of the bond-domain to prevent the generated bond-domain from overfitting to the source domain. The experimental results show that the proposed algorithm achieves better performance in DukeMTMC-ReID, Market1501 and MSMT17 alternating as the source and the target domain tasks. In the generalization experiments of Market-1501 → DukeMTMC-ReID, mAP and Rank-1 increased by 7.7 % and 3.6 %, respectively, and in the generalization experiments of DukeMTMC-ReID → Market-1501, mAP and Rank-1 are increased by 9.3 % and 3.5 %, respectively, which are significantly better than the newer representative algorithms.
A physics-oriented shadowgraph motion estimation algorithm for turbulent flow structures

Authors:
raw_author_name: Qian Wang
raw_affiliation_string: School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

Abstract: Shadowgraph imaging is a simple, cost-effective, and non-invasive technique for visualizing strong gradients in transparent medium. This paper developed a shadowgraph motion estimation algorithm to resolve dense motion fields for turbulent flow structures. The algorithm inherits the framework of the optical flow method, which resolves the two-dimensional velocity vectors from two basic constraints using optimization techniques. In the current motion estimation scheme, a physics-oriented constraint is derived from the optical equation of shadowgraph imaging and the fluid continuity equation, while the other constraint adopts a second-order div-curl equation. The improved constraints are specifically suitable for shadowgraph imaging, which can resolve more accurate estimations. An energy function is constructed with the two constraints, and the velocity components are solved by minimizing the energy function. Several state-of-the-art optimization techniques are adopted, including multi-resolution pyramids, weighted median filter and graduated non-convex algorithms. The algorithm is applied to two test conditions covering a wide velocity range, including an acoustic excited premixed flame and a sonic jet. The comparison to Horn–Schunck optical flow indicates that the current algorithm is able to resolve more details of the turbulent flow field, and the velocity shows better continuity. The proposed algorithm has great potential for motion estimation based on shadowgraph images in high speed turbulent flow and combustion research.
Entropy Computation for Oscillator-based Physical Random Number Generators

Authors:
raw_author_name: Viktor Fischer
raw_affiliation_string: Laboratoire Hubert Curien; Université Jean Monnet - Saint-Étienne

Abstract: Abstract In this paper, we provide a complete set of algorithms aimed at the design and security evaluation of oscillator-based True Random Number Generators (TRNG). While depending on some TRNG design assumptions, the proposed algorithms use as inputs the statistical parameters of the underlying random physical process such as the clock jitter originating from the thermal noise and give a lower bound of the entropy rate of the generated bit stream as output. We describe the general structure of a TRNG composed of multiple free-running oscillators and samplers, the outputs of which are post-processed by an entropy conditioner. Depending on the specification of the entropy conditioner, which can usually be any Boolean function, we describe several algorithmic optimizations. We then explain how to compute and efficiently manage the entropy rate at the output of such a post-processing block and at the output of the generator as a whole.
Subspace learning machine (SLM): Methodology and performance evaluation

Authors:
raw_author_name: Vinod K. Mishra
raw_affiliation_string: Army Research Laboratory, Adelphi, MD, USA
raw_author_name: C.-C. Jay Kuo
raw_affiliation_string: University of Southern California, Los Angeles, CA, USA

Abstract: Inspired by the feedforward multilayer perceptron (FF-MLP), decision tree (DT) and extreme learning machine (ELM), a new classification model, called the subspace learning machine (SLM), is proposed in this work. SLM first identifies a discriminant subspace, S0, by examining the discriminant power of each input feature. Then, it uses probabilistic projections of features in S0 to yield 1D subspaces and finds the optimal partition for each of them. This is equivalent to partitioning S0 with hyperplanes. A criterion is developed to choose the best q partitions that yield 2q partitioned subspaces among them. We assign S0 to the root node of a decision tree and the intersections of 2q subspaces to its child nodes of depth one. The partitioning process is recursively applied at each child node to build an SLM tree. When the samples at a child node are sufficiently pure, the partitioning process stops and each leaf node makes a prediction. The idea can be generalized to regression, leading to the subspace learning regressor (SLR). Furthermore, ensembles of SLM/SLR trees can yield a stronger predictor. Extensive experiments are conducted for performance benchmarking among SLM/SLR trees, ensembles and classical classifiers/regressors.
Integrating subsystem embedding subalgebras and coupled cluster Green’s function: a theoretical foundation for quantum embedding in excitation manifold

Authors:
raw_author_name: Bo Peng
raw_affiliation_string: Physical and Computational Science Division, Pacific Northwest National Laboratory, 902 Battelle Blvd, Richland, Washington, 99352, UNITED STATES
raw_author_name: Karol Kowalski
raw_affiliation_string: Physical and Computational Science Division, Pacific Northwest National Laboratory, 902 Battelle Blvd, Richland, Washington, 99352, UNITED STATES

Abstract: Abstract In this study, we introduce a novel approach to coupled-cluster Green’s function (CCGF) embedding by seamlessly integrating conventional CCGF theory with the state-of-the-art sub-system embedding sub-algebras coupled cluster (SES-CC) formalism. This integration focuses primarily on delineating the characteristics of the sub-system and the corresponding segments of the Green’s function, defined explicitly by active orbitals. Crucially, our work involves the adaptation of the SES-CC paradigm, addressing the left eigenvalue problem through a distinct form of Hamiltonian similarity transformation. This advancement not only facilitates a comprehensive representation of the interaction between the embedded sub-system and its surrounding environment but also paves the way for the quantum mechanical description of multiple embedded domains, particularly by employing the emergent quantum flow algorithms. Our theoretical underpinnings further set the stage for a generalization to multiple embedded sub-systems. This expansion holds significant promise for the exploration and application of non-equilibrium quantum systems, enhancing the understanding of system–environment interactions. In doing so, the research underscores the potential of SES-CC embedding within the realm of quantum computations and multi-scale simulations, promising a good balance between accuracy and computational efficiency.
Multi-Task Learning with Sequential Dependence Toward Industrial Applications: A Systematic Formulation

Authors:
raw_author_name: Xiaobo Guo
raw_affiliation_string: Institute of Information Science, Beijing Jiaotong University and Data Management Department, China Minsheng Bank, Beijing, China
raw_author_name: Mingming Ha
raw_affiliation_string: Institute of Artificial Intelligence and School of Intelligence Science and Technology, University of Science and Technology Beijing and MYbank, Ant Group, Beijing, China
raw_author_name: Xuewen Tao
raw_affiliation_string: MYbank, Ant Group, Beijing, China
raw_author_name: Shaoshuai Li
raw_affiliation_string: MYbank, Ant Group, Beijing, China
raw_author_name: Youru Li
raw_affiliation_string: Institute of Information Science, Beijing Jiaotong University, Beijing, China
raw_author_name: Zhenfeng Zhu
raw_affiliation_string: Institute of Information Science, Beijing Jiaotong University, Beijing, China
raw_author_name: Li Ma
raw_affiliation_string: Legal Affairs and Compliance Department, China Minsheng Bank, Beijing, China

Abstract: Multi-task learning (MTL) is widely used in the online recommendation and financial services for multi-step conversion estimation, but current works often overlook the sequential dependence among tasks. In particular, sequential dependence multi-task learning (SDMTL) faces challenges in dealing with complex task correlations and extracting valuable information in real-world scenarios, leading to negative transfer and a deterioration in the performance. Herein, a systematic learning paradigm of the SDMTL problem is established for the first time, which applies to more general multi-step conversion scenarios with longer conversion paths or various task dependence relationships. Meanwhile, an SDMTL architecture, named Task-Aware Feature Extraction (TAFE), is designed to enable the dynamic task representation learning from a sample-wise view. TAFE selectively reconstructs the implicit shared information corresponding to each sample case and performs the explicit task-specific extraction under dependence constraints, which can avoid the negative transfer, resulting in more effective information sharing and joint representation learning. Extensive experiment results demonstrate the effectiveness and applicability of the proposed theoretical and implementation frameworks. Furthermore, the online evaluations at MYbank showed that TAFE had an average increase of 9.22% and 3.76% in various scenarios on the post-view click-through &amp; conversion rate (CTCVR) estimation task. Currently, TAFE is deployed in an online platform to provide various traffic services.