pwc-archive/papers-with-abstracts huggingface dataset:
Multi-Task Learning to Enhance Generalizability of Neural Network Equalizers in Coherent Optical Systems
Authors: Sasipim Srivallapanondh, Pedro J. Freire, Ashraful Alam, Nelson Costa, Bernhard Spinnler, Antonio Napoli, Egor Sedov, Sergei K. Turitsyn, Jaroslaw E. Prilepsky
Date: 2023-07-04 00:00:00
Tasks: Multi-Task Learning

For the first time, multi-task learning is proposed to improve the flexibility of NN-based equalizers in coherent systems. A "single" NN-based equalizer improves Q-factor by up to 4 dB compared to CDC, without re-training, even with variations in launch power, symbol rate, or transmission distance.
SleepEGAN: A GAN-enhanced Ensemble Deep Learning Model for Imbalanced Classification of Sleep Stages
Authors: Xuewei Cheng, Ke Huang, Yi Zou, Shujie Ma
Date: 2023-07-04 00:00:00
Tasks: Automatic Sleep Stage Classification, Classification, Data Augmentation, EEG, Ensemble Learning, Generative Adversarial Network, imbalanced classification

Deep neural networks have played an important role in automatic sleep stage classification because of their strong representation and in-model feature transformation abilities. However, class imbalance and individual heterogeneity which typically exist in raw EEG signals of sleep data can significantly affect the classification performance of any machine learning algorithms. To solve these two problems, this paper develops a generative adversarial network (GAN)-powered ensemble deep learning model, named SleepEGAN, for the imbalanced classification of sleep stages. To alleviate class imbalance, we propose a new GAN (called EGAN) architecture adapted to the features of EEG signals for data augmentation. The generated samples for the minority classes are used in the training process. In addition, we design a cost-free ensemble learning strategy to reduce the model estimation variance caused by the heterogeneity between the validation and test sets, so as to enhance the accuracy and robustness of prediction performance. We show that the proposed method can improve classification accuracy compared to several existing state-of-the-art methods using three public sleep datasets.
Using BOLD-fMRI to Compute the Respiration Volume per Time (RTV) and Respiration Variation (RV) with Convolutional Neural Networks (CNN) in the Human Connectome Development Cohort
Authors: Abdoljalil Addeh, Fernando Vega, Rebecca J Williams, Ali Golestani, G. Bruce Pike, M. Ethan MacDonald
Date: 2023-07-03 00:00:00

In many fMRI studies, respiratory signals are unavailable or do not have acceptable quality. Consequently, the direct removal of low-frequency respiratory variations from BOLD signals is not possible. This study proposes a one-dimensional CNN model for reconstruction of two respiratory measures, RV and RVT. Results show that a CNN can capture informative features from resting BOLD signals and reconstruct realistic RV and RVT timeseries. It is expected that application of the proposed method will lower the cost of fMRI studies, reduce complexity, and decrease the burden on participants as they will not be required to wear a respiratory bellows.
Wearable-based Fair and Accurate Pain Assessment Using Multi-Attribute Fairness Loss in Convolutional Neural Networks
Authors: Yidong Zhu, Shao-Hsien Liu, Mohammad Arif Ul Alam
Date: 2023-07-03 00:00:00
Tasks: Attribute, Fairness

The integration of diverse health data, such as IoT (Internet of Things), EHR (Electronic Health Record), and clinical surveys, with scalable AI(Artificial Intelligence) has enabled the identification of physical, behavioral, and psycho-social indicators of pain. However, the adoption of AI in clinical pain evaluation is hindered by challenges like personalization and fairness. Many AI models, including machine and deep learning, exhibit biases, discriminating against specific groups based on gender or ethnicity, causing skepticism among medical professionals about their reliability. This paper proposes a Multi-attribute Fairness Loss (MAFL) based Convolutional Neural Network (CNN) model designed to account for protected attributes in data, ensuring fair pain status predictions while minimizing disparities between privileged and unprivileged groups. We evaluate whether a balance between accuracy and fairness is achievable by comparing the proposed model with existing mitigation methods. Our findings indicate that the model performs favorably against state-of-the-art techniques. Using the NIH All-Of-US dataset, comprising data from 868 individuals over 1500 days, we demonstrate our model's effectiveness, achieving accuracy rates between 75% and 85%.
Classification of sleep stages from EEG, EOG and EMG signals by SSNet
Authors: Haifa Almutairi, Ghulam Mubashar Hassan, Amitava Datta
Date: 2023-07-03 00:00:00
Tasks: Deep Learning, EEG, Electroencephalogram (EEG)

Classification of sleep stages plays an essential role in diagnosing sleep-related diseases including Sleep Disorder Breathing (SDB) disease. In this study, we propose an end-to-end deep learning architecture, named SSNet, which comprises of two deep learning networks based on Convolutional Neuron Networks (CNN) and Long Short Term Memory (LSTM). Both deep learning networks extract features from the combination of Electrooculogram (EOG), Electroencephalogram (EEG), and Electromyogram (EMG) signals, as each signal has distinct features that help in the classification of sleep stages. The features produced by the two-deep learning networks are concatenated to pass to the fully connected layer for the classification. The performance of our proposed model is evaluated by using two public datasets Sleep-EDF Expanded dataset and ISRUC-Sleep dataset. The accuracy and Kappa coefficient are 96.36% and 93.40% respectively, for classifying three classes of sleep stages using Sleep-EDF Expanded dataset. Whereas, the accuracy and Kappa coefficient are 96.57% and 83.05% respectively for five classes of sleep stages using Sleep-EDF Expanded dataset. Our model achieves the best performance in classifying sleep stages when compared with the state-of-the-art techniques.
Protecting the Future: Neonatal Seizure Detection with Spatial-Temporal Modeling
Authors: Ziyue Li, Yuchen Fang, You Li, Kan Ren, Yansen Wang, Xufang Luo, Juanyong Duan, Congrui Huang, Dongsheng Li, Lili Qiu
Date: 2023-07-02 00:00:00
Tasks: EEG, Electroencephalogram (EEG), Seizure Detection

A timely detection of seizures for newborn infants with electroencephalogram (EEG) has been a common yet life-saving practice in the Neonatal Intensive Care Unit (NICU). However, it requires great human efforts for real-time monitoring, which calls for automated solutions to neonatal seizure detection. Moreover, the current automated methods focusing on adult epilepsy monitoring often fail due to (i) dynamic seizure onset location in human brains; (ii) different montages on neonates and (iii) huge distribution shift among different subjects. In this paper, we propose a deep learning framework, namely STATENet, to address the exclusive challenges with exquisite designs at the temporal, spatial and model levels. The experiments over the real-world large-scale neonatal EEG dataset illustrate that our framework achieves significantly better seizure detection performance.
Analysis of a competitive respiratory disease system with quarantine
Authors: Anna Daniel Fome, Wolfgang Bock, Axel Klar
Date: 2023-07-11 00:00:00

In the world of epidemics, the mathematical modeling of disease co-infection is gaining importance due to its contributions to mathematics and public health. Because the co-infection may have a double burden on families, countries, and the universe, understanding its dynamics is paramount. We study a SEIQR (susceptible-exposed-infectious-quarantined-recovered) deterministic epidemic model with a single host population and multiple strains (-$c$ and -$i$) to account for two competitive diseases with quarantine effects. To model the role of quarantine and isolation efficacy in disease dynamics, we utilize a linear function. Further, we shed light on the standard endemic threshold and determine the conditions for extinction or coexistence with and without forming co-infection. Next, we show the dependence of the criticality based on specific parameters of the different pathogens. We found that the disease-free equilibrium (DFE) of the single-strain model always exists and is globally asymptotically stable (GAS) if $\tilde{\mathcal{R}}_k^q\leq 1$, else, a stable endemic equilibrium. On top of that, the model has forward bifurcation at $\tilde{\mathcal{R}}_k^q = 1$. In the case of a two-strain model, the strain with a large reproduction number outcompetes the one with a smaller reproduction number. Further, if the co-infected quarantine reproduction number is less than one, the infections of already infected individuals will die out, and co-infection will persist in the population otherwise. We note that the quarantine and isolation of exposed and infected individuals will reduce the number of secondary cases below one, consequently reducing the disease complications if the total number of people in the quarantine is at most the critical value.
Root Causal Inference from Single Cell RNA Sequencing with the Negative Binomial
Authors: Eric V. Strobl
Date: 2023-07-10 00:00:00
Tasks: Causal Inference

Accurately inferring the root causes of disease from sequencing data can improve the discovery of novel therapeutic targets. However, existing root causal inference algorithms require perfectly measured continuous random variables. Single cell RNA sequencing (scRNA-seq) datasets contain large numbers of cells but non-negative counts measured by an error prone process. We therefore introduce an algorithm called Root Causal Inference with Negative Binomials (RCI-NB) that accounts for count-based measurement error by separating negative binomial distributions into their gamma and Poisson components; the gamma distributions form a fully identifiable but latent post non-linear causal model representing the true RNA expression levels, which we only observe with Poisson corruption. RCI-NB identifies patient-specific root causal contributions from scRNA-seq datasets by integrating novel sparse regression and goodness of fit testing procedures that bypass Poisson measurement error. Experiments demonstrate significant improvements over existing alternatives.
The Role of Schwartz Measures in Human Tri-Color Vision
Authors: M. L. Sloan
Date: 2023-06-22 00:00:00

The human tri-color vision process may be characterized as follows: 1. A requirement of three scalar quantities to fully define a color (for example, intensity, hue, and purity), with 2. These scalar measures linear in the intensity of the incident light, allowing in general any specific color to be duplicated by an additive mixture of light from three standardized (basis) colors, 3. The exception being that the spectral colors are unique, in that they cannot be duplicated by any positive mixture of other colors. These characteristics strongly suggest that human color vision makes use of Schwartz measures in processing color data. This hypothesis is subject to test. In this brief paper, the results of this hypothesis are shown to be in good agreement with measured data.
Parameter and coupling estimation in small groups of Izhikevich neurons
Authors: R. P. Aristides, A. J. Pons, H. A. Cerdeira, C. Masoller, G. Tirabass
Date: 2023-06-16 00:00:00

Nowadays, experimental techniques allow scientists to have access to large amounts of data. In order to obtain reliable information from the complex systems which produce these data, appropriate analysis tools are needed}. The Kalman filter is a {frequently used} technique to infer, assuming a model of the system, the parameters of the model from uncertain observations. A well-known implementation of the Kalman filter, the Unscented Kalman filter (UKF), was recently shown to be able to infer the connectivity of a set of coupled chaotic oscillators. {I}n this work, we test whether the UKF can also reconstruct the connectivity of {small groups of} coupled neurons when their links are either electrical or chemical {synapses}. {In particular, w}e consider Izhikevich neurons, and aim to infer which neurons influence each other, considering {simulated spike trains as the experimental observations used by the UKF}. First, we {verify} that the UKF can recover the parameters of a single neuron, even when the parameters vary in time. Second, we analyze small neural ensembles and}} demonstrate that the UKF allows inferring the connectivity between the neurons, even for heterogeneous, directed, and {temporally evolving} networks. {Our results show that time-dependent parameter and coupling estimation is possible in this nonlinearly coupled system.
Explicit mathematical epidemiology results on age renewal kernels and R0 formulas are often consequences of the rank one property of the next generation matrix
Authors: Florin Avram, Rim Adenane, Dan Goreac, Andrei Halanay
Date: 2023-07-09 00:00:00
Tasks: Epidemiology

A very large class of ODE epidemic models (2.2) discussed in this paper enjoys the property of admitting also an integral renewal formulation, with respect to an "age of infection kernel" a(t) which has a matrix exponential form (3.2). We observe first that a very short proof of this fact is available when there is only one susceptible compartment, and when its associated "new infections" matrix has rank one. In this case, a(t) normalized to have integral 1, is precisely the probabilistic law which governs the time spent in all the "infectious states associated to the susceptible compartment", and the normalization is precisely the basic replacement number. The Laplace transform (LT) of a(t) is a generalization of the basic replacement number, and its structure reflects the laws of the times spent in each infectious state. Subsequently, we show that these facts admit extensions to processes with several susceptible classes, provided that all of them have a new infections matrix of rank one. These results reveal that the ODE epidemic models highlighted below have also interesting probabilistic properties.
Measuring Cause-Effect with the Variability of the Largest Eigenvalue
Authors: Alejandro Rodriguez Dominguez, Irving Ramirez Carrillo, David Parraga Riquelme
Date: 2023-07-11 00:00:00
Tasks: Time Series

We present a method to test and monitor structural relationships between time variables. The distribution of the first eigenvalue for lagged correlation matrices (Tracy-Widom distribution) is used to test structural time relationships between variables against the alternative hypothesis (Independence). This distribution studies the asymptotic dynamics of the largest eigenvalue as a function of the lag in lagged correlation matrices. By analyzing the time series of the standard deviation of the greatest eigenvalue for $2\times 2$ correlation matrices with different lags we can analyze deviations from the Tracy-Widom distribution to test structural relationships between these two time variables. These relationships can be related to causality. We use the standard deviation of the explanatory power of the first eigenvalue at different lags as a proxy for testing and monitoring structural causal relationships. The method is applied to analyse causal dependencies between daily monetary flows in a retail brokerage business allowing to control for liquidity risks.
Interpretable ML for High-Frequency Execution
Authors: Timothée Fabre, Vincent Ragel
Date: 2023-07-10 00:00:00
Tasks: Survival Analysis

Order placement tactics play a crucial role in high-frequency trading algorithms and their design is based on understanding the dynamics of the order book. Using high quality high-frequency data and a set of microstructural features, we exhibit strong state dependence properties of the fill probability function. We train a neural network to infer the fill probability function for a fixed horizon. Since we aim at providing a high-frequency execution framework, we use a simple architecture. A weighting method is applied to the loss function such that the model learns from censored data. By comparing numerical results obtained on both digital asset centralized exchanges (CEXs) and stock markets, we are able to analyze dissimilarities between feature importances of the fill probability of small tick crypto pairs and Euronext equities. The practical use of this model is illustrated with a fixed time horizon execution problem in which both the decision to post a limit order or to immediately execute and the optimal distance of placement are characterized. We discuss the importance of accurately estimating the clean-up cost that occurs in the case of a non-execution and we show it can be well approximated by a smooth function of market features. We finally assess the performance of our model with a backtesting approach that avoids the insertion of hypothetical orders and makes possible to test the order placement algorithm with orders that realistically impact the price formation process.
Collaborative Score Distillation for Consistent Visual Synthesis
Authors: Subin Kim, Kyungmin Lee, June Suk Choi, Jongheon Jeong, Kihyuk Sohn, Jinwoo Shin
Date: 2023-07-04 00:00:00

Generative priors of large-scale text-to-image diffusion models enable a wide range of new generation and editing applications on diverse visual modalities. However, when adapting these priors to complex visual modalities, often represented as multiple images (e.g., video), achieving consistency across a set of images is challenging. In this paper, we address this challenge with a novel method, Collaborative Score Distillation (CSD). CSD is based on the Stein Variational Gradient Descent (SVGD). Specifically, we propose to consider multiple samples as "particles" in the SVGD update and combine their score functions to distill generative priors over a set of images synchronously. Thus, CSD facilitates seamless integration of information across 2D images, leading to a consistent visual synthesis across multiple samples. We show the effectiveness of CSD in a variety of tasks, encompassing the visual editing of panorama images, videos, and 3D scenes. Our results underline the competency of CSD as a versatile method for enhancing inter-sample consistency, thereby broadening the applicability of text-to-image diffusion models.
Q-YOLO: Efficient Inference for Real-time Object Detection
Authors: Mingze Wang, Huixin Sun, Jun Shi, Xuhui Liu, Baochang Zhang, Xianbin Cao
Date: 2023-07-01 00:00:00
Tasks: Object, object-detection, Object Detection, Quantization, Real-Time Object Detection

Real-time object detection plays a vital role in various computer vision applications. However, deploying real-time object detectors on resource-constrained platforms poses challenges due to high computational and memory requirements. This paper describes a low-bit quantization method to build a highly efficient one-stage detector, dubbed as Q-YOLO, which can effectively address the performance degradation problem caused by activation distribution imbalance in traditional quantized YOLO models. Q-YOLO introduces a fully end-to-end Post-Training Quantization (PTQ) pipeline with a well-designed Unilateral Histogram-based (UH) activation quantization scheme, which determines the maximum truncation values through histogram analysis by minimizing the Mean Squared Error (MSE) quantization errors. Extensive experiments on the COCO dataset demonstrate the effectiveness of Q-YOLO, outperforming other PTQ methods while achieving a more favorable balance between accuracy and computational cost. This research contributes to advancing the efficient deployment of object detection models on resource-limited edge devices, enabling real-time detection with reduced computational and memory overhead.
Towards exploring adversarial learning for anomaly detection in complex driving scenes
Authors: Nour Habib, Yunsu Cho, Abhishek Buragohain, Andreas Rausch
Date: 2023-06-17 00:00:00
Tasks: Anomaly Detection, Autonomous Driving

One of the many Autonomous Systems (ASs), such as autonomous driving cars, performs various safety-critical functions. Many of these autonomous systems take advantage of Artificial Intelligence (AI) techniques to perceive their environment. But these perceiving components could not be formally verified, since, the accuracy of such AI-based components has a high dependency on the quality of training data. So Machine learning (ML) based anomaly detection, a technique to identify data that does not belong to the training data could be used as a safety measuring indicator during the development and operational time of such AI-based components. Adversarial learning, a sub-field of machine learning has proven its ability to detect anomalies in images and videos with impressive results on simple data sets. Therefore, in this work, we investigate and provide insight into the performance of such techniques on a highly complex driving scenes dataset called Berkeley DeepDrive.
Food Recognition and Nutritional Apps
Authors: Lubnaa Abdur Rahman, Ioannis Papathanail, Lorenzo Brigato, Elias K. Spanakis, Stavroula Mougiakakou
Date: 2023-06-20 00:00:00
Tasks: Food Recognition, Nutrition

Food recognition and nutritional apps are trending technologies that may revolutionise the way people with diabetes manage their diet. Such apps can monitor food intake as a digital diary and even employ artificial intelligence to assess the diet automatically. Although these apps offer a promising solution for managing diabetes, they are rarely used by patients. This chapter aims to provide an in-depth assessment of the current status of apps for food recognition and nutrition, to identify factors that may inhibit or facilitate their use, while it is accompanied by an outline of relevant research and development.
Optimized Crystallographic Graph Generation for Material Science
Authors: Astrid Klipfel, Yaël Frégier, Adlane Sayede, Zied Bouraoui
Date: 2023-06-07 00:00:00
Tasks: GPU, Graph Generation

Graph neural networks are widely used in machine learning applied to chemistry, and in particular for material science discovery. For crystalline materials, however, generating graph-based representation from geometrical information for neural networks is not a trivial task. The periodicity of crystalline needs efficient implementations to be processed in real-time under a massively parallel environment. With the aim of training graph-based generative models of new material discovery, we propose an efficient tool to generate cutoff graphs and k-nearest-neighbours graphs of periodic structures within GPU optimization. We provide pyMatGraph a Pytorch-compatible framework to generate graphs in real-time during the training of neural network architecture. Our tool can update a graph of a structure, making generative models able to update the geometry and process the updated graph during the forward propagation on the GPU side. Our code is publicly available at https://github.com/aklipf/mat-graph.