pwc-archive/papers-with-abstracts huggingface dataset:
System Identification and Two-Degree-of-Freedom Control of Nonlinear, Viscoelastic Tissues
Authors: Amanda Bianco, Raphael Zonis, Anne-Marie Lauzon, James Richard Forbes, Gijs Ijpma
Date: 2022-07-28 00:00:00

Objective: This paper presents a force control scheme for brief isotonic holds in an isometrically contracted muscle tissue, with minimal overshoot and settling time to measure its shortening velocity, a key parameter of muscle function. Methods: A two-degree-of-freedom control configuration, formed by a feedback controller and a feedforward controller, is explored. The feedback controller is a proportional-integral controller and the feedforward controller is designed using the inverse of a control-oriented model of muscle tissue. A generalized linear model and a nonlinear model of muscle tissue are explored using input-output data and system identification techniques. The force control scheme is tested on equine airway smooth muscle and its robustness confirmed with murine flexor digitorum brevis muscle. Results: Performance and repeatability of the force control scheme as well as the number of inputs and level of supervision required from the user were assessed with a series of experiments. The force control scheme was able to fulfill the stated control objectives in most cases, including the requirements for settling time and overshoot. Conclusion: The proposed control scheme is shown to enable automation of force control for characterizing muscle mechanics with minimal user input required. Significance: This paper leverages an inversion-based feedforward controller based on a nonlinear physiological model in a system identification context that is superior to classic linear system identification. The control scheme can be used as a steppingstone for generalized control of nonlinear, viscoelastic materials.
Distributional Actor-Critic Ensemble for Uncertainty-Aware Continuous Control
Authors: Takuya Kanazawa, HaiYan Wang, Chetan Gupta
Date: 2022-07-27 00:00:00
Tasks: continuous-control, Continuous Control, reinforcement-learning, Reinforcement Learning, Reinforcement Learning (RL), Uncertainty Quantification

Uncertainty quantification is one of the central challenges for machine learning in real-world applications. In reinforcement learning, an agent confronts two kinds of uncertainty, called epistemic uncertainty and aleatoric uncertainty. Disentangling and evaluating these uncertainties simultaneously stands a chance of improving the agent's final performance, accelerating training, and facilitating quality assurance after deployment. In this work, we propose an uncertainty-aware reinforcement learning algorithm for continuous control tasks that extends the Deep Deterministic Policy Gradient algorithm (DDPG). It exploits epistemic uncertainty to accelerate exploration and aleatoric uncertainty to learn a risk-sensitive policy. We conduct numerical experiments showing that our variant of DDPG outperforms vanilla DDPG without uncertainty estimation in benchmark tasks on robotic control and power-grid optimization.
Optimization of Artificial Neural Networks models applied to the identification of images of asteroids' resonant arguments
Authors: Valerio Carruba, Safwan Aljbaae, Gabriel Caritá, Rita Cassia Domingos, Bruno Martins
Date: 2022-07-28 00:00:00
Tasks: Data Augmentation

The asteroidal main belt is crossed by a web of mean-motion and secular resonances, that occur when there is a commensurability between fundamental frequencies of the asteroids and planets. Traditionally, these objects were identified by visual inspection of the time evolution of their resonant argument, which is a combination of orbital elements of the asteroid and the perturbing planet(s). Since the population of asteroids affected by these resonances is, in some cases, of the order of several thousand, this has become a taxing task for a human observer. Recent works used Convolutional Neural Networks (CNN) models to perform such task automatically. In this work, we compare the outcome of such models with those of some of the most advanced and publicly available CNN architectures, like the VGG, Inception and ResNet. The performance of such models is first tested and optimized for overfitting issues, using validation sets and a series of regularization techniques like data augmentation, dropout, and batch normalization. The three best-performing models were then used to predict the labels of larger testing databases containing thousands of images. The VGG model, with and without regularizations, proved to be the most efficient method to predict labels of large datasets. Since the Vera C. Rubin observatory is likely to discover up to four million new asteroids in the next few years, the use of these models might become quite valuable to identify populations of resonant minor bodies.
Classification of FIB/SEM-tomography images for highly porous multiphase materials using random forest classifiers
Authors: Markus Osenberg, André Hilger, Matthias Neumann, Amalia Wagner, Nicole Bohn, Joachim R. Binder, Volker Schmidt, John Banhart, Ingo Manke
Date: 2022-07-28 00:00:00
Tasks: 3D Classification

FIB/SEM tomography represents an indispensable tool for the characterization of three-dimensional nanostructures in battery research and many other fields. However, contrast and 3D classification/reconstruction problems occur in many cases, which strongly limits the applicability of the technique especially on porous materials, like those used for electrode materials in batteries or fuel cells. Distinguishing the different components like active Li storage particles and carbon/binder materials is difficult and often prevents a reliable quantitative analysis of image data, or may even lead to wrong conclusions about structure-property relationships. In this contribution, we present a novel approach for data classification in three-dimensional image data obtained by FIB/SEM tomography and its applications to NMC battery electrode materials. We use two different image signals, namely the signal of the angled SE2 chamber detector and the Inlens detector signal, combine both signals and train a random forest, i.e. a particular machine learning algorithm. We demonstrate that this approach can overcome current limitations of existing techniques suitable for multi-phase measurements and that it allows for quantitative data reconstruction even where current state-of the art techniques fail, or demand for large training sets. This approach may yield as guideline for future research using FIB/SEM tomography.
Automated Classification of Nanoparticles with Various Ultrastructures and Sizes
Authors: Claudius Zelenka, Marius Kamp, Kolja Strohm, Akram Kadoura, Jacob Johny, Reinhard Koch, Lorenz Kienle
Date: 2022-07-28 00:00:00
Tasks: Classification, Image Generation

Accurately measuring the size, morphology, and structure of nanoparticles is very important, because they are strongly dependent on their properties for many applications. In this paper, we present a deep-learning based method for nanoparticle measurement and classification trained from a small data set of scanning transmission electron microscopy images. Our approach is comprised of two stages: localization, i.e., detection of nanoparticles, and classification, i.e., categorization of their ultrastructure. For each stage, we optimize the segmentation and classification by analysis of the different state-of-the-art neural networks. We show how the generation of synthetic images, either using image processing or using various image generation neural networks, can be used to improve the results in both stages. Finally, the application of the algorithm to bimetallic nanoparticles demonstrates the automated data collection of size distributions including classification of complex ultrastructures. The developed method can be easily transferred to other material systems and nanoparticle structures.
p-Adic Statistical Field Theory and Deep Belief Networks
Authors: W. A. Zúñiga-Galindo
Date: 2022-07-28 00:00:00

In this work we initiate the study of the correspondence between p-adic statistical field theories (SFTs) and neural networks (NNs). In general quantum field theories over a p-adic spacetime can be formulated in a rigorous way. Nowadays these theories are considered just mathematical toy models for understanding the problems of the true theories. In this work we show these theories are deeply connected with the deep belief networks (DBNs). Hinton et al. constructed DBNs by stacking several restricted Boltzmann machines (RBMs). The purpose of this construction is to obtain a network with a hierarchical structure (a deep learning architecture). An RBM corresponds to a certain spin glass, we argue that a DBN should correspond to an ultrametric spin glass. A model of such a system can be easily constructed by using p-adic numbers. In our approach, a p-adic SFT corresponds to a p-adic continuous DBN, and a discretization of this theory corresponds to a p-adic discrete DBN. We show that these last machines are universal approximators. In the p-adic framework, the correspondence between SFTs and NNs is not fully developed. We point out several open problems.
Learning unseen coexisting attractors
Authors: Daniel J. Gauthier, Ingo Fischer, André Röhm
Date: 2022-07-28 00:00:00
Tasks: BIG-bench Machine Learning

Reservoir computing is a machine learning approach that can generate a surrogate model of a dynamical system. It can learn the underlying dynamical system using fewer trainable parameters and hence smaller training data sets than competing approaches. Recently, a simpler formulation, known as next-generation reservoir computing, removes many algorithm metaparameters and identifies a well-performing traditional reservoir computer, thus simplifying training even further. Here, we study a particularly challenging problem of learning a dynamical system that has both disparate time scales and multiple co-existing dynamical states (attractors). We compare the next-generation and traditional reservoir computer using metrics quantifying the geometry of the ground-truth and forecasted attractors. For the studied four-dimensional system, the next-generation reservoir computing approach uses $\sim 1.7 \times$ less training data, requires $10^3 \times$ shorter `warm up' time, has fewer metaparameters, and has an $\sim 100\times$ higher accuracy in predicting the co-existing attractor characteristics in comparison to a traditional reservoir computer. Furthermore, we demonstrate that it predicts the basin of attraction with high accuracy. This work lends further support to the superior learning ability of this new machine learning algorithm for dynamical systems.
Emergent structure and dynamics of tropical forest-grassland landscapes
Authors: Bert Wuyts, Jan Sieber
Date: 2022-07-28 00:00:00

Previous work indicates that tropical forest can exist as an alternative stable state to savanna. Therefore, perturbation by climate change or human impact may lead to crossing of a tipping point beyond which there is rapid forest dieback that is not easily reversed. A hypothesised mechanism for such bistability is a feedback between fire and vegetation, where fire spreads as a contagion process on grass patches. Theoretical models have largely implemented this mechanism implicitly, by assuming a threshold dependence of fire spread on flammable vegetation. Here, we show how the nonlinear dynamics and bistability emerge spontaneously, without assuming equations or thresholds for fire spread. We find that the forest geometry causes the nonlinearity that induces bistability. We demonstrate this in three steps. First, we model forest and fire as interacting contagion processes on grass patches, %using a cellular automaton showing that spatial structure emerges due to two counteracting effects on the forest perimeter: forest expansion by dispersal, and forest erosion by fires originating in adjacent grassland. Then, we derive a landscape-scale balance equation in which these two effects link forest geometry and dynamics: forest expands proportionally to its perimeter, while it shrinks proportionally to its perimeter weighted by adjacent grassland area. Finally, we show that these perimeter quantities introduce nonlinearity in our balance equation and lead to bistability. Relying on the link between structure and dynamics, we propose a forest resilience indicator that could be used for targeted conservation or restoration.
Adaptive Time Step Algorithms for the Simulation of marine Ecosystem Models using the Transport Matrix Method Implementation Metos3D
Authors: Markus Pfeil, Thomas Slawig
Date: 2022-07-28 00:00:00

The reduction of the computational effort is desirable for the simulation of marine ecosystem models. Using a marine ecosystem model, the assessment and the validation of annual periodic solutions (i.e., steady annual cycles) against observational data are crucial to identify biogeochemical processes, which, for example, influence the global carbon cycle. For marine ecosystem models, the transport matrix method (TMM) already lowers the runtime of the simulation significantly and enables the application of larger time steps straightforwardly. However, the selection of an appropriate time step is a challenging compromise between accuracy and shortening the runtime. Using an automatic time step adjustment during the computation of a steady annual cycle with the TMM, we present in this paper different algorithms applying either an adaptive step size control or decreasing time steps in order to use the time step always as large as possible without any manual selection. For these methods and a variety of marine ecosystem models of different complexity, the accuracy of the computed steady annual cycle achieved the same accuracy as solutions obtained with a fixed time step. Depending on the complexity of the marine ecosystem model, the application of the methods shortened the runtime significantly. Due to the certain overhead of the adaptive method, the computational effort may be higher in special cases using the adaptive step size control. The presented methods represent computational efficient methods for the simulation of marine ecosystem models using the TMM but without any manual selection of the time step.
Spotlight on nerves: Portable multispectral optoacoustic imaging of peripheral nerve vascularization and morphology
Authors: Dominik Jüstel, Hedwig Irl, Florian Hinterwimmer, Christoph Dehner, Walter Simson, Nassir Navab, Gerhard Schneider, Vasilis Ntziachristos
Date: 2022-07-28 00:00:00

Various morphological and functional parameters of peripheral nerves and their vascular supply are indicative of pathological changes due to injury or disease. Based on recent improvements in optoacoustic image quality, we explore the ability of multispectral optoacoustic tomography, in tandem with ultrasound imaging (OPUS), to investigate the vascular environment and morphology of peripheral nerves in vivo in a pilot study on healthy volunteers. We showcase the unique ability of optoacoustic imaging to visualize the vasa nervorum by observing intraneurial vessels in healthy nerves in vivo for the first time. In addition, we demonstrate that the label-free spectral optoacoustic contrast of the perfused connective tissue of peripheral nerves can be linked to the endogenous contrast of haemoglobin and collagen. We introduce metrics to analyze the composition of tissue based on its optoacoustic contrast and show that the high-resolution spectral contrast reveals specific differences between nervous tissue and reference tissue in the nerve's surrounding. We discuss how this showcased extraction of peripheral nerve characteristics using multispectral optoacoustic and ultrasound imaging can offer new insights into the pathophysiology of nerve damage and neuropathies, for example, in the context of diabetes.
Stable Matching with Mistaken Agents
Authors: Georgy Artemov, Yeon-Koo Che, YingHua He
Date: 2022-07-28 00:00:00

Motivated by growing evidence of agents' mistakes in strategically simple environments, we propose a solution concept -- robust equilibrium -- that requires only an asymptotically optimal behavior. We use it to study large random matching markets operated by the applicant-proposing Deferred Acceptance (DA). Although truth-telling is a dominant strategy, almost all applicants may be non-truthful in robust equilibrium; however, the outcome must be arbitrarily close to the stable matching. Our results imply that one can assume truthful agents to study DA outcomes, theoretically or counterfactually. However, to estimate the preferences of mistaken agents, one should assume stable matching but not truth-telling.
Quadratic Funding and Matching Funds Requirements
Authors: Ricardo A. Pasquini
Date: 2020-10-02 00:00:00

In this paper we examine the mechanism proposed by Buterin, Hitzig, and Weyl (2019) for public goods financing, particularly regarding its matching funds requirements, related efficiency implications, and incentives for strategic behavior. Then, we use emerging evidence from Gitcoin Grants, to identify stylized facts in contribution giving and test our propositions. Because of its quadratic design, matching funds requirements scale rapidly, particularly by more numerous and equally contributed projects. As a result, matching funds are exhausted early in the funding rounds, and much space remains for social efficiency improvement. Empirically, there is also a tendency by contributors to give small amounts, scattered among multiple projects, which accelerates this process. Among other findings, we also identify a significant amount of reciprocal backing, which could be consistent with the kind of strategic behavior we discuss.
Dialogue Enhancement and Listening Effort in Broadcast Audio: A Multimodal Evaluation
Authors: Matteo Torcoli, Thomas Robotham, Emanuël A. P. Habets
Date: 2022-07-28 00:00:00
Tasks: Pupil Dilation, Sentence

Dialogue enhancement (DE) plays a vital role in broadcasting, enabling the personalization of the relative level between foreground speech and background music and effects. DE has been shown to improve the quality of experience, intelligibility, and self-reported listening effort (LE). A physiological indicator of LE known from audiology studies is pupil size. The relation between pupil size and LE is typically studied using artificial sentences and background noises not encountered in broadcast content. This work evaluates the effect of DE on LE in a multimodal manner that includes pupil size (tracked by a VR headset) and real-world audio excerpts from TV. Under ideal listening conditions, 28 normal-hearing participants listened to 30 audio excerpts presented in random order and processed by conditions varying the relative level between foreground and background audio. One of these conditions employed a recently proposed source separation system to attenuate the background given the original mixture as the sole input. After listening to each excerpt, subjects were asked to repeat the heard sentence and self-report the LE. Mean pupil dilation and peak pupil dilation were analyzed and compared with the self-report and the word recall rate. The multimodal evaluation shows a consistent trend of decreasing LE along with decreasing background level. DE, also when enabled by source separation, significantly reduces the pupil size as well as the self-reported LE. This highlights the benefit of personalization functionalities at the user's end.
Re-thinking and Re-labeling LIDC-IDRI for Robust Pulmonary Cancer Prediction
Authors: Hanxiao Zhang, Xiao Gu, Minghui Zhang, Weihao Yu, Liang Chen, Zhexin Wang, Feng Yao, Yun Gu, Guang-Zhong Yang
Date: 2022-07-28 00:00:00
Tasks: Metric Learning, Prediction, Retrieval

The LIDC-IDRI database is the most popular benchmark for lung cancer prediction. However, with subjective assessment from radiologists, nodules in LIDC may have entirely different malignancy annotations from the pathological ground truth, introducing label assignment errors and subsequent supervision bias during training. The LIDC database thus requires more objective labels for learning-based cancer prediction. Based on an extra small dataset containing 180 nodules diagnosed by pathological examination, we propose to re-label LIDC data to mitigate the effect of original annotation bias verified on this robust benchmark. We demonstrate in this paper that providing new labels by similar nodule retrieval based on metric learning would be an effective re-labeling strategy. Training on these re-labeled LIDC nodules leads to improved model performance, which is enhanced when new labels of uncertain nodules are added. We further infer that re-labeling LIDC is current an expedient way for robust lung cancer prediction while building a large pathological-proven nodule database provides the long-term solution.
RHA-Net: An Encoder-Decoder Network with Residual Blocks and Hybrid Attention Mechanisms for Pavement Crack Segmentation
Authors: Guijie Zhu, Zhun Fan, Jiacheng Liu, Duan Yuan, Peili Ma, Meihua Wang, Weihua Sheng, Kelvin C. P. Wang
Date: 2022-07-28 00:00:00
Tasks: Crack Segmentation, Decoder

The acquisition and evaluation of pavement surface data play an essential role in pavement condition evaluation. In this paper, an efficient and effective end-to-end network for automatic pavement crack segmentation, called RHA-Net, is proposed to improve the pavement crack segmentation accuracy. The RHA-Net is built by integrating residual blocks (ResBlocks) and hybrid attention blocks into the encoder-decoder architecture. The ResBlocks are used to improve the ability of RHA-Net to extract high-level abstract features. The hybrid attention blocks are designed to fuse both low-level features and high-level features to help the model focus on correct channels and areas of cracks, thereby improving the feature presentation ability of RHA-Net. An image data set containing 789 pavement crack images collected by a self-designed mobile robot is constructed and used for training and evaluating the proposed model. Compared with other state-of-the-art networks, the proposed model achieves better performance and the functionalities of adding residual blocks and hybrid attention mechanisms are validated in a comprehensive ablation study. Additionally, a light-weighted version of the model generated by introducing depthwise separable convolution achieves better a performance and a much faster processing speed with 1/30 of the number of U-Net parameters. The developed system can segment pavement crack in real-time on an embedded device Jetson TX2 (25 FPS). The video taken in real-time experiments is released at https://youtu.be/3XIogk0fiG4.
A Transformer-based Generative Adversarial Network for Brain Tumor Segmentation
Authors: Liqun Huang, Long Chen, Baihai Zhang, Senchun Chai
Date: 2022-07-28 00:00:00
Tasks: Brain Tumor Segmentation, Decoder, Generative Adversarial Network, Image Segmentation, Medical Image Segmentation, Segmentation, Semantic Segmentation, Tumor Segmentation

Brain tumor segmentation remains a challenge in medical image segmentation tasks. With the application of transformer in various computer vision tasks, transformer blocks show the capability of learning long-distance dependency in global space, which is complementary with CNNs. In this paper, we proposed a novel transformer-based generative adversarial network to automatically segment brain tumors with multi-modalities MRI. Our architecture consists of a generator and a discriminator, which are trained in min-max game progress. The generator is based on a typical "U-shaped" encoder-decoder architecture, whose bottom layer is composed of transformer blocks with resnet. Besides, the generator is trained with deep supervision technology. The discriminator we designed is a CNN-based network with multi-scale $L_{1}$ loss, which is proved to be effective for medical semantic image segmentation. To validate the effectiveness of our method, we conducted experiments on BRATS2015 dataset, achieving comparable or better performance than previous state-of-the-art methods.