julilili42/papers huggingface dataset:
On the Frequency Bias of Generative Models
2022-02-19

The key objective of Generative Adversarial Networks (GANs) is to generate new data with the same statistics as the provided training data. However, multiple recent works show that state-of-the-art architectures yet struggle to achieve this goal. In particular, they report an elevated amount of high frequencies in the spectral statistics which makes it straightforward to distinguish real and generated images. Explanations for this phenomenon are controversial: While most works attribute the artifacts to the generator, other works point to the discriminator. We take a sober look at those explanations and provide insights on what makes proposed measures against high-frequency artifacts effective. To achieve this, we first independently assess the architectures of both the generator and discriminator and investigate if they exhibit a frequency bias that makes learning the distribution of high-frequency content particularly problematic. Based on these experiments, we make the following four observations: 1) Different upsampling operations bias the generator towards different spectral properties. 2) Checkerboard artifacts introduced by upsampling cannot explain the spectral discrepancies alone as the generator is able to compensate for these artifacts. 3) The discriminator does not struggle with detecting high frequencies per se but rather struggles with frequencies of low magnitude. 4) The downsampling operations in the discriminator can impair the quality of the training signal it provides. In light of these findings, we analyze proposed measures against high-frequency artifacts in state-of-the-art GAN training but find that none of the existing approaches can fully resolve spectral artifacts yet. Our results suggest that there is great potential in improving the discriminator and that this could be key to match the distribution of the training data more closely.
Towards an X-ray inventory of nearby neutron stars
2022-02-19

The X-ray emission of neutron stars enables a probe of their temperatures, geometries, and magnetospheric properties. The current number of X-ray emitting pulsars is insufficient to rule out observational biases that may arise from poorly known distance, age, or location of the neutron stars. One approach to overcome such biases is to create a distance-limited sample with sufficiently deep observations. With the aim of better sampling of the nearby ( 2kpc) neutron stars population, we started an XMM-Newton survey of pulsars to measure their X-ray fluxes or derive respective constraining upper limits. We investigated 14 nearby pulsars for potential X-ray counterparts using different energy bands and detectors. In addition to our new XMM-Newton data, we also considered archival data and catalogs. We discuss source properties and also check for alternative counterparts to the X-ray sources. In our new XMM-Newton data, we found two pulsar counterpart candidates with significance above over and one candidate with by combining EPIC camera detection likelihoods. We also report the detection of potential X-ray counterparts to 8 radio pulsars in the 4XMM-DR10 catalog which have not been reported in the literature.
Novel approaches in Hadron Spectroscopy
2022-02-19

The last two decades have witnessed the discovery of a myriad of new and unexpected hadrons. The future holds more surprises for us, thanks to new-generation experiments. Understanding the signals and determining the properties of the states requires a parallel theoretical effort. To make full use of available and forthcoming data, a careful amplitude modeling is required, together with a sound treatment of the statistical uncertainties, and a systematic survey of the model dependencies. We review the contributions made by the Joint Physics Analysis Center to the field of hadron spectroscopy.
A wide-orbit giant planet in the high-mass b Centauri binary system
2022-02-19

Planet formation occurs around a wide range of stellar masses and stellar system architectures. An improved understanding of the formation process can be achieved by studying it across the full parameter space, particularly toward the extremes. Earlier studies of planets in close-in orbits around high-mass stars have revealed an increase in giant planet frequency with increasing stellar mass until a turnover point at 1.9 solar masses, above which the frequency rapidly decreases. This could potentially imply that planet formation is impeded around more massive stars, and that giant planets around stars exceeding 3 solar masses may be rare or non-existent. However, the methods used to detect planets in small orbits are insensitive to planets in wide orbits. Here we demonstrate the existence of a planet at 560 times the Sun-Earth distance from the 6-10 solar mass binary b Centauri through direct imaging. The planet-to-star mass ratio of 0.10-0.17% is similar to the Jupiter-Sun ratio, but the separation of the detected planet is ~100 times wider than that of Jupiter. Our results show that planets can reside in much more massive stellar systems than what would be expected from extrapolation of previous results. The planet is unlikely to have formed in-situ through the conventional core accretion mechanism, but might have formed elsewhere and arrived to its present location through dynamical interactions, or might have formed via gravitational instability.
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms
2022-02-20

Counterfactual explanations provide means for prescriptive model explanations by suggesting actionable feature changes (e.g., increase income) that allow individuals to achieve favorable outcomes in the future (e.g., insurance approval). Choosing an appropriate method is a crucial aspect for meaningful counterfactual explanations. As documented in recent reviews, there exists a quickly growing literature with available methods. Yet, in the absence of widely available opensource implementations, the decision in favor of certain models is primarily based on what is readily available. Going forward - to guarantee meaningful comparisons across explanation methods - we present CARLA (Counterfactual And Recourse LibrAry), a python library for benchmarking counterfactual explanation methods across both different data sets and different machine learning models. In summary, our work provides the following contributions: (i) an extensive benchmark of 11 popular counterfactual explanation methods, (ii) a benchmarking framework for research on future counterfactual explanation methods, and (iii) a standardized set of integrated evaluation measures and data sets for transparent and extensive comparisons of these methods. We have open-sourced CARLA and our experimental results on Github, making them available as competitive baselines. We welcome contributions from other research groups and practitioners.
Impaired Metabolic Health and Low Cardiorespiratory Fitness Independently Associate With Subclinical Atherosclerosis in Obesity
2022-02-20

Abstract Context For a given body mass index (BMI), both impaired metabolic health (MH) and reduced cardiorespiratory fitness (CRF) associate with increased risk of cardiovascular disease (CVD). Objective It remains unknown whether both risk phenotypes relate to CVD independently of each other, and whether these relationships differ in normal weight, overweight, and obese subjects. Methods Data from 421 participants from the Tübingen Diabetes Family Study, who had measurements of anthropometrics, metabolic parameters, CRF (maximal aerobic capacity [VO2max]) and carotid intima-media thickness (cIMT), an early marker of atherosclerosis, were analyzed. Subjects were divided by BMI and MH status into 6 phenotypes. Results In univariate analyses, older age, increased BMI, and a metabolic risk profile correlated positively, while insulin sensitivity and VO2max negatively with cIMT. In multivariable analyses in obese subjects, older age, male sex, lower VO2max (std. ß −0.21, P = 0.002) and impaired MH (std. ß 0.13, P = 0.02) were independent determinants of increased cIMT. After adjustment for age and sex, subjects with metabolically healthy obesity (MHO) had higher cIMT than subjects with metabolically healthy normal weight (MHNW; 0.59 ± 0.009 vs 0.52 ± 0.01 mm; P &amp;lt; 0.05). When VO2max was additionally included in this model, the difference in cIMT between MHO and MHNW groups became statistically nonsignificant (0.58 ± 0.009 vs 0.56 ± 0.02 mm; P &amp;gt; 0.05). Conclusion These data suggest that impaired MH and low CRF independently determine increased cIMT in obese subjects and that low CRF may explain part of the increased CVD risk observed in MHO compared with MHNW.
Generation of human nociceptor-enriched sensory neurons for the study of pain-related dysfunctions
2022-02-20

Abstract In vitro models of the peripheral nervous system would benefit from further refinements to better support studies on neuropathies. In particular, the assessment of pain-related signals is still difficult in human cell cultures. Here, we harnessed induced pluripotent stem cells (iPSCs) to generate peripheral sensory neurons enriched in nociceptors. The objective was to generate a culture system with signaling endpoints suitable for pharmacological and toxicological studies. Neurons generated by conventional differentiation protocols expressed moderate levels of P2X3 purinergic receptors and only low levels of TRPV1 capsaicin receptors, when maturation time was kept to the upper practically-useful limit of 6 weeks. As alternative approach, we generated cells with an inducible NGN1 transgene. Ectopic expression of this transcription factor during a defined time window of differentiation resulted in highly-enriched nociceptor cultures, as determined by functional (P2X3 and TRPV1 receptors) and immunocytochemical phenotyping, complemented by extensive transcriptome profiling. Single cell recordings of Ca 2+ -indicator fluorescence from &gt;9,000 cells were used to establish the “fraction of reactive cells” in a stimulated population as experimental endpoint, that appeared robust, transparent and quantifiable. To provide an example of application to biomedical studies, functional consequences of prolonged exposure to the chemotherapeutic drug oxaliplatin were examined at non-cytotoxic concentrations. We found (i) neuronal (allodynia-like) hypersensitivity to otherwise non-activating mechanical stimulation that could be blocked by modulators of voltage-gated sodium channels; (ii) hyper-responsiveness to TRPV1 receptor stimulation. These findings and several other measured functional alterations indicate that the model is suitable for pharmacological and toxicological studies related to peripheral neuropathies.
Tensor Normalization and Full Distribution Training
2022-02-20

In this work, we introduce pixel wise tensor normalization, which is inserted after rectifier linear units and, together with batch normalization, provides a significant improvement in the accuracy of modern deep neural networks. In addition, this work deals with the robustness of networks. We show that the factorized superposition of images from the training set and the reformulation of the multi class problem into a multi-label problem yields significantly more robust networks. The reformulation and the adjustment of the multi class log loss also improves the results compared to the overlay with only one class as label. https://atreus.informatik.uni-tuebingen.de/seafile/d/8e2ab8c3fdd444e1a135/?p=%2FTNandFDT&amp;mode=list
Meta-Learning the Search Distribution of Black-Box Random Search Based Adversarial Attacks
2022-02-20

Adversarial attacks based on randomized search schemes have obtained state-of-the-art results in black-box robustness evaluation recently. However, as we demonstrate in this work, their efficiency in different query budget regimes depends on manual design and heuristic tuning of the underlying proposal distributions. We study how this issue can be addressed by adapting the proposal distribution online based on the information obtained during the attack. We consider Square Attack, which is a state-of-the-art score-based black-box attack, and demonstrate how its performance can be improved by a learned controller that adjusts the parameters of the proposal distribution online during the attack. We train the controller using gradient-based end-to-end training on a CIFAR10 model with white box access. We demonstrate that plugging the learned controller into the attack consistently improves its black-box robustness estimate in different query regimes by up to 20% for a wide range of different models with black-box access. We further show that the learned adaptation principle transfers well to the other data distributions such as CIFAR100 or ImageNet and to the targeted attack setting.
Trivial or impossible -- dichotomous data difficulty masks model differences (on ImageNet and beyond)
2022-02-20

"The power of a generalization system follows directly from its biases" (Mitchell 1980). Today, CNNs are incredibly powerful generalisation systems -- but to what degree have we understood how their inductive bias influences model decisions? We here attempt to disentangle the various aspects that determine how a model decides. In particular, we ask: what makes one model decide differently from another? In a meticulously controlled setting, we find that (1.) irrespective of the network architecture or objective (e.g. self-supervised, semi-supervised, vision transformers, recurrent models) all models end up with a similar decision boundary. (2.) To understand these findings, we analysed model decisions on the ImageNet validation set from epoch to epoch and image by image. We find that the ImageNet validation set, among others, suffers from dichotomous data difficulty (DDD): For the range of investigated models and their accuracies, it is dominated by 46.0% "trivial" and 11.5% "impossible" images (beyond label errors). Only 42.5% of the images could possibly be responsible for the differences between two models' decision boundaries. (3.) Only removing the "impossible" and "trivial" images allows us to see pronounced differences between models. (4.) Humans are highly accurate at predicting which images are "trivial" and "impossible" for CNNs (81.4%). This implies that in future comparisons of brains, machines and behaviour, much may be gained from investigating the decisive role of images and the distribution of their difficulties.
Towards a European Stratospheric Balloon Observatory -- The ESBO Design Study
2022-02-20

This paper presents the concept of a community-accessible stratospheric balloon-based observatory that is currently under preparation by a consortium of European research institutes and industry. The planned European Stratospheric Balloon Observatory (ESBO) aims at complementing the current landscape of scientific ballooning activities by providing a service-centered infrastructure tailored towards broad astronomical use. In particular, the concept focuses on reusable platforms with exchangeable instruments and telescopes performing regular flights and an operations concept that provides researchers with options to test and operate own instruments, but later on also a proposal-based access to observations. It thereby aims at providing a complement to ground-, space-based, and airborne observatories in terms of access to wavelength regimes - particularly the ultraviolet (UV) and far infrared (FIR) regimes -, spatial resolution capability, and photometric stability. Within the currently ongoing ESBO Design Study (ESBO DS), financed within the European Union's Horizon 2020 Programme, a prototype platform carrying a 0.5-m telescope for UV and visible light observations is being built and concepts for larger following platforms, leading up to a next-generation FIR telescope are being studied. A flight of the UV/visible prototype platform is currently foreseen for 2021. We present the technical motivation, science case, instrumentation, and a two-stage image stabilization approach of the 0.5-m UV/visible platform. In addition, we briefly describe the novel mid-sized stabilized balloon gondola under design to carry telescopes in the 0.5 to 0.6 m range as well as the currently considered flight option for this platform. Secondly, we outline the scientific and technical motivation for a large balloon-based FIR telescope and the ESBO DS approach towards such an infrastructure.
Spirality and Rectilinear Planarity Testing of Independent-Parallel SP-Graphs
2022-02-20

We study the long-standing open problem of efficiently testing rectilinear planarity of series-parallel graphs (SP-graphs) in the variable embedding setting. A key ingredient behind the design of a linear-time testing algorithm for SP-graphs of vertex-degree at most three is that one can restrict the attention to a constant number of ``rectilinear shapes'' for each series or parallel component. To formally describe these shapes the notion of spirality can be used. This key ingredient no longer holds for SP-graphs with vertices of degree four, as we prove a logarithmic lower bound on the spirality of their components. The bound holds even for the independent-parallel SP-graphs, in which no two parallel components share a pole. Nonetheless, by studying the spirality properties of the independent-parallel SP-graphs, we are able to design a linear-time rectilinear planarity testing algorithm for this graph family.
TriStereoNet: A Trinocular Framework for Multi-baseline Disparity Estimation
2022-02-20

Stereo vision is an effective technique for depth estimation with broad applicability in autonomous urban and highway driving. While various deep learning-based approaches have been developed for stereo, the input data from a binocular setup with a fixed baseline are limited. Addressing such a problem, we present an end-to-end network for processing the data from a trinocular setup, which is a combination of a narrow and a wide stereo pair. In this design, two pairs of binocular data with a common reference image are treated with shared weights of the network and a mid-level fusion. We also propose a Guided Addition method for merging the 4D data of the two baselines. Additionally, an iterative sequential self-supervised and supervised learning on real and synthetic datasets is presented, making the training of the trinocular system practical with no need to ground-truth data of the real dataset. Experimental results demonstrate that the trinocular disparity network surpasses the scenario where individual pairs are fed into a similar architecture. Code and dataset: https://github.com/cogsys-tuebingen/tristereonet.
Accreting protoplanets: Spectral signatures and magnitude of gas and dust extinction at H alpha
2022-02-20

Accreting planets have been seen at Ha (H alpha), but targeted searches have not been fruitful. For planets, accretion tracers should come from the shock itself, exposing them to extinction by the accreting material. High-resolution (R&gt;5e4) spectrographs at Ha should soon allow studying how the incoming material shapes the line profile. We calculate how much the gas and dust accreting onto a planet reduce the Ha flux from the shock at the planetary surface and how they affect line shapes. We also study the absorption-modified relationship between Ha luminosity and Mdot. We compute the high-resolution radiative transfer of the Ha line using a 1D velocity-density-temperature structure for the inflowing matter in three representative accretion geometries: spherical symmetry, polar inflow, and magnetospheric accretion. For each, we explore wide ranges of Mdot and planet mass M. We use detailed gas opacities and estimate dust opacities. At Mdot&lt;3e-6 MJ/yr, gas extinction is negligible for spherical or polar inflow and at most A_Ha&lt;0.5 mag for magnetospheric accretion. Up to Mdot~3e-4 MJ/yr, the gas has A_Ha&lt;4 mag. This decreases with M. We estimate realistic dust opacities at Ha as ~0.01-10 cm^2/g, i.e., 10-1e4 times lower than in the ISM. Extinction flattens the L_Ha-Mdot relationship, which becomes non-monotonic with a maximum L_Ha~1e-4 LSun near Mdot~1e-4 MJ/yr for M~10 MJ. In magnetospheric accretion, the gas can introduce features in line profiles, but the velocity gradient smears them out in other geometries. For most of parameter space, extinction by the accreting matter should be negligible, simplifying interpretation of observations, especially for planets in gaps. At high Mdot, strong absorption reduces the Ha flux, and some measurements can be interpreted as two Mdot values. Line profiles at R~1e5 can provide complex constraints on the accretion flow's thermal-dynamical structure.
Fall and Rise of Discourse Connectives: A Cross-language Study
2022-02-20

Recent studies have claimed that the amount of discourse connectives or discourse markers has risen in multiple languages. However, the thesis has seldom been evaluated using comprehensive empirical data evidence. This study investigates the historical changes of frequencies in discourse connectives in the Chinese, English, French, German and Spanish over the last two hundred years. We find that the frequencies of the majority of discourse connectives showed a marked decrease in the latter four languages. These research results show that the frequencies of discourse markers in these languages have not in fact increased over the last two centuries. However, an increase of frequencies can be seen after 1980. Our findings are consistent with the changes of rationality in language recently reported. The current study can make contributions to a better understanding of the changes of human cognitive interest in language.
Airborne ultra-wideband radar sounding over the shear margins and along flow lines at the onset region of the Northeast Greenland Ice Stream
2022-02-21

Abstract. We present a high-resolution airborne radar data set (EGRIP-NOR-2018) for the onset region of the Northeast Greenland Ice Stream (NEGIS). The radar data were acquired in May 2018 with the Alfred Wegener Institute's multichannel ultra-wideband (UWB) radar mounted on the Polar 6 aircraft. Radar profiles cover an area of ∼24 000 km2 and extend over the well-defined shear margins of the NEGIS. The survey area is centered at the location of the drill site of the East Greenland Ice-Core Project (EastGRIP), and several radar lines intersect at this location. The survey layout was designed to (i) map the stratigraphic signature of the shear margins with radar profiles aligned perpendicular to ice flow, (ii) trace the radar stratigraphy along several flow lines, and (iii) provide spatial coverage of ice thickness and basal properties. While we are able to resolve radar reflections in the deep stratigraphy, we cannot fully resolve the steeply inclined reflections at the tightly folded shear margins in the lower part of the ice column. The NEGIS is causing the most significant discrepancies between numerically modeled and observed ice surface velocities. Given the high likelihood of future climate and ocean warming, this extensive data set of new high-resolution radar data in combination with the EastGRIP ice core will be a key contribution to understand the past and future dynamics of the NEGIS. The EGRIP-NOR-2018 radar data products can be obtained from the PANGAEA data publisher (https://doi.pangaea.de/10.1594/PANGAEA.928569; Franke et al., 2021a).