Miracle-dz/UniFAR-FTUs huggingface dataset:
HyperAgent: A Simple, Scalable, Efficient and Provable Reinforcement Learning Framework for Complex Environments

To solve complex tasks under resource constraints, reinforcement learning (RL) agents need to be simple, efficient, and scalable, addressing (1) large state spaces and (2) the continuous accumulation of interaction data. We propose HyperAgent, an RL framework featuring the hypermodel and index sampling schemes that enable computation-efficient incremental approximation for the posteriors associated with general value functions without the need for conjugacy, and data-efficient action selection. Implementing HyperAgent is straightforward, requiring only one additional module beyond what is necessary for Double-DQN. HyperAgent stands out as the first method to offer robust performance in large-scale deep RL benchmarks while achieving provably scalable per-step computational complexity and attaining sublinear regret under tabular assumptions. HyperAgent can solve Deep Sea hard exploration problems with episodes that optimally scale with problem size and exhibits significant efficiency gains in both data and computation under the Atari benchmark. The core of our theoretical analysis is the sequential posterior approximation argument, enabled by the first analytical tool for sequential random projection -- a non-trivial martingale extension of the Johnson-Lindenstrauss. This work bridges the theoretical and practical realms of RL, establishing a new benchmark for RL algorithm design.
Fermion exchange in ring polymer self-consistent field theory

A mapping is made between fermion exchange and excluded volume in the quantum-classical isomorphism using polymer self-consistent field theory. Apart from exchange, quantum particles are known to be exactly representable in classical statistical mechanics as ring polymers, with contours that are parametrized by the inverse thermal energy, often called the imaginary time. Evidence in support of a previously used approximation for fermion exchange in ring polymer self-consistent field theory is given, specifically, that the use of all-contour interactions in the mean field picture instead of equal imaginary time interactions is justified based on the symmetry of ring polymers. It is also shown that the removal of forbidden thermal trajectories, both those that violate excluded volume directly and those that represent topologically inaccessible microstates, is equivalent to antisymmetric exchange. The electron density of the beryllium atom is calculated with ring polymer self-consistent field theory ignoring classical correlations, and very good agreement is found with Hartree-Fock theory which also neglects Coulomb correlations. The total binding energies agree to within less than 6%, which while still far from chemical accuracy, is remarkable given that the field theory equations are derived from first principles with zero free parameters. The discrepancy between self-consistent field theory and Hartree-Fock theory is attributed to classical Coulomb self-interactions which are included in Hartree-Fock theory but not in self-consistent field theory. A potential method to improve the agreement by more accurately representing electron-electron self-interactions in self-consistent field theory is discussed, as are the implications for quantum foundations of the quantum-classical mapping between fermion exchange and thermal trajectory excluded volume.
Core Stability in Additively Separable Hedonic Games of Low Treewidth

Additively Separable Hedonic Game (ASHG) are coalition-formation games where we are given a graph whose vertices represent $n$ selfish agents and the weight of each edge $uv$ denotes how much agent $u$ gains (or loses) when she is placed in the same coalition as agent $v$. We revisit the computational complexity of the well-known notion of core stability of ASHGs, where the goal is to construct a partition of the agents into coalitions such that no group of agents would prefer to diverge from the given partition and form a new (blocking) coalition. Since both finding a core stable partition and verifying that a given partition is core stable are intractable problems ($\Sigma_2^p$-complete and coNP-complete respectively) we study their complexity from the point of view of structural parameterized complexity, using standard graph-theoretic parameters, such as treewidth.
Stochastic Localization via Iterative Posterior Sampling

Building upon score-based learning, new interest in stochastic localization techniques has recently emerged. In these models, one seeks to noise a sample from the data distribution through a stochastic process, called observation process, and progressively learns a denoiser associated to this dynamics. Apart from specific applications, the use of stochastic localization for the problem of sampling from an unnormalized target density has not been explored extensively. This work contributes to fill this gap. We consider a general stochastic localization framework and introduce an explicit class of observation processes, associated with flexible denoising schedules. We provide a complete methodology, $\textit{Stochastic Localization via Iterative Posterior Sampling}$ (SLIPS), to obtain approximate samples of this dynamics, and as a by-product, samples from the target distribution. Our scheme is based on a Markov chain Monte Carlo estimation of the denoiser and comes with detailed practical guidelines. We illustrate the benefits and applicability of SLIPS on several benchmarks, including Gaussian mixtures in increasing dimensions, Bayesian logistic regression and a high-dimensional field system from statistical-mechanics.
White Spruce Light Rings in Northwestern Canada

Light ring chronologies are developed from white spruce (Picea glauca [Moench] Voss) at six sites in the Yukon and western Northwest Territories of Canada in order to evaluate their spatiotemporal distribution and to investigate the climatic factors leading to their formation. The chronologies, produced using both living and subfossil material, vary in length from 350 yr to 800 yr. In several key years during the common interval A.D. 1641-1989, light rings developed in a majority of trees at all or most of the sites, indicating their usefulness for regional crossdating of tree-ring records. Comparison of light ring records with climate data at the northernmost site suggests white spruce light ring formation is related to below average June to August tempertures, with an emphasis on low August temperatures. Prominent white spruce light ring years in northwestern Canada are different from black spruce light ring years in northern Quebec, probably due to the differences in synoptic circulation patterns between the two regions, and thus cross-dating may be limited to the regional scale.
The universal Lipschitz path space of the Heisenberg group $\mathbb{H}^1$

The goal of this paper is to define and inspect a metric version of the universal path space and study its application to purely 2-unrectifiable spaces, in particular the Heisenberg group $\mathbb{H}^1$. The construction of the universal Lipschitz path space, as the metric version is called, echoes the construction of the universal cover for path-connected, locally path-connected, and semilocally simply connected spaces. We prove that the universal Lipschitz path space of a purely 2-unrectifiable space, much like the universal cover, satisfies a unique lifting property, a universal property, and is Lipschitz simply connected. The existence of such a universal Lipschitz path space of $\mathbb{H}^1$ will be used to prove that $\pi_{1}^{\text{Lip}}(\mathbb{H}^1)$ is torsion-free in a subsequent paper.
Spike-EVPR: Deep Spiking Residual Network with Cross-Representation Aggregation for Event-Based Visual Place Recognition

Event cameras have been successfully applied to visual place recognition (VPR) tasks by using deep artificial neural networks (ANNs) in recent years. However, previously proposed deep ANN architectures are often unable to harness the abundant temporal information presented in event streams. In contrast, deep spiking networks exhibit more intricate spatiotemporal dynamics and are inherently well-suited to process sparse asynchronous event streams. Unfortunately, directly inputting temporal-dense event volumes into the spiking network introduces excessive time steps, resulting in prohibitively high training costs for large-scale VPR tasks. To address the aforementioned issues, we propose a novel deep spiking network architecture called Spike-EVPR for event-based VPR tasks. First, we introduce two novel event representations tailored for SNN to fully exploit the spatio-temporal information from the event streams, and reduce the video memory occupation during training as much as possible. Then, to exploit the full potential of these two representations, we construct a Bifurcated Spike Residual Encoder (BSR-Encoder) with powerful representational capabilities to better extract the high-level features from the two event representations. Next, we introduce a Shared&Specific Descriptor Extractor (SSD-Extractor). This module is designed to extract features shared between the two representations and features specific to each. Finally, we propose a Cross-Descriptor Aggregation Module (CDA-Module) that fuses the above three features to generate a refined, robust global descriptor of the scene. Our experimental results indicate the superior performance of our Spike-EVPR compared to several existing EVPR pipelines on Brisbane-Event-VPR and DDD20 datasets, with the average Recall@1 increased by 7.61% on Brisbane and 13.20% on DDD20.
Uncertainty, Calibration, and Membership Inference Attacks: An Information-Theoretic Perspective

In a membership inference attack (MIA), an attacker exploits the overconfidence exhibited by typical machine learning models to determine whether a specific data point was used to train a target model. In this paper, we analyze the performance of the state-of-the-art likelihood ratio attack (LiRA) within an information-theoretical framework that allows the investigation of the impact of the aleatoric uncertainty in the true data generation process, of the epistemic uncertainty caused by a limited training data set, and of the calibration level of the target model. We compare three different settings, in which the attacker receives decreasingly informative feedback from the target model: confidence vector (CV) disclosure, in which the output probability vector is released; true label confidence (TLC) disclosure, in which only the probability assigned to the true label is made available by the model; and decision set (DS) disclosure, in which an adaptive prediction set is produced as in conformal prediction. We derive bounds on the advantage of an MIA adversary with the aim of offering insights into the impact of uncertainty and calibration on the effectiveness of MIAs. Simulation results demonstrate that the derived analytical bounds predict well the effectiveness of MIAs.
Superluminal Motion and Jet Parameters in the Gamma-ray-Emitting Narrow-Line Seyfert 1 Galaxy TXS 1206+549

Narrow-line Seyfert 1 (NLS1) galaxies are a peculiar subclass of active galactic nuclei (AGN). Among them, TXS 1206+549 belongs to a small group of radio-loud and γ-ray-emitting NLS1 galaxies. We focus on the radio properties of this galaxy by analysing archival, high-resolution, very long baseline interferometry (VLBI) imaging observations taken at 8 GHz frequency in six epochs between 1994 and 2018. Using the milliarcsecond-scale radio structure, we can resolve a core and a jet component whose angular separation increases by (0.055±0.006) mas yr−1. This corresponds to an apparent superluminal jet component motion of (3.5±0.4)c. From the core brightness temperature and the jet component proper motion, we determine the characteristic Doppler-boosting factor, the bulk Lorentz factor, and the jet viewing angle. We find no compelling evidence for a very closely aligned blazar-type jet. The parameters for TXS 1206+549 resemble those of radio-loud quasar jets with a moderate Lorentz factor (Γ≈4) and ϑ≈24∘ inclination to the line of sight.
Neural dynamics of shifting attention between perception and working-memory contents

In everyday tasks, our focus of attention shifts seamlessly between contents in the sensory environment and internal memory representations. Yet, research has mainly considered external and internal attention in isolation. We used magnetoencephalography to compare the neural dynamics of shifting attention to visual contents within vs. between the external and internal domains. Participants performed a combined perception and working-memory task in which two sequential cues guided attention to upcoming (external) or memorised (internal) sensory information. Critically, the second cue could redirect attention to visual content within the same or alternative domain as the first cue. Multivariate decoding unveiled distinct patterns of human brain activity when shifting attention within vs. between domains. Crossing domains did not alter the timing of spatial orienting, as indexed by posterior alpha lateralisation. These findings provide important initial insights into the neural dynamics that govern attentional shifts between perception and working memory.
Toxicity of the model protein 3×GFP arises from degradation overload, not from aggregate formation

While protein aggregation can cause cytotoxicity, it also forms to mitigate cytotoxicity from misfolded proteins, though the nature of these contrasting aggregates remains unclear. We previously found that overproduction (op) of a three green fluorescent protein linked protein (3×GFP) in yeast cells induces giant aggregates, and is detrimental to growth. Here, we investigated the mechanism of growth inhibition by 3×GFP-op using non-aggregative 3×MOX-op as a control. The 3×GFP aggregates were induced by misfolding, and 3×GFP-op had higher cytotoxicity than 3×MOX-op because it perturbs the ubiquitin-proteasome system. Static aggregates formed by 3×GFP-op dynamically trapped Hsp70, causing the heat shock response. Systematic analysis of mutants deficient in the protein quality control suggested that 3×GFP-op did not cause critical Hsp70 depletion and that the formation of aggregates functioned in the direction of mitigating toxicity. Artificial trapping of essential cell cycle regulators into 3×GFP aggregates caused abnormalities in the cell cycle. In conclusion, the formation of the giant 3×GFP aggregates itself is not cytotoxic, as it does not entrap and deplete essential proteins. Rather, it is productive, inducing the heat shock response while preventing an overload to the degradation system.
Hidden hearing loss in a hereditary peripheral neuropathy: evidence from a mouse model of

Author Contributions: LRC and GC designed the research studies. LRC, LJ, MCY, ASD and NDC conducted experiments. LRC, MCY, ASD and NDC acquired data. LRC, MCY, ASD, NDC, ZAA and GC analyzed data. LRC, LJ, MCY, ASD, NDC and GC wrote the manuscript
SARS-CoV-2 serosurvey of healthy, privately owned cats presenting to a New York City animal hospital in the early phase of the COVID-19 pandemic (2020–2021)

Both domestic and non-domestic cats are now established to be susceptible to infection by SARS-CoV-2, the cause of the ongoing COVID-19 pandemic. While serious disease in cats may occur in some instances, the majority of infections appear to be subclinical. Differing prevalence data for SARS-CoV-2 infection of cats have been reported, and are highly context-dependent. Here, we report a retrospective serological survey of cats presented to an animal practice in New York City, located in close proximity to a large medical center that treated the first wave of COVID-19 patients in the US in the Spring of 2020. We sampled 79, mostly indoor, cats between June 2020 to May 2021, the early part of which time the community was under a strict public health “lock-down”. Using a highly sensitive and specific fluorescent bead-based multiplex assay, we found an overall prevalence of 13/79 (16%) serologically-positive animals for the study period; however, cats sampled in the Fall of 2020 had a confirmed positive prevalence of 44%. For SARS-CoV-2 seropositive cats, we performed viral neutralization test with live SARS-CoV-2 to additionally confirm presence of SARS-CoV-2 specific antibodies. Of the thirteen seropositive cats, 7/13 (54%) were also positive by virus neutralization, and 2 of seropositive cats had previously documented respiratory signs, with high neutralization titers of 1:1024 and 1:4096; overall however, there was no statistically significant association of SARS-CoV-2 seropositivity with respiratory signs, or with breed, sex or age of the animals. Follow up sampling of cats, while limited in scope, showed that positive serological titers were maintained over time. In comparison, we found an overall confirmed positive prevalence of 51% for feline coronavirus (FCoV), an endemic virus of cats, with 30% confirmed negative for FCoV. We demonstrate the impact of SARS-CoV in a defined feline population during the first wave of SARS-CoV-2 infection of humans, and suggest that human-cat transmission was substantial in our study group. Our data provide a new context for SARS-CoV-2 transmission events across species.
Age-associated B cell infiltration in salivary glands represents a hallmark of Sjögren’s-like disease in aging mice

Sjögren’s disease (SjD), characterized by circulating autoantibodies and exocrine gland inflammation, is typically diagnosed in women over 50 years of age. However, the contribution of age to SjD pathogenesis is unclear. C57BL/6 female mice at different ages were studied to investigate how aging influences the dynamics of salivary gland inflammation. Salivary glands were characterized for immune cell infiltration, inflammatory gene expression, oxidative stress, and saliva production. At 8 months, gene expression of several chemokines involved in immune cell trafficking was significantly elevated. At this age, Age-associated B cells (ABCs), a unique subset of B cells expressing the myeloid markers CD11b and/or CD11c, were preferentially enriched in the salivary glands compared to other organs like the spleen or liver. The salivary gland ABCs increased with age and positively correlated with increased CD4 T follicular helper cells. By 14 months, lymphocytic foci of well-organized T and B cells spontaneously developed in the salivary glands. In addition, the mice progressively developed high titers of serum autoantibodies. A subset of aged mice developed salivary gland dysfunction mimicking SjD patients. Our data demonstrates that aging is a significant confounding factor for SjD. Thus, aged female C57BL/6 mice are more appropriate and a valuable preclinical model for investigating SjD pathogenesis and novel therapeutic interventions.
Klumpy: A Tool to Evaluate the Integrity of Long-Read Genome Assemblies and Illusive Sequence Motifs

The improvement and decreasing costs of third-generation sequencing technologies has widened the scope of biological questions researchers can address with de novo genome assemblies. With the increasing number of reference genomes, validating their integrity with minimal overhead is vital for establishing confident results in their applications. Here, we present Klumpy, a tool for detecting and visualizing both misassembled regions in a genome assembly and genetic elements (e.g., genes, promotors, or transposable elements) of interest in a set of sequences. By leveraging the initial raw reads in combination with their respective genome assembly, we illustrate Klumpy’s utility by investigating antifreeze glycoprotein (afgp) loci across two icefishes, by searching for a reported absent gene in the northern snakehead fish, and by scanning the reference genomes of a mudskipper and bumblebee for misassembled regions. In the two former cases, we were able to provide support for the noncanonical placement of an afgp locus in the icefishes and locate the missing snakehead gene. Furthermore, our genome scans were able to identify an cryptic locus in the mudskipper reference genome, and identify a putative repetitive element shared amongst several species of bees.
Long-term adaptation of prefrontal circuits in a mouse model of NMDAR hypofunction

Pharmacological approaches to induce N-methyl-D-aspartate receptor (NMDAR) hypofunction have been intensively used to understand the aetiology and pathophysiology of schizophrenia. Yet, the precise cellular and molecular mechanisms that relate to brain network dysfunction remain largely unknown. Here, we used a set of complementary approaches to assess the functional network abnormalities present in mice that underwent a 7-day subchronic phencyclidine (PCP 10mg/kg, subcutaneously, once daily) treatment. Our data revealed that pharmacological intervention with PCP affected cognitive performance and auditory evoked gamma oscillations in the prefrontal cortex (PFC) mimicking endophenotypes of some schizophrenia patients. We further assessed PFC cellular function and identified altered neuronal intrinsic membrane properties, reduced parvalbumin (PV) immunostaining and diminished inhibition onto L5 PFC pyramidal cells. A decrease in the strength of optogenetically-evoked glutamatergic current at the ventral hippocampus (HPC) to PFC synapse was also demonstrated, along with a weaker shunt of excitatory transmission by local PFC interneurons. On a macrocircuit level, functional ultrasound measurements indicated compromised functional connectivity within several brain regions particularly involving PFC and frontostriatal circuits. Herein, we reproduced a panel of schizophrenia endophenotypes induced by subchronic PCP application in mice. We further recapitulated electrophysiological signatures associated with schizophrenia and provided an anatomical reference to critical elements in the brain circuitry. Together, our findings contribute to a better understanding of the physiological underpinnings of deficits induced by subchronic NMDAR antagonist regimes and provide a test system for characterization of pharmacological compounds. Highlights Subchronic PCP treatment alters cognitive performance and evoked gamma synchronization in the prefrontal cortex. Subchronic PCP reduces number of parvalbumin-positive boutons and inhibitory synaptic transmission onto pyramidal neurons in layer 5/6 of the prelimbic cortex. Subchronic PCP reduces the strength of ventral hippocampal inputs to the medial prefrontal cortex. Frontostriatal circuits show robust dysconnectivity after subchronic PCP treatment. Abstract