Miracle-dz/UniFAR-FTUs huggingface dataset:
Maneuver Decision-Making Through Proximal Policy Optimization And Monte Carlo Tree Search

Maneuver decision-making can be regarded as a Markov decision process and can be address by reinforcement learning. However, original reinforcement learning algorithms can hardly solve the maneuvering decision-making problem. One reason is that agents use random actions in the early stages of training, which makes it difficult to get rewards and learn how to make effective decisions. To address this issue, a method based on proximal policy optimization and Monte Carlo tree search is proposed. The method uses proximal policy optimization to train the agent, and regards the results of air combat as targets to train the value network. Then, based on the value network and the visit count of each node, Monte Carlo tree search is used to find the actions with more expected returns than random actions, which can improve the training performance. The ablation studies and simulation experiments indicate that agents trained by the proposed method can make different decisions according to different states, which demonstrates that the method can solve the maneuvering decision problem that the original reinforcement learning algorithm cannot solve.
Cyclic AMP mediates ovine cumulus–oocyte gap junctional function via balancing connexin 43 expression and phosphorylation

Gap junction channels in cumulus–oocyte complexes (COCs) enable the transmission and communication of small molecular signals between adjacent cells, such as cAMP. However, the regulation of gap junction function (GJF) by cAMP and the underlying mechanisms involved are not fully clarified. This study investigated the effect of cAMP on connexin 43 (CX43) expression and GJF in ovine COCs using immunofluorescence, quantitative real-time PCR (qRT-PCR), western blotting, and GJF detection. The CX43 was only found in the cumulus cells (CCs) side of ovine COC. The intra-oocyte cAMP showed a significant increase at 30 min, while the intra-CC cAMP exhibited two peaks at 10 min and 1 h during in vitro maturation (IVM). Phosphorylated CX43 protein exhibited an immediate increase at 10 min, and CX43 protein displayed two peaks at 10 min and 1 h during IVM. The duration of pre-IVM exposure to forskolin and IBMX significantly enhanced phosphorylated and total CX43, as well as Gja1 and Creb genes, for 10 min; these effects were counteracted by Rp-cAMP. Both pre-IVM with forskolin and IBMX for 1 h and the GJF and CX43/p-CX43 ratio were elevated. The closure of gap junction channels caused by phosphorylated CX43 to prevent cAMP outflow from oocytes in early IVM of COC. Cyclic AMP upregulated phosphorylated and total CX43 via genomic and non-genomic pathways, but its functional regulation was dependent on the balance of the two proteins. This study provides a new insight into the regulatory mechanism between cAMP and GJF, which would improve IVM in animal and clinical research.
Segmentation of Tubular Structures Using Iterative Training with Tailored Samples

We propose a minimal path method to simultaneously compute segmentation masks and extract centerlines of tubular structures with line-topology. Minimal path methods are commonly used for the segmentation of tubular structures in a wide variety of applications. Recent methods use features extracted by CNNs, and often outperform methods using hand-tuned features. However, for CNN-based methods, the samples used for training may be generated inappropriately, so that they can be very different from samples encountered during inference. We approach this discrepancy by introducing a novel iterative training scheme, which enables generating better training samples specifically tailored for the minimal path methods without changing existing annotations. In our method, segmentation masks and centerlines are not determined after one another by post-processing, but obtained using the same steps. Our method requires only very few annotated training images. Comparison with seven previous approaches on three public datasets, including satellite images and medical images, shows that our method achieves state-of-the-art results both for segmentation masks and centerlines.
Triple Regression for Camera Agnostic Sim2Real Robot Grasping and Manipulation Tasks

Sim2Real (Simulation to Reality) techniques have gained prominence in robotic manipulation and motion planning due to their ability to enhance success rates by enabling agents to test and evaluate various policies and trajectories. In this paper, we investigate the advantages of integrating Sim2Real into robotic frameworks. We introduce the Triple Regression Sim2Real framework, which constructs a real-time digital twin. This twin serves as a replica of reality to simulate and evaluate multiple plans before their execution in real-world scenarios. Our triple regression approach addresses the reality gap by: (1) mitigating projection errors between real and simulated camera perspectives through the first two regression models, and (2) detecting discrepancies in robot control using the third regression model. Experiments on 6-DoF grasp and manipulation tasks (where the gripper can approach from any direction) highlight the effectiveness of our framework. Remarkably, with only RGB input images, our method achieves state-of-the-art success rates. This research advances efficient robot training methods and sets the stage for rapid advancements in robotics and automation.
Self-training Strategies for Sentiment Analysis: An Empirical Study

Sentiment analysis is a crucial task in natural language processing that involves identifying and extracting subjective sentiment from text. Self-training has recently emerged as an economical and efficient technique for developing sentiment analysis models by leveraging a small amount of labeled data and a large amount of unlabeled data. However, given a set of training data, how to utilize them to conduct self-training makes a significant difference in the final performance of the model. We refer to this methodology as the self-training strategy. In this paper, we present an empirical study of various self-training strategies for sentiment analysis. First, we investigate the influence of the self-training strategy and hyper-parameters on the performance of traditional small language models (SLMs) in various few-shot settings. Second, we also explore the feasibility of leveraging large language models (LLMs) to help self-training. We propose and empirically compare several self-training strategies with the intervention of LLMs. Extensive experiments are conducted on three real-world sentiment analysis datasets.
Mapping the electronic transitions of protonation sites in peptides using soft X-ray action spectroscopy.

Near-edge X-ray absorption mass spectrometry (NEXAMS) around the nitrogen and oxygen K-edges was employed on gas-phase peptides to probe the electronic transitions related to their protonation sites, namely at basic side chains, the N-terminus and the amide oxygen. The experimental results are supported by replica exchange molecular dynamics and density-functional theory and restricted open-shell configuration with single calculations to attribute the transitions responsible for the experimentally observed resonances. We studied five tailor-made glycine-based pentapeptides, where we identified the signature of the protonation site of N-terminal proline, histidine, lysine and arginine, at 406 eV, corresponding to N 1s → σ*(NHx+) (x = 2 or 3) transitions, depending on the peptides. We compared the spectra of pentaglycine and triglycine to evaluate the sensitivity of NEXAMS to protomers. Separate resonances have been identified to distinguish two protomers in triglycine, the protonation site at the N-terminus at 406 eV and the protonation site at the amide oxygen characterized by a transition at 403.1 eV.
URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environments

A major challenge with off-road autonomous navigation is the lack of maps or road markings that can be used to plan a path for autonomous robots. Classical path planning methods mostly assume a perfectly known environment without accounting for the inherent perception and sensing uncertainty from detecting terrain and obstacles in off-road environments. Recent work in computer vision and deep neural networks has advanced the capability of terrain traversability segmentation from raw images; however, the feasibility of using these noisy segmentation maps for navigation and path planning has not been adequately explored. To address this problem, this research proposes an uncertainty-aware path planning method, URA* using aerial images for autonomous navigation in off-road environments. An ensemble convolutional neural network (CNN) model is first used to perform pixel-level traversability estimation from aerial images of the region of interest. The traversability predictions are represented as a grid of traversal probability values. An uncertainty-aware planner is then applied to compute the best path from a start point to a goal point given these noisy traversal probability estimates. The proposed planner also incorporates replanning techniques to allow rapid replanning during online robot operation. The proposed method is evaluated on the Massachusetts Road Dataset, the DeepGlobe dataset, as well as a dataset of aerial images from off-road proving grounds at Mississippi State University. Results show that the proposed image segmentation and planning methods outperform conventional planning algorithms in terms of the quality and feasibility of the initial path, as well as the quality of replanned paths.
Characteristics of Gravity Waves in Opposing Phases of the QBO: A Reanalysis Perspective with ERA5

ERA5 data for the period of 1979-2019 are used as a basis for investigating the properties of gravity waves as they disperse and propagate upward through the stratosphere during opposing phases of the QBO. Two-sided zonal wavenumber-frequency spectra of vertical velocity in the stratosphere exhibit distinctive gravity wave signatures. Consistent with theory, westward propagating waves tend to be suppressed during the easterly QBO phase and eastward propagating waves tend to be suppressed during the westerly phase. Cospectra of the vertical flux of zonal momentum also show significant asymmetries between eastward and westward propagating waves during opposing QBO phases. Phase speed spectra of the vertical flux of momentum are indicative of a strong dissipation of westward propagating gravity waves during the easterly phase and vice versa; i.e., a selective"wind filtering"of the waves as they propagate upward. The three-dimensional structure of the gravity waves is revealed by compositing. In the absence of a background zonal flow, the waves radiate outward and upward from their respective reference grid points in concentric rings. When a zonal flow is present, the rings are amplified and compressed upstream of the source and attenuated and stretched downstream of it, such that they assume the form of arcs. These results serve to confirm the applicability of the mechanism proposed by Lindzen and Holton (1968) to explain the downward propagation of the QBO. The QBO also influences the spectrum of gravity waves in ERA5 at 100 hPa, below the layer in which wind-filtering occurs.
Large Language Models Can Infer Psychological Dispositions of Social Media Users

As Large Language Models (LLMs) demonstrate increasingly human-like abilities in various natural language processing (NLP) tasks that are bound to become integral to personalized technologies, understanding their capabilities and inherent biases is crucial. Our study investigates the potential of LLMs like ChatGPT to infer psychological dispositions of individuals from their digital footprints. Specifically, we assess the ability of GPT-3.5 and GPT-4 to derive the Big Five personality traits from users' Facebook status updates in a zero-shot learning scenario. Our results show an average correlation of r = . 29 (range = [.22, .33]) between LLM-inferred and self-reported trait scores. Furthermore, our findings suggest biases in personality inferences with regard to gender and age: inferred scores demonstrated smaller errors for women and younger individuals on several traits, suggesting a potential systematic bias stemming from the underlying training data or differences in online self-expression.
The Contribution and FIP Bias of Three Types of Materials inside ICMEs Associated with Different Flare Intensities

The relationship between coronal mass ejections (CMEs) and flares is an important issue in solar and stellar physics. The studies on the origination and generation mechanisms of interplanetary CME (ICME) materials are crucial for understanding the connection between CMEs and flares. The materials inside ICMEs can be classified into three types, coming from corona directly (corona materials), heated by magnetic reconnection in corona (heated corona materials), and generated by chromospheric evaporation (chromospheric evaporation materials). Here the contribution and first ionization potential (FIP) bias of three types of materials inside ICMEs associated with different flare intensities are analyzed and compared. We find that the speeds and scales of near-Earth ICMEs both increase with flare intensities. The proportions of heated corona materials are nearly constant with flare intensities. The contributions of corona materials (chromospheric evaporation materials) are significantly decreased (increased) with flare intensities. More than two-thirds of materials are chromospheric evaporation materials for ICMEs associated with strong flares. The FIP bias of corona materials and heated corona materials is almost the same. The FIP bias of chromospheric evaporation materials is significantly higher than that of corona materials and heated corona materials, and it is increased with flare intensities. The above characteristics of FIP bias can be explained reasonably by the origination and generation mechanisms of three types of ICME materials. The present study demonstrates that the origination and generation mechanisms of ICME materials are significantly influenced by flare intensities. The reasons for the elevation of FIP bias, if ICMEs are regarded as a whole, are that the FIP bias of chromospheric evaporation materials is much higher, and the chromospheric evaporation materials contributed significantly to the ICMEs that are associated with strong flares.
Neural Gradient Learning and Optimization for Oriented Point Normal Estimation

We propose Neural Gradient Learning (NGL), a deep learning approach to learn gradient vectors with consistent orientation from 3D point clouds for normal estimation. It has excellent gradient approximation properties for the underlying geometry of the data. We utilize a simple neural network to parameterize the objective function to produce gradients at points using a global implicit representation. However, the derived gradients usually drift away from the ground-truth oriented normals due to the lack of local detail descriptions. Therefore, we introduce Gradient Vector Optimization (GVO) to learn an angular distance field based on local plane geometry to refine the coarse gradient vectors. Finally, we formulate our method with a two-phase pipeline of coarse estimation followed by refinement. Moreover, we integrate two weighting functions, i.e., anisotropic kernel and inlier score, into the optimization to improve the robust and detail-preserving performance. Our method efficiently conducts global gradient approximation while achieving better accuracy and generalization ability of local feature description. This leads to a state-of-the-art normal estimator that is robust to noise, outliers and point density variations. Extensive evaluations show that our method outperforms previous works in both unoriented and oriented normal estimation on widely used benchmarks. The source code and pre-trained models are available at https://github.com/LeoQLi/NGLO .
Energy-efficient Integrated Sensing and Communication System and DNLFM Waveform

Integrated sensing and communication (ISAC) is a key enabler of 6G. Unlike communication radio links, the sensing signal requires to experience round trips from many scatters. Therefore, sensing is more power-sensitive and faces a severer multi-target interference. In this paper, the ISAC system employs dedicated sensing signals, which can be reused as the communication reference signal. This paper proposes to add time-frequency matched windows at both the transmitting and receiving sides, which avoids mismatch loss and increases energy efficiency. Discrete non-linear frequency modulation (DNLFM) is further proposed to achieve both time-domain constant modulus and frequency-domain arbitrary windowing weights. DNLFM uses very few Newton iterations and a simple geometrically-equivalent method to generate, which greatly reduces the complex numerical integral in the conventional method. Moreover, the spatial-domain matched window is proposed to achieve low sidelobes. The simulation results show that the proposed methods gain a higher energy efficiency than conventional methods.
Semantically Redundant Training Data Removal and Deep Model Classification Performance: A Study with Chest X-rays

Deep learning (DL) has demonstrated its innate capacity to independently learn hierarchical features from complex and multi-dimensional data. A common understanding is that its performance scales up with the amount of training data. Another data attribute is the inherent variety. It follows, therefore, that semantic redundancy, which is the presence of similar or repetitive information, would tend to lower performance and limit generalizability to unseen data. In medical imaging data, semantic redundancy can occur due to the presence of multiple images that have highly similar presentations for the disease of interest. Further, the common use of augmentation methods to generate variety in DL training may be limiting performance when applied to semantically redundant data. We propose an entropy-based sample scoring approach to identify and remove semantically redundant training data. We demonstrate using the publicly available NIH chest X-ray dataset that the model trained on the resulting informative subset of training data significantly outperforms the model trained on the full training set, during both internal (recall: 0.7164 vs 0.6597, p<0.05) and external testing (recall: 0.3185 vs 0.2589, p<0.05). Our findings emphasize the importance of information-oriented training sample selection as opposed to the conventional practice of using all available training data.
Axioms for Distanceless Graph Partitioning

In 2002, Kleinberg proposed three axioms for distance-based clustering, and proved that it was impossible for a clustering method to satisfy all three. While there has been much subsequent work examining and modifying these axioms for distance-based clustering, little work has been done to explore axioms relevant to the graph partitioning problem, i.e., when the graph is given without a distance matrix. Here, we propose and explore axioms for graph partitioning when given graphs without distance matrices, including modifications of Kleinberg's axioms for the distanceless case and two others (one axiom relevant to the ''Resolution Limit'' and one addressing well-connectedness). We prove that clustering under the Constant Potts Model satisfies all the axioms, while Modularity clustering and Iterative k-core both fail many axioms we pose. These theoretical properties of the clustering methods are relevant both for theoretical investigation as well as to practitioners considering which methods to use for their domain science studies.
Embedding Classical Variational Methods in Quantum Circuits

We introduce a novel quantum-classical variational method that extends the quantum devices capabilities to approximate ground states of interacting quantum systems. The proposed method enhances parameterized quantum circuit ansatzes implemented on quantum devices with classical variational functions, such as neural-network quantum states. The quantum hardware is used as a high-accuracy solver on the most correlated degrees of freedom, while the remaining contributions are treated on a classical device. Our approach is completely variational, providing a well-defined route to systematically improve the accuracy by increasing the number of variational parameters, and performs a global optimization of the two partitions at the same time. We demonstrate the effectiveness of the protocol on spin chains and small molecules and provide insights into its accuracy and computational cost. We prove that our method is able to converge to exact diagonalization results via the addition of classical degrees of freedom, while the quantum circuit is kept fixed in both depth and width.
Maximum-likelihood fits of piece-wise Pareto distributions with finite and non-zero core

We discuss multiple classes of piece-wise Pareto-like power law probability density functions $p(x)$ with two regimes, a non-pathological core with non-zero, finite values for support $0\leq x\leq x_{\mathrm{min}}$ and a power-law tail with exponent $-\alpha$ for $x>x_{\mathrm{min}}$. The cores take the respective shapes (i) $p(x)\propto (x/x_{\mathrm{min}})^\beta$, (ii) $p(x)\propto\exp(-\beta[x/x_{\mathrm{min}}-1])$, and (iii) $p(x)\propto [2-(x/x_{\mathrm{min}})^\beta]$, including the special case $\beta=0$ leading to core $p(x)=\mathrm{const}$. We derive explicit maximum-likelihood estimators and/or efficient numerical methods to find the best-fit parameter values for empirical data. Solutions for the special cases $\alpha=\beta$ are presented, as well. The results are made available as a Python package.
Do Large GPT Models Discover Moral Dimensions in Language Representations? A Topological Study Of Sentence Embeddings

As Large Language Models are deployed within Artificial Intelligence systems, that are increasingly integrated with human society, it becomes more important than ever to study their internal structures. Higher level abilities of LLMs such as GPT-3.5 emerge in large part due to informative language representations they induce from raw text data during pre-training on trillions of words. These embeddings exist in vector spaces of several thousand dimensions, and their processing involves mapping between multiple vector spaces, with total number of parameters on the order of trillions. Furthermore, these language representations are induced by gradient optimization, resulting in a black box system that is hard to interpret. In this paper, we take a look at the topological structure of neuronal activity in the"brain"of Chat-GPT's foundation language model, and analyze it with respect to a metric representing the notion of fairness. We develop a novel approach to visualize GPT's moral dimensions. We first compute a fairness metric, inspired by social psychology literature, to identify factors that typically influence fairness assessments in humans, such as legitimacy, need, and responsibility. Subsequently, we summarize the manifold's shape using a lower-dimensional simplicial complex, whose topology is derived from this metric. We color it with a heat map associated with this fairness metric, producing human-readable visualizations of the high-dimensional sentence manifold. Our results show that sentence embeddings based on GPT-3.5 can be decomposed into two submanifolds corresponding to fair and unfair moral judgments. This indicates that GPT-based language models develop a moral dimension within their representation spaces and induce an understanding of fairness during their training process.