Miracle-dz/UniFAR-FTUs huggingface dataset:
Fermi Constraints on the Ejecta Speed and Prompt Emission Region of the Distant GRB 220101A

At redshift z = 4.618, GRB 220101A is the most distant gamma-ray burst (GRB) detected by Fermi/LAT to date. It is also a very energetic event, with an equivalent isotropic energy of 3.6 × 1054 erg. We jointly analyzed the Fermi/GBM and LAT observations of GRB 220101A with two independent approaches and found a significant spectral break at sub-100 MeV energies during the prompt emission. The fast variability of the emission suggests that this spectral attenuation is caused by internal opacity to pair creation. Regardless of the nature of the emission processes assumed in the spectral analysis, we infer a moderate value for the jet Lorentz factor, Γ ∼ 110, and find that all of the high-energy emission was produced above and near the photosphere, at a distance of ∼1014 cm from the central engine. We compare these results with the four other LAT-detected GRBs with similar properties.
Average treatment effect on the treated, under lack of positivity

The use of propensity score (PS) methods has become ubiquitous in causal inference. At the heart of these methods is the positivity assumption. Violation of the positivity assumption leads to the presence of extreme PS weights when estimating average causal effects of interest, such as the average treatment effect (ATE) or the average treatment effect on the treated (ATT), which renders invalid related statistical inference. To circumvent this issue, trimming or truncating the extreme estimated PSs have been widely used. However, these methods require that we specify a priori a threshold and sometimes an additional smoothing parameter. While there are a number of methods dealing with the lack of positivity when estimating ATE, surprisingly there is no much effort in the same issue for ATT. In this paper, we first review widely used methods, such as trimming and truncation in ATT. We emphasize the underlying intuition behind these methods to better understand their applications and highlight their main limitations. Then, we argue that the current methods simply target estimands that are scaled ATT (and thus move the goalpost to a different target of interest), where we specify the scale and the target populations. We further propose a PS weight-based alternative for the average causal effect on the treated, called overlap weighted average treatment effect on the treated (OWATT). The appeal of our proposed method lies in its ability to obtain similar or even better results than trimming and truncation while relaxing the constraint to choose a priori a threshold (or even specify a smoothing parameter). The performance of the proposed method is illustrated via a series of Monte Carlo simulations and a data analysis on racial disparities in health care expenditures.
Unsupervised Skin Lesion Segmentation via Structural Entropy Minimization on Multi-Scale Superpixel Graphs

Skin lesion segmentation is a fundamental task in dermoscopic image analysis. The complex features of pixels in the lesion region impede the lesion segmentation accuracy, and existing deep learning-based methods often lack interpretability to this problem. In this work, we propose a novel unsupervised Skin Lesion sEgmentation framework based on structural entropy and isolation forest outlier Detection, namely SLED. Specifically, skin lesions are segmented by minimizing the structural entropy of a superpixel graph constructed from the dermoscopic image. Then, we characterize the consistency of healthy skin features and devise a novel multi-scale segmentation mechanism by outlier detection, which enhances the segmentation accuracy by leveraging the superpixel features from multiple scales. We conduct experiments on four skin lesion benchmarks and compare SLED with nine representative unsupervised segmentation methods. Experimental results demonstrate the superiority of the proposed framework. Additionally, some case studies are analyzed to demonstrate the effectiveness of SLED.
Contextual Biasing of Named-Entities with Large Language Models

This paper studies contextual biasing with Large Language Models (LLMs), where during second-pass rescoring additional contextual information is provided to a LLM to boost Automatic Speech Recognition (ASR) performance. We propose to leverage prompts for a LLM without fine tuning during rescoring which incorporate a biasing list and few-shot examples to serve as additional information when calculating the score for the hypothesis. In addition to few-shot prompt learning, we propose multi-task training of the LLM to predict both the entity class and the next token. To improve the efficiency for contextual biasing and to avoid exceeding LLMs' maximum sequence lengths, we propose dynamic prompting, where we select the most likely class using the class tag prediction, and only use entities in this class as contexts for next token prediction. Word Error Rate (WER) evaluation is performed on i) an internal calling, messaging, and dictation dataset, and ii) the SLUE-Voxpopuli dataset. Results indicate that biasing lists and few-shot examples can achieve 17.8% and 9.6% relative improvement compared to first pass ASR, and that multi-task training and dynamic prompting can achieve 20.0% and 11.3% relative WER improvement, respectively.
Gradient Gibbs measures with periodic boundary laws of a generalized SOS model on a Cayley tree

We consider gradient Gibbs measures corresponding to a periodic boundary law for a generalized solid-on-solid (SOS) model with spin values from a countable set on a Cayley tree. On the Cayley tree, detailed information on gradient Gibbs measures for models of SOS type is given in Botirov and Haydarov (2020 J. Stat. Mech. 093102), Henning et al (2019 Electron. J. Probab. 24 104), Haydarov and Rozikov (2022 Rep. Math. Phys. 90 81–101) and Kulske and Schriever (2017 Markov Process. Relat. Fields 23 553–90). We continue this work for the generalized SOS model. Namely, in this paper, the problem of finding gradient Gibbs measures which correspond to periodic boundary laws is reduced to a functional equation and, by solving this equation, all gradient Gibbs measures with four periodic boundary laws are found.
Objcache: An Elastic Filesystem over External Persistent Storage for Container Clusters

Container virtualization enables emerging AI workloads such as model serving, highly parallelized training, machine learning pipelines, and so on, to be easily scaled on demand on the elastic cloud infrastructure. Particularly, AI workloads require persistent storage to store data such as training inputs, models, and checkpoints. An external storage system like cloud object storage is a common choice because of its elasticity and scalability. To mitigate access latency to external storage, caching at a local filesystem is an essential technique. However, building local caches on scaling clusters must cope with explosive disk usage, redundant networking, and unexpected failures. We propose objcache, an elastic filesystem over external storage. Objcache introduces an internal transaction protocol over Raft logging to enable atomic updates of distributed persistent states with consistent hashing. The proposed transaction protocol can also manage inode dirtiness by maintaining the consistency between the local cache and external storage. Objcache supports scaling down to zero by automatically evicting dirty files to external storage. Our evaluation reports that objcache speeded up model serving startup by 98.9% compared to direct copies via S3 interfaces. Scaling up with dirty files completed from 2 to 14 seconds with 1024 dirty files.
Quantum Bruhat graphs and tilted Richardson varieties

Quantum Bruhat graph is a weighted directed graph on a finite Weyl group first defined by Brenti-Fomin-Postnikov. It encodes quantum Monk's rule and can be utilized to study the $3$-point Gromov-Witten invariants of the flag variety. In this paper, we provide an explicit formula for the minimal weights between any pair of permutations on the quantum Bruhat graph, and consequently obtain an Ehresmann-like characterization for the tilted Bruhat order. Moreover, for any ordered pair of permutations $u$ and $v$, we define the tilted Richardson variety $T_{u,v}$, with a stratification that gives a geometric meaning to intervals in the tilted Bruhat order. We provide a few equivalent definitions to this new family of varieties that include Richardson varieties, and establish some fundamental geometric properties including their dimensions and closure relations.
Value-oriented Renewable Energy Forecasting for Coordinated Energy Dispatch Problems at Two Stages

Energy forecasting is deemed an essential task in power system operations. Operators usually issue forecasts and leverage them to schedule energy dispatch ahead of time (referred to as the 'predict, then optimize' paradigm). However, forecast models are often developed via optimizing statistical scores while overlooking the value of the forecasts in operation. In this paper, we design a value-oriented point forecasting approach for energy dispatch problems with renewable energy sources (RESs). At the training phase, this approach incorporates forecasting with day-ahead/real-time operations for power systems, thereby achieving reduced operation costs of the two stages. To this end, we formulate the forecast model parameter estimation as a bilevel program at the training phase, where the lower level solves the day-ahead and real-time energy dispatch problems, with the forecasts as parameters; the optimal solutions of the lower level are then returned to the upper level, which optimizes the model parameters given the contextual information and minimizes the expected operation cost of the two stages. Under mild assumptions, we propose a novel iterative solution strategy for this bilevel program. Under such an iterative scheme, we show that the upper level objective is locally linear regarding the forecast model output, and can act as the loss function. Numerical experiments demonstrate that, compared to commonly used point forecasting methods, the forecasts obtained by the proposed approach result in lower operation costs in the subsequent energy dispatch problems. Meanwhile, the proposed approach is more computationally efficient than traditional two-stage stochastic program.
ReOnto: A Neuro-Symbolic Approach for Biomedical Relation Extraction

Relation Extraction (RE) is the task of extracting semantic relationships between entities in a sentence and aligning them to relations defined in a vocabulary, which is generally in the form of a Knowledge Graph (KG) or an ontology. Various approaches have been proposed so far to address this task. However, applying these techniques to biomedical text often yields unsatisfactory results because it is hard to infer relations directly from sentences due to the nature of the biomedical relations. To address these issues, we present a novel technique called ReOnto, that makes use of neuro symbolic knowledge for the RE task. ReOnto employs a graph neural network to acquire the sentence representation and leverages publicly accessible ontologies as prior knowledge to identify the sentential relation between two entities. The approach involves extracting the relation path between the two entities from the ontology. We evaluate the effect of using symbolic knowledge from ontologies with graph neural networks. Experimental results on two public biomedical datasets, BioRel and ADE, show that our method outperforms all the baselines (approximately by 3\%).
Nuclear charge radii of silicon isotopes

The nuclear charge radius of $^{32}$Si was determined using collinear laser spectroscopy. The experimental result was confronted with ab initio nuclear lattice effective field theory, valence-space in-medium similarity renormalization group, and mean field calculations, highlighting important achievements and challenges of modern many-body methods. The charge radius of $^{32}$Si completes the radii of the mirror pair $^{32}$Ar - $^{32}$Si, whose difference was correlated to the slope $L$ of the symmetry energy in the nuclear equation of state. Our result suggests $L \leq 60$\,MeV, which agrees with complementary observables.
Face Clustering for Connection Discovery from Event Images

Social graphs are very useful for many applications, such as recommendations and community detections. However, they are only accessible to big social network operators due to both data availability and privacy concerns. Event images also capture the interactions among the participants, from which social connections can be discovered to form a social graph. Unlike online social graphs, social connections carried by event images can be extracted without user inputs, and hence many social graph-based applications become possible, even without access to online social graphs. This paper proposes a system to discover social connections from event images. By utilizing the social information from even images, such as co-occurrence, a face clustering method is proposed and implemented, and connections can be discovered without the identity of the event participants. By collecting over 40000 faces from over 3000 participants, it is shown that the faces can be well clustered with 80% in F1 score, and social graphs can be constructed. Utilizing offline event images may create a long-term impact on social network analytics.
In-processing User Constrained Dominant Sets for User-Oriented Fairness in Recommender Systems

Recommender systems are typically biased toward a small group of users, leading to severe unfairness in recommendation performance, i.e., User-Oriented Fairness (UOF) issue. The existing research on UOF is limited and fails to deal with the root cause of the UOF issue: the learning process between advantaged and disadvantaged users is unfair. To tackle this issue, we propose an In-processing User Constrained Dominant Sets (In-UCDS) framework, which is a general framework that can be applied to any backbone recommendation model to achieve user-oriented fairness. We split In-UCDS into two stages, i.e., the UCDS modeling stage and the in-processing training stage. In the In-UCDS modeling stage, for each disadvantaged user, we extract a constrained dominant set (a user cluster) containing some advantaged users that are similar to it. In the in-processing training stage, we move the representations of disadvantaged users closer to their corresponding cluster by calculating a fairness loss. By combining the fairness loss with the original backbone model loss, we address the UOF issue and maintain the overall recommendation performance simultaneously. Comprehensive experiments on three real-world datasets demonstrate that In-UCDS outperforms the state-of-the-art methods, leading to a fairer model with better overall recommendation performance.
Importance of overnight parameters to predict Sea Breeze on Long Island

The sea breeze is a phenomenon frequently impacting Long Island, New York, especially during the spring and early summer, when land surface temperatures can exceed ocean temperatures considerably. The sea breeze influences daily weather conditions by causing a shift in wind direction and speed, limiting the maximum temperature, and occasionally serving as a trigger for precipitation and thunderstorms. Advance prediction of the presence or absence of the sea breeze for a certain location on a given day would therefore be beneficial to weather forecasters. To forecast sea breeze occurrence based on the previous night's weather conditions, we used a novel algorithm called the $D$-Basis. We analyzed sea breeze data from a recent four year period (2017-2020) at a single weather station several miles inland from the coast. High or constant station pressure, high or constant dew point, and onshore wind from the previous night were found to be strong predictors of sea breeze formation the following day. The accuracy of the prediction was around 74\% for June 2020. Unlike other prediction methods which involve the comparison of sea surface and land surface temperatures in near real time, our prediction method is based on the parameters from the prior night, allowing it to potentially aid in advanced forecasting of the sea breeze.
The Early Development of the 2015/16 Quasi-Biennial Oscillation Disruption

An unprecedented disruption of the quasi-biennial oscillation (QBO) started to develop from late 2015. The early development of this event is analyzed using the space–time spectra of eddies from reanalysis data. While the extratropical waves propagating horizontally into the tropics were assumed to be the main driver for the disruption, it was not clear why these waves dissipated near the jet core instead of near the jet edge as linear theory predicts. This study shows that the drastic deceleration of the equatorial jet was largely brought about by a single strong wave packet, and the local winds experienced by the wave packet served as a better indicator of the wave breaking latitude than the zonal mean winds. Surprisingly, tropical mixed Rossby–gravity waves also made an appreciable contribution to the deceleration of the equatorial westerly jet by the horizontal eddy momentum fluxes, especially before January 2016. The horizontal eddy momentum fluxes associated with the tropical waves arise from the deformation of the wave structure when background westerlies increase with height. These horizontal eddy momentum anomalies from the tropical waves are commonly observed in the reanalysis data but are typically much weaker than those in the 2015/16 winter. The possibility exists that exceptionally strong equatorially trapped waves precondition the flow to disruption by an extratropical disturbance.
On the training and generalization of deep operator networks

We present a novel training method for deep operator networks (DeepONets), one of the most popular neural network models for operators. DeepONets are constructed by two sub-networks, namely the branch and trunk networks. Typically, the two sub-networks are trained simultaneously, which amounts to solving a complex optimization problem in a high dimensional space. In addition, the nonconvex and nonlinear nature makes training very challenging. To tackle such a challenge, we propose a two-step training method that trains the trunk network first and then sequentially trains the branch network. The core mechanism is motivated by the divide-and-conquer paradigm and is the decomposition of the entire complex training task into two subtasks with reduced complexity. Therein the Gram-Schmidt orthonormalization process is introduced which significantly improves stability and generalization ability. On the theoretical side, we establish a generalization error estimate in terms of the number of training data, the width of DeepONets, and the number of input and output sensors. Numerical examples are presented to demonstrate the effectiveness of the two-step training method, including Darcy flow in heterogeneous porous media.
Regret Analysis of Policy Gradient Algorithm for Infinite Horizon Average Reward Markov Decision Processes

In this paper, we consider an infinite horizon average reward Markov Decision Process (MDP). Distinguishing itself from existing works within this context, our approach harnesses the power of the general policy gradient-based algorithm, liberating it from the constraints of assuming a linear MDP structure. We propose a vanilla policy gradient-based algorithm and show its global convergence property. We then prove that the proposed algorithm has O(T^3/4) regret. Remarkably, this paper marks a pioneering effort by presenting the first exploration into regret bound computation for the general parameterized policy gradient algorithm in the context of average reward scenarios.
Layer-wise training for self-supervised learning on graphs

End-to-end training of graph neural networks (GNN) on large graphs presents several memory and computational challenges, and limits the application to shallow architectures as depth exponentially increases the memory and space complexities. In this manuscript, we propose Layer-wise Regularized Graph Infomax, an algorithm to train GNNs layer by layer in a self-supervised manner. We decouple the feature propagation and feature transformation carried out by GNNs to learn node representations in order to derive a loss function based on the prediction of future inputs. We evaluate the algorithm in inductive large graphs and show similar performance to other end to end methods and a substantially increased efficiency, which enables the training of more sophisticated models in one single device. We also show that our algorithm avoids the oversmoothing of the representations, another common challenge of deep GNNs.
iLoRE: Dynamic Graph Representation with Instant Long-term Modeling and Re-occurrence Preservation

Continuous-time dynamic graph modeling is a crucial task for many real-world applications, such as financial risk management and fraud detection. Though existing dynamic graph modeling methods have achieved satisfactory results, they still suffer from three key limitations, hindering their scalability and further applicability. i) Indiscriminate updating. For incoming edges, existing methods would indiscriminately deal with them, which may lead to more time consumption and unexpected noisy information. ii) Ineffective node-wise long-term modeling. They heavily rely on recurrent neural networks (RNNs) as a backbone, which has been demonstrated to be incapable of fully capturing node-wise long-term dependencies in event sequences. iii) Neglect of re-occurrence patterns. Dynamic graphs involve the repeated occurrence of neighbors that indicates their importance, which is disappointedly neglected by existing methods. In this paper, we present iLoRE, a novel dynamic graph modeling method with instant node-wise Long-term modeling and Re-occurrence preservation. To overcome the indiscriminate updating issue, we introduce the Adaptive Short-term Updater module that will automatically discard the useless or noisy edges, ensuring iLoRE's effectiveness and instant ability. We further propose the Long-term Updater to realize more effective node-wise long-term modeling, where we innovatively propose the Identity Attention mechanism to empower a Transformer-based updater, bypassing the limited effectiveness of typical RNN-dominated designs. Finally, the crucial re-occurrence patterns are also encoded into a graph module for informative representation learning, which will further improve the expressiveness of our method. Our experimental results on real-world datasets demonstrate the effectiveness of our iLoRE for dynamic graph modeling.
Productive Development of Scalable Network Functions with NFork

Despite decades of research, developing correct and scalable concurrent programs is still challenging. Network functions (NFs) are not an exception. This paper presents NFork, a system that helps NF domain experts to productively develop concurrent NFs by abstracting away concurrency from developers. The key scheme behind NFork's design is to exploit NF characteristics to overcome the limitations of prior work on concurrency programming. Developers write NFs as sequential programs, and during runtime, NFork performs transparent parallelization by processing packets in different cores. Exploiting NF characteristics, NFork leverages transactional memory and develops efficient concurrent data structures to achieve scalability and guarantee the absence of concurrency bugs. Since NFork manages concurrency, it further provides (i) a profiler that reveals the root causes of scalability bottlenecks inherent to the NF's semantics and (ii) actionable recipes for developers to mitigate these root causes by relaxing the NF's semantics. We show that NFs developed with NFork achieve competitive scalability with those in Cisco VPP [16], and NFork's profiler and recipes can effectively aid developers in optimizing NF scalability.