Miracle-dz/UniFAR-FTUs huggingface dataset:
Differentially private projection-depth-based medians

We develop $(\epsilon,\delta)$-differentially private projection-depth-based medians using the propose-test-release (PTR) and exponential mechanisms. Under general conditions on the input parameters and the population measure, (e.g. we do not assume any moment bounds), we quantify the probability the test in PTR fails, as well as the cost of privacy via finite sample deviation bounds. We demonstrate our main result on the canonical projection-depth-based median. In the Gaussian setting, we show that the resulting deviation bound matches the known lower bound for private Gaussian mean estimation, up to a polynomial function of the condition number of the covariance matrix. In the Cauchy setting, we show that the ``outlier error amplification'' effect resulting from the heavy tails outweighs the cost of privacy. This result is then verified via numerical simulations. Additionally, we present results on general PTR mechanisms and a uniform concentration result on the projected spacings of order statistics.
Disconnected cuts in 4-connected planar graphs

Let $G=(V,E)$ be a connected graph. A subset $S\subset V$ is a cut of $G$ if $G-S$ is disconnected. A near triangulation is a 2-connected plane graph that has at most one face that is not a triangle. In this paper, we explore minimal cuts of 4-connected planar graphs. Our main result is that every minimal cut of a 4-connected planar graph $G$ is connected if and only if $G$ is a near-triangulation. We use this result to sketch a linear-time algorithm for finding a disconnected cut of a 4-connected planar graph.
Cost Minimization for Equilibrium Transition

In this paper, we delve into the problem of using monetary incentives to encourage players to shift from an initial Nash equilibrium to a more favorable one within a game. Our main focus revolves around computing the minimum reward required to facilitate this equilibrium transition. The game involves a single row player who possesses m strategies and k column players, each endowed with n strategies. Our findings reveal that determining whether the minimum reward is zero is NP-complete, and computing the minimum reward becomes APX-hard. Nonetheless, we bring some positive news, as this problem can be efficiently handled if either k or n is a fixed constant. Furthermore, we have devised an approximation algorithm with an additive error that runs in polynomial time. Lastly, we explore a specific case wherein the utility functions exhibit single-peaked characteristics, and we successfully demonstrate that the optimal reward can be computed in polynomial time.
Near-Optimal Differentially Private k-Core Decomposition

Recent work by Dhulipala et al. \cite{DLRSSY22} initiated the study of the $k$-core decomposition problem under differential privacy via a connection between low round/depth distributed/parallel graph algorithms and private algorithms with small error bounds. They showed that one can output differentially private approximate $k$-core numbers, while only incurring a multiplicative error of $(2 +\eta)$ (for any constant $\eta>0$) and additive error of $\poly(\log(n))/\eps$. In this paper, we revisit this problem. Our main result is an $\eps$-edge differentially private algorithm for $k$-core decomposition which outputs the core numbers with no multiplicative error and $O(\text{log}(n)/\eps)$ additive error. This improves upon previous work by a factor of 2 in the multiplicative error, while giving near-optimal additive error. Our result relies on a novel generalized form of the sparse vector technique, which is especially well-suited for threshold-based graph algorithms; thus, we further strengthen the connection between distributed/parallel graph algorithms and differentially private algorithms.
Meta-learning to Calibrate Gaussian Processes with Deep Kernels for Regression Uncertainty Estimation

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for improving regression uncertainty estimation performance with a limited number of training data. The proposed method meta-learns how to calibrate uncertainty using data from various tasks by minimizing the test expected calibration error, and uses the knowledge for unseen tasks. We design our model such that the adaptation and calibration for each task can be performed without iterative procedures, which enables effective meta-learning. In particular, a task-specific uncalibrated output distribution is modeled by a GP with a task-shared encoder network, and it is transformed to a calibrated one using a cumulative density function of a task-specific Gaussian mixture model (GMM). By integrating the GP and GMM into our neural network-based model, we can meta-learn model parameters in an end-to-end fashion. Our experiments demonstrate that the proposed method improves uncertainty estimation performance while keeping high regression performance compared with the existing methods using real-world datasets in few-shot settings.
Distributed Inference and Fine-tuning of Large Language Models Over The Internet

Large language models (LLMs) are useful in many NLP tasks and become more capable with size, with the best open-source models having over 50 billion parameters. However, using these 50B+ models requires high-end hardware, making them inaccessible to most researchers. In this work, we investigate methods for cost-efficient inference and fine-tuning of LLMs, comparing local and distributed strategies. We observe that a large enough model (50B+) can run efficiently even on geodistributed devices in a consumer-grade network. This could allow running LLM efficiently by pooling together idle compute resources of multiple research groups and volunteers. We address two open problems: (1) how to perform inference and fine-tuning reliably if any device can disconnect abruptly and (2) how to partition LLMs between devices with uneven hardware, joining and leaving at will. In order to do that, we develop special fault-tolerant inference algorithms and load-balancing protocols that automatically assign devices to maximize the total system throughput. We showcase these algorithms in Petals - a decentralized system that runs Llama 2 (70B) and BLOOM (176B) over the Internet up to 10x faster than offloading for interactive generation. We evaluate the performance of our system in simulated conditions and a real-world setup spanning two continents.
Native Language Identification with Large Language Models

We present the first experiments on Native Language Identification (NLI) using LLMs such as GPT-4. NLI is the task of predicting a writer's first language by analyzing their writings in a second language, and is used in second language acquisition and forensic linguistics. Our results show that GPT models are proficient at NLI classification, with GPT-4 setting a new performance record of 91.7% on the benchmark TOEFL11 test set in a zero-shot setting. We also show that unlike previous fully-supervised settings, LLMs can perform NLI without being limited to a set of known classes, which has practical implications for real-world applications. Finally, we also show that LLMs can provide justification for their choices, providing reasoning based on spelling errors, syntactic patterns, and usage of directly translated linguistic patterns.
Low-Scale Inflationary Magnetogenesis without Baryon Isocurvature Problem

Primordial magnetogenesis is an intriguing possibility to explain the origin of intergalactic magnetic fields (IGMFs). However, the baryon isocurvature problem has recently been pointed out, ruling out all magnetogenesis models operating above the electroweak scale. In this letter, we show that lower-scale inflationary scenarios with a Chern-Simons coupling can evade this problem. We propose concrete inflationary models whose reheating temperatures are lower than the electroweak scale and numerically compute the amount of magnetic fields generated during inflation and reheating. We find that, for lower reheating temperatures, the magnetic helicity decreases significantly. It is also possible to generate fully helical magnetic fields by modifying the inflaton potential. In both cases, the produced magnetic fields can be strong enough to explain the observed IGMFs, while avoiding the baryon isocurvature problem.
Efficient Entropy-Stable Discontinuous Spectral-Element Methods Using Tensor-Product Summation-by-Parts Operators on Triangles and Tetrahedra

We present a new class of efficient and robust discontinuous spectral-element methods of arbitrary order for nonlinear hyperbolic systems of conservation laws on curved triangular and tetrahedral unstructured grids. Such discretizations employ a recently introduced family of sparse tensor-product summation-by-parts (SBP) operators in collapsed coordinates within an entropy-stable modal formulation. The proposed algorithms exploit the structure of such SBP operators alongside that of the Proriol-Koornwinder-Dubiner polynomial basis, and a weight-adjusted approximation is used to efficiently invert the local mass matrix for curvilinear elements. Using such techniques, the number of required entropy-conservative two-point flux evaluations between pairs of quadrature nodes is significantly reduced relative to existing entropy-stable formulations using (non-tensor-product) multidimensional SBP operators, particularly for high polynomial degrees, with an improvement in time complexity from $\mathcal{O}(p^{2d})$ to $\mathcal{O}(p^{d+1})$, where $p$ is the polynomial degree of the approximation and $d$ is the number of spatial dimensions. In numerical experiments involving smooth solutions to the compressible Euler equations, the proposed tensor-product schemes demonstrate similar levels of accuracy for a given mesh and polynomial degree to those using multidimensional SBP operators based on symmetric quadrature rules. Furthermore, both operator families are shown to give rise to entropy-stable methods which exhibit excellent robustness for under-resolved problems. Such results suggest that the algorithmic advantages resulting from the use of tensor-product operators are obtained without compromising accuracy or robustness, enabling the efficient extension of the benefits of entropy stability to higher polynomial degrees than previously considered for triangular and tetrahedral elements.
EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset

Event cameras are emerging imaging technology that offers advantages over conventional frame-based imaging sensors in dynamic range and sensing speed. Complementing the rich texture and color perception of traditional image frames, the hybrid camera system of event and frame-based cameras enables high-performance imaging. With the assistance of event cameras, high-quality image/video enhancement methods make it possible to break the limits of traditional frame-based cameras, especially exposure time, resolution, dynamic range, and frame rate limits. This paper focuses on five event-aided image and video enhancement tasks (i.e., event-based video reconstruction, event-aided high frame rate video reconstruction, image deblurring, image super-resolution, and high dynamic range image reconstruction), provides an analysis of the effects of different event properties, a real-captured and ground truth labeled benchmark dataset, a unified benchmarking of state-of-the-art methods, and an evaluation for two mainstream event simulators. In detail, this paper collects a real-captured evaluation dataset EventAid for five event-aided image/video enhancement tasks, by using"Event-RGB"multi-camera hybrid system, taking into account scene diversity and spatiotemporal synchronization. We further perform quantitative and visual comparisons for state-of-the-art algorithms, provide a controlled experiment to analyze the performance limit of event-aided image deblurring methods, and discuss open problems to inspire future research.
IDKM: Memory Efficient Neural Network Quantization via Implicit, Differentiable k-Means

Compressing large neural networks with minimal performance loss is crucial to enabling their deployment on edge devices. (Cho et al., 2022) proposed a weight quantization method that uses an attention-based clustering algorithm called differentiable $k$-means (DKM). Despite achieving state-of-the-art results, DKM's performance is constrained by its heavy memory dependency. We propose an implicit, differentiable $k$-means algorithm (IDKM), which eliminates the major memory restriction of DKM. Let $t$ be the number of $k$-means iterations, $m$ be the number of weight-vectors, and $b$ be the number of bits per cluster address. IDKM reduces the overall memory complexity of a single $k$-means layer from $\mathcal{O}(t \cdot m \cdot 2^b)$ to $\mathcal{O}( m \cdot 2^b)$. We also introduce a variant, IDKM with Jacobian-Free-Backpropagation (IDKM-JFB), for which the time complexity of the gradient calculation is independent of $t$ as well. We provide a proof of concept of our methods by showing that, under the same settings, IDKM achieves comparable performance to DKM with less compute time and less memory. We also use IDKM and IDKM-JFB to quantize a large neural network, Resnet18, on hardware where DKM cannot train at all.
OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methods

Optical coherence tomography (OCT) is a non-invasive imaging technique with extensive clinical applications in ophthalmology. OCT enables the visualization of the retinal layers, playing a vital role in the early detection and monitoring of retinal diseases. OCT uses the principle of light wave interference to create detailed images of the retinal microstructures, making it a valuable tool for diagnosing ocular conditions. This work presents an open-access OCT dataset (OCTDL) comprising over 2000 OCT images labeled according to disease group and retinal pathology. The dataset consists of OCT records of patients with Age-related Macular Degeneration (AMD), Diabetic Macular Edema (DME), Epiretinal Membrane (ERM), Retinal Artery Occlusion (RAO), Retinal Vein Occlusion (RVO), and Vitreomacular Interface Disease (VID). The images were acquired with an Optovue Avanti RTVue XR using raster scanning protocols with dynamic scan length and image resolution. Each retinal b-scan was acquired by centering on the fovea and interpreted and cataloged by an experienced retinal specialist. In this work, we applied Deep Learning classification techniques to this new open-access dataset.
Information Manipulation in Partially Observable Markov Decision Processes

A common approach to solve partially observable Markov decision processes (POMDPs) is transforming them into Makov decision processes (MDPs) defined on information states. Updated using the existing belief and an observation based on Bayes rule at each stage, the plausibility of the information states depends significantly on the credibility and precision of the observations, which can be influenced by noisy communication links or intentionally manipulated by adversaries. This work proposes an information manipulation problem built on a POMDP to investigate a manipulator's incentives to influence the probabilistic rules of the underlying states. In particular, the information manipulator (IM) stealthily changes the observations of the controller of the POMDP to guide the controller's actions and achieve his manipulation goals. We introduce a stage-wise consistency constraint to the IM's feasible designs so that the marginal distribution of the unobservable states must agree with the one specified by the true kernel at each stage. We show the solution to the IM's problem under two distinct information patterns and discuss their relations. An example is presented to illustrate the procedure of solving the IM's problem. The impact of information manipulation on the POMDP is shown using an upper-bound on the performance deviation caused by the IM's effort. The bound is derived with the help of the stability of the unnormalized conditional densities that serve as information states.
Optimization of an Optical Testbed for Characterization of EXCLAIM u-Spec Integrated Spectrometers

We describe a testbed to characterize the optical response of compact superconducting on-chip spectrometers in development for the Experiment for Cryogenic Large-Aperture Intensity Mapping (EXCLAIM) mission. EXCLAIM is a balloonborne far-infrared experiment to probe the CO and CII emission lines in galaxies from redshift 3.5 to the present. The spectrometer, called u-Spec, comprises a diffraction grating on a silicon chip coupled to kinetic inductance detectors (KIDs) read out via a single microwave feedline. We use a prototype spectrometer for EXCLAIM to demonstrate our ability to characterize the spectrometers spectral response using a photomixer source. We utilize an on-chip reference detector to normalize relative to spectral structure from the off-chip optics and a silicon etalon to calibrate the absolute frequency.
Sense, Predict, Adapt, Repeat: A Blueprint for Design of New Adaptive AI-Centric Sensing Systems

As Moore's Law loses momentum, improving size, performance, and efficiency of processors has become increasingly challenging, ending the era of predictable improvements in hardware performance. Meanwhile, the widespread incorporation of high-definition sensors in consumer devices and autonomous technologies has fueled a significant upsurge in sensory data. Current global trends reveal that the volume of generated data already exceeds human consumption capacity, making AI algorithms the primary consumers of data worldwide. To address this, a novel approach to designing AI-centric sensing systems is needed that can bridge the gap between the increasing capabilities of high-definition sensors and the limitations of AI processors. This paper provides an overview of efficient sensing and perception methods in both AI and sensing domains, emphasizing the necessity of co-designing AI algorithms and sensing systems for dynamic perception. The proposed approach involves a framework for designing and analyzing dynamic AI-in-the-loop sensing systems, suggesting a fundamentally new method for designing adaptive sensing systems through inference-time AI-to-sensor feedback and end-to-end efficiency and performance optimization.
Tell, don't show: Declarative facts influence how LLMs generalize

We examine how large language models (LLMs) generalize from abstract declarative statements in their training data. As an illustration, consider an LLM that is prompted to generate weather reports for London in 2050. One possibility is that the temperatures in the reports match the mean and variance of reports from 2023 (i.e. matching the statistics of pretraining). Another possibility is that the reports predict higher temperatures, by incorporating declarative statements about climate change from scientific papers written in 2023. An example of such a declarative statement is"global temperatures will increase by $1^{\circ} \mathrm{C}$ by 2050". To test the influence of abstract declarative statements, we construct tasks in which LLMs are finetuned on both declarative and procedural information. We find that declarative statements influence model predictions, even when they conflict with procedural information. In particular, finetuning on a declarative statement $S$ increases the model likelihood for logical consequences of $S$. The effect of declarative statements is consistent across three domains: aligning an AI assistant, predicting weather, and predicting demographic features. Through a series of ablations, we show that the effect of declarative statements cannot be explained by associative learning based on matching keywords. Nevertheless, the effect of declarative statements on model likelihoods is small in absolute terms and increases surprisingly little with model size (i.e. from 330 million to 175 billion parameters). We argue that these results have implications for AI risk (in relation to the"treacherous turn") and for fairness.
Accelerating the Global Aggregation of Local Explanations

Local explanation methods highlight the input tokens that have a considerable impact on the outcome of classifying the document at hand. For example, the Anchor algorithm applies a statistical analysis of the sensitivity of the classifier to changes in the token. Aggregating local explanations over a dataset provides a global explanation of the model. Such aggregation aims to detect words with the most impact, giving valuable insights about the model, like what it has learned in training and which adversarial examples expose its weaknesses. However, standard aggregation methods bear a high computational cost: a naive implementation applies a costly algorithm to each token of each document, and hence, it is infeasible for a simple user running in the scope of a short analysis session. We devise techniques for accelerating the global aggregation of the Anchor algorithm. Specifically, our goal is to compute a set of top-k words with the highest global impact according to different aggregation functions. Some of our techniques are lossless and some are lossy. We show that for a very mild loss of quality, we are able to accelerate the computation by up to 30 times, reducing the computation from hours to minutes. We also devise and study a probabilistic model that accounts for noise in the Anchor algorithm and diminishes the bias toward words that are frequent yet low in impact.
ρ-Diffusion: A diffusion-based density estimation framework for computational physics

In physics, density $\rho(\cdot)$ is a fundamentally important scalar function to model, since it describes a scalar field or a probability density function that governs a physical process. Modeling $\rho(\cdot)$ typically scales poorly with parameter space, however, and quickly becomes prohibitively difficult and computationally expensive. One promising avenue to bypass this is to leverage the capabilities of denoising diffusion models often used in high-fidelity image generation to parameterize $\rho(\cdot)$ from existing scientific data, from which new samples can be trivially sampled from. In this paper, we propose $\rho$-Diffusion, an implementation of denoising diffusion probabilistic models for multidimensional density estimation in physics, which is currently in active development and, from our results, performs well on physically motivated 2D and 3D density functions. Moreover, we propose a novel hashing technique that allows $\rho$-Diffusion to be conditioned by arbitrary amounts of physical parameters of interest.
Expedition 344 summary

The Costa Rica Seismogenesis Project (CRISP) was designed to elucidate processes that control nucleation and seismic rupture of large earthquakes at erosional subduction zones. The CRISP study area is located offshore the Osa Peninsula where the incoming Cocos Ridge has lifted the seismogenic zone to within reach of scientific drilling. This area is characterized by low sediment supply, a fast convergence rate, abundant plate interface seismicity, and a change in subducting plate relief along strike. In addition to elucidating processes at erosional convergent margins, this project is complementary to other deep fault drilling projects (e.g., The Nankai Trough Seismogenic Zone Experiment and the Japan Trench Fast Drilling Project). Integrated Ocean Drilling Program (IODP) Expedition 344 is the second expedition of CRISP Program A (IODP Proposal 537A-Full5), a first step toward deep riser drilling through the seismogenic zone. The focus of CRISP Program A is on the shallow lithologic, hydrologic, stress, and thermal conditions that lead to unstable slip in the seismogenic zone. Together with IODP Expedition 334, the first expedition of CRISP Program A, these data provide exciting insights into the nature of seismogenesis and erosive plate boundaries.