Miracle-dz/UniFAR-FTUs huggingface dataset:
Bubble nucleation and jetting inside a millimetric droplet

Abstract In this work we present experiments and simulations on the nucleation and successive dynamics of laser-induced bubbles inside liquid droplets in free-fall motion, i.e. a case where the bubbles are subjected to the influence of a free boundary in all directions. Within this spherical millimetric droplet, we have investigated the nucleation of secondary bubbles induced by the rarefaction wave that is produced when the shock wave emitted by the laser-induced plasma reflects at the drop surface. Interestingly, three-dimensional clusters of cavitation bubbles are observed. Their shape is compared with the negative pressure distribution computed with a computational fluid dynamics model and allows us to estimate a cavitation threshold value. In particular, we observed that the focusing of the waves in the vicinity of the free surface can give rise to explosive cavitation events that end up in fast liquid ejections. High-speed recordings of the drop/bubble dynamics are complemented by the velocity and pressure fields simulated for the same initial conditions. The effect of the proximity of a curved free surface on the jetting dynamics of the bubbles was qualitatively assessed by classifying the cavitation events using a non-dimensional stand-off parameter ${\Upsilon\hskip -1,05em -\,}$ that depends on the drop size, the bubble maximum radius and the relative position of the bubble inside the drop. Additionally, we studied the role of the drop's curvature by implementing a structural similarity algorithm to compare cases with bubbles produced near a flat surface to the bubbles inside the drop. Interestingly, this quantitative comparison method indicated the existence of equivalent stand-off distances at which bubbles influenced by different boundaries behave in a very similar way. The oscillation of the laser-induced bubbles promotes the onset of Rayleigh–Taylor and Rayleigh–Plateau instabilities, observed on the drop's surface. This phenomenon was studied by varying the ratio of the maximum radii of the bubble and the drop. The specific mechanisms leading to the destabilisation of the droplet surface were identified.
Multi-agent Black-box Optimization using a Bayesian Approach to Alternating Direction Method of Multipliers

Bayesian optimization (BO) is a powerful black-box optimization framework that looks to efficiently learn the global optimum of an unknown system by systematically trading-off between exploration and exploitation. However, the use of BO as a tool for coordinated decision-making in multi-agent systems with unknown structure has not been widely studied. This paper investigates a black-box optimization problem over a multi-agent network coupled via shared variables or constraints, where each subproblem is formulated as a BO that uses only its local data. The proposed multi-agent BO (MABO) framework adds a penalty term to traditional BO acquisition functions to account for coupling between the subsystems without data sharing. We derive a suitable form for this penalty term using alternating directions method of multipliers (ADMM), which enables the local decision-making problems to be solved in parallel (and potentially asynchronously). The effectiveness of the proposed MABO method is demonstrated on an intelligent transport system for fuel efficient vehicle platooning.
SIO: Synthetic In-Distribution Data Benefits Out-of-Distribution Detection

Building up reliable Out-of-Distribution (OOD) detectors is challenging, often requiring the use of OOD data during training. In this work, we develop a data-driven approach which is distinct and complementary to existing works: Instead of using external OOD data, we fully exploit the internal in-distribution (ID) training set by utilizing generative models to produce additional synthetic ID images. The classifier is then trained using a novel objective that computes weighted loss on real and synthetic ID samples together. Our training framework, which is termed SIO, serves as a"plug-and-play"technique that is designed to be compatible with existing and future OOD detection algorithms, including the ones that leverage available OOD training data. Our experiments on CIFAR-10, CIFAR-100, and ImageNet variants demonstrate that SIO consistently improves the performance of nearly all state-of-the-art (SOTA) OOD detection algorithms. For instance, on the challenging CIFAR-10 v.s. CIFAR-100 detection problem, SIO improves the average OOD detection AUROC of 18 existing methods from 86.25\% to 89.04\% and achieves a new SOTA of 92.94\% according to the OpenOOD benchmark. Code is available at https://github.com/zjysteven/SIO.
Real spectra in one-dimensional single-band non-Hermitian Hamiltonians

In general, the energy spectrum of a non-Hermitian system turns out to be complex, which is not so satisfactory since the time evolution of eigenstates with complex eigenvalues is either exponentially growing or decaying. Here we provide a sufficient and necessary condition of the real spectrum under open boundary conditions for one-dimensional non-Hermitian tight-binding Hamiltonians. The necessity is directly related to the fact that the generalized Brillouin zone in one dimension is a closed loop with the origin in its interior. For some simple models, we demonstrate the sufficiency by analytically determining when the preimage of the characteristic polynomial contains a loop and showing that this loop is just the generalized Brillouin zone itself. For more complex models, the numerical results are shown. Our results indicate that real spectra are more common than one may have expected in non-Hermitian systems and are helpful for designing non-Hermitian models with real spectra.
Verifying Properties of Tsetlin Machines

Tsetlin Machines (TsMs) are a promising and interpretable machine learning method which can be applied for various classification tasks. We present an exact encoding of TsMs into propositional logic and formally verify properties of TsMs using a SAT solver. In particular, we introduce in this work a notion of similarity of machine learning models and apply our notion to check for similarity of TsMs. We also consider notions of robustness and equivalence from the literature and adapt them for TsMs. Then, we show the correctness of our encoding and provide results for the properties: adversarial robustness, equivalence, and similarity of TsMs. In our experiments, we employ the MNIST and IMDB datasets for (respectively) image and sentiment classification. We discuss the results for verifying robustness obtained with TsMs with those in the literature obtained with Binarized Neural Networks on MNIST.
Dynamic piezoresponse force microscopy: Spatially resolved probing of polarization dynamics in time and voltage domains

An approach for probing dynamic phenomena during hysteresis loop measurements in piezoresponse force microscopy (PFM) is developed. Dynamic PFM (D-PFM) necessitates development of 5-dimensional (5D) data acquisition protocols and associated methods for analysis and visualization of multidimensional data. Using a combination of multivariate statistical analysis and phenomenological fitting, we explore dynamic behavior during polarization switching in model ferroelectric films with dense ferroelastic domain structures and in ferroelectric capacitors. In polydomain films, multivariate analysis of the switching data suggests that ferroelectric and ferroelastic components can be decoupled and time dynamics can be explored. In capacitors, a strong correlation between polarization dynamics and microstructure is observed. The future potential of D-PFM for probing time-dependent hysteretic phenomena in ferroelectrics and ionic systems is discussed.
Relation between higher-dimensional gauge theories and gravitational waves from first-order phase transitions

In this work, we investigate the relation between higher-dimensional gauge theories and stochastic gravitational wave (GW) spectrums caused by their potential. It is known that the higher-dimensional gauge theories can induce the spontaneous symmetry breaking of the gauge symmetry. If the spontaneous symmetry breaking induces the first-order phase transition, the stochastic GW can be observed in future interferometers. Through our numerical calculations, we reveal that distinctive parameters in the theories, like the compact scale, can change the GW spectrums dynamically. We also discuss the verifiability of the theories through the GW observations.
Robustness of Dynamics in Games: A Contraction Mapping Decomposition Approach

A systematic framework for analyzing dynamical attributes of games has not been well-studied except for the special class of potential or near-potential games. In particular, the existing results have shortcomings in determining the asymptotic behavior of a given dynamic in a designated game. Although there is a large body literature on developing convergent dynamics to the Nash equilibrium (NE) of a game, in general, the asymptotic behavior of an underlying dynamic may not be even close to a NE. In this paper, we initiate a new direction towards game dynamics by studying the fundamental properties of the map of dynamics in games. To this aim, we first decompose the map of a given dynamic into contractive and non-contractive parts and then explore the asymptotic behavior of those dynamics using the proximity of such decomposition to contraction mappings. In particular, we analyze the non-contractive behavior for better/best response dynamics in discrete-action space sequential/repeated games and show that the non-contractive part of those dynamics is well-behaved in a certain sense. That allows us to estimate the asymptotic behavior of such dynamics using a neighborhood around the fixed point of their contractive part proxy. Finally, we demonstrate the practicality of our framework via an example from duopoly Cournot games.
AIR-DA: Adversarial Image Reconstruction for Unsupervised Domain Adaptive Object Detection

Unsupervised domain adaptive object detection is a challenging vision task where object detectors are adapted from a label-rich source domain to an unlabeled target domain. Recent advances prove the efficacy of the adversarial based domain alignment where the adversarial training between the feature extractor and domain discriminator results in domain-invariance in the feature space. However, due to the domain shift, domain discrimination, especially on low-level features, is an easy task. This results in an imbalance of the adversarial training between the domain discriminator and the feature extractor. In this work, we achieve a better domain alignment by introducing an auxiliary regularization task to improve the training balance. Specifically, we propose Adversarial Image Reconstruction (AIR) as the regularizer to facilitate the adversarial training of the feature extractor. We further design a multi-level feature alignment module to enhance the adaptation performance. Our evaluations across several datasets of challenging domain shifts demonstrate that the proposed method outperforms all previous methods, of both one- and two-stage, in most settings.
Randomized Matrix Weighted Consensus

In this paper, randomized gossip-type matrix-weighted consensus algorithms are proposed for both leaderless and leader-follower topologies. First, we introduce the notion of expected matrix-weighted network, which captures the multi-dimensional interactions between any two agents in a probabilistic sense. Under some mild assumptions on the distribution of the expected matrix weights and the upper bound of the updating step size, the proposed asynchronous pairwise update algorithms drive the network to achieve a consensus in expectation. An upper bound of the $\epsilon$-convergence time of the algorithm is then derived. Furthermore, the proposed algorithms are applied to the bearing-based network localization and formation control problems. The theoretical results are supported by several numerical examples.
Finite temperature effects on the structural stability of Si-doped HfO2 using first-principles calculations

The structural stabilities of the monoclinic and tetragonal phases of Si-doped HfO2 at finite temperatures were analyzed using a computational scheme to assess the effects of impurity doping. We proposed a method that the finite temperature effects, i.e., lattice vibration and impurity configuration effects, are considered. The results show that 6% Si doping stabilizes the tetragonal phase at room temperature, although a higher concentration of Si is required to stabilize the tetragonal phase at zero temperature. These data indicate that lattice vibration and impurity configuration effects are important factors determining structural stability at finite temperatures.
Troika: Multi-Path Cross-Modal Traction for Compositional Zero-Shot Learning

Recent compositional zero-shot learning (CZSL) methods adapt pre-trained vision-language models (VLMs) by constructing trainable prompts only for composed state-object pairs. Relying on learning the joint representation of seen compositions, these methods ignore the explicit modeling of the state and object, thus limiting the exploitation of pre-trained knowledge and generalization to unseen compositions. With a particular focus on the universality of the solution, in this work, we propose a novel paradigm for CZSL models that establishes three identification branches (i.e., Multi-Path) to jointly model the state, object, and composition. The presented Troika is our implementation that aligns the branch-specific prompt representations with decomposed visual features. To calibrate the bias between semantically similar multi-modal representations, we further devise a Cross-Modal Traction module into Troika that shifts the prompt representation towards the current visual content. We conduct extensive experiments on three popular benchmarks, where our method significantly outperforms existing methods in both closed-world and open-world settings. The code will be available at https://github.com/bighuang624/Troika.
Automata-Based Software Model Checking of Hyperproperties

We develop model checking algorithms for Temporal Stream Logic (TSL) and Hyper Temporal Stream Logic (HyperTSL) modulo theories. TSL extends Linear Temporal Logic (LTL) with memory cells, functions and predicates, making it a convenient and expressive logic to reason over software and other systems with infinite data domains. HyperTSL further extends TSL to the specification of hyperproperties - properties that relate multiple system executions. As such, HyperTSL can express information flow policies like noninterference in software systems. We augment HyperTSL with theories, resulting in HyperTSL(T),and build on methods from LTL software verification to obtain model checking algorithms for TSL and HyperTSL(T). This results in a sound but necessarily incomplete algorithm for specifications contained in the forall*exists* fragment of HyperTSL(T). Our approach constitutes the first software model checking algorithm for temporal hyperproperties with quantifier alternations that does not rely on a finite-state abstraction.
Context-Aware Transformer for 3D Point Cloud Automatic Annotation

3D automatic annotation has received increased attention since manually annotating 3D point clouds is laborious. However, existing methods are usually complicated, e.g., pipelined training for 3D foreground/background segmentation, cylindrical object proposals, and point completion. Furthermore, they often overlook the inter-object feature correlation that is particularly informative to hard samples for 3D annotation. To this end, we propose a simple yet effective end-to-end Context-Aware Transformer (CAT) as an automated 3D-box labeler to generate precise 3D box annotations from 2D boxes, trained with a small number of human annotations. We adopt the general encoder-decoder architecture, where the CAT encoder consists of an intra-object encoder (local) and an inter-object encoder (global), performing self-attention along the sequence and batch dimensions, respectively. The former models intra-object interactions among points and the latter extracts feature relations among different objects, thus boosting scene-level understanding. Via local and global encoders, CAT can generate high-quality 3D box annotations with a streamlined workflow, allowing it to outperform existing state-of-the-arts by up to 1.79% 3D AP on the hard task of the KITTI test set.
PiNNwall: Heterogeneous Electrode Models from Integrating Machine Learning and Atomistic Simulation

Electrochemical energy storage always involves the capacitive process. The prevailing electrode model used in the molecular simulation of polarizable electrode–electrolyte systems is the Siepmann–Sprik model developed for perfect metal electrodes. This model has been recently extended to study the metallicity in the electrode by including the Thomas–Fermi screening length. Nevertheless, a further extension to heterogeneous electrode models requires introducing chemical specificity, which does not have any analytical recipes. Here, we address this challenge by integrating the atomistic machine learning code (PiNN) for generating the base charge and response kernel and the classical molecular dynamics code (MetalWalls) dedicated to the modeling of electrochemical systems, and this leads to the development of the PiNNwall interface. Apart from the cases of chemically doped graphene and graphene oxide electrodes as shown in this study, the PiNNwall interface also allows us to probe polarized oxide surfaces in which both the proton charge and the electronic charge can coexist. Therefore, this work opens the door for modeling heterogeneous and complex electrode materials often found in energy storage systems.
DLACB: Deep Learning Based Access Control Using Blockchain

In general, deep learning models use to make informed decisions immensely. Developed models are mainly based on centralized servers, which face several issues, including transparency, traceability, reliability, security, and privacy. In this research, we identify a research gap in a distributed nature-based access control that can solve those issues. The innovative technology blockchain could fill this gap and provide a robust solution. Blockchain's immutable and distributed nature designs a useful framework in various domains such as medicine, finance, and government, which can also provide access control as opposed to centralized methods that rely on trusted third parties to access the resources. In existing frameworks, a traditional access control approach is developed using blockchain, which depends on predefined policies and permissions that are not reliable. In this research, we propose DLACB: Deep Learning Based Access Control Using Blockchain, which utilizes a deep learning access control mechanism to determine a user's permissions on a given resource. This proposed framework authenticates the users and logs the access requests on the blockchain to recognize malicious users. The results show that this proposed framework operates correctly for all possible scenarios.
Towards Outcome-Driven Patient Subgroups: A Machine Learning Analysis Across Six Depression Treatment Studies

BACKGROUND Major depressive disorder (MDD) is a heterogeneous condition; multiple underlying neurobiological and behavioral substrates are associated with treatment response variability. Understanding the sources of this variability and predicting outcomes has been elusive. Machine learning (ML) shows promise in predicting treatment response in MDD, but its application is limited by challenges to the clinical interpretability of ML models, and clinicians often lack confidence in model results. In order to improve the interpretability of ML models in clinical practice, our goal was to demonstrate the derivation of treatment-relevant patient profiles comprised of clinical and demographic information using a novel ML approach. METHODS We analyzed data from six clinical trials of pharmacological treatment for depression (total n = 5438) using the Differential Prototypes Neural Network (DPNN), a ML model that derives patient prototypes which can be used to derive treatment-relevant patient clusters while learning to generate probabilities for differential treatment response. A model classifying remission and outputting individual remission probabilities for five first-line monotherapies and three combination treatments was trained using clinical and demographic data. Prototypes were evaluated for interpretability by assessing differences in feature distributions (e.g. age, sex, symptom severity) and treatment-specific outcomes. RESULTS A 3-prototype model achieved an area under the receiver operating curve of 0.66 and an expected absolute improvement in remission rate for those receiving the best predicted treatment of 6.5% (relative improvement of 15.6%) compared to the population remission rate. We identified three treatment-relevant patient clusters. Cluster A patients tended to be younger, to have increased levels of fatigue, and more severe symptoms. Cluster B patients tended to be older, female, have less severe symptoms, and the highest remission rates. Cluster C patients had more severe symptoms, lower remission rates, more psychomotor agitation, more intense suicidal ideation, and more somatic genital symptoms. CONCLUSION It is possible to produce novel treatment-relevant patient profiles using ML models; doing so may improve interpretability of ML models and the quality of precision medicine treatments for MDD.
Soft Skills Centrality in Graduate Studies Offerings

Is it possible to measure how critical soft skills like leadership or teamwork are from the viewpoint of graduate studies offerings? This paper provides a conceptual and methodological framework that introduces the concept of a bipartite network as a practical way to estimate the importance of soft skills as socio-emotional abilities trained in graduate studies. We examined 230 graduate programs offered by 49 higher education institutions in Colombia to estimate the empirical importance of soft skills from the viewpoint of graduate studies offerings. The results show that: a) graduate programs in Colombia share 31 soft skills in their intended learning outcomes; b) the centrality of these skills varies as a function of the graduate program, although this variation was not statistically significant; and c) while most central soft skills tend to be those related to creativity (i.e., creation or generation of ideas or projects), leadership (to lead or teamwork), and analytical orientation (e.g., evaluating situations and solving problems), less central were those related to empathy (i.e., understanding others and acknowledgment of others), ethical thinking, and critical thinking, posing the question if too much emphasis on most visible skills might imply an unbalance in the opportunities to enhancing other soft skills such as ethical thinking.