Miracle-dz/UniFAR-FTUs huggingface dataset:
Multimodal extended reality applications offer benefits for volumetric biomedical image analysis in research and medicine

3D data from high-resolution volumetric imaging is a central resource for diagnosis and treatment in modern medicine. While the fast development of AI enhances imaging and analysis, commonly used visualization methods lag far behind. Recent research used extended reality (XR) for perceiving 3D images with visual depth perception and touch, but used restricting haptic devices. While unrestricted touch is beneficial for volumetric data examination, implementing natural haptic interaction with XR is challenging. The research question is whether a multimodal XR application with intutitive haptic interaction adds value and should be pursued. In a study, 24 expterts for biomedical images in research and medicine. explored 3D anatomical medical shapes with 3 applications: a multimodal virtual reality (VR) prototype using haptic gloves, a simple VR prototype using VR controllers, and a commonly used standard PC application. Results of the standardized questionnaires showed no significant differences between the three application types regarding usability and no significant difference between both VR applications regarding presence. Participants agreed to statements that VR visualizations provide better depth information, that using the hands instead of controllers simplifies data exploration, that the multimodal VR prototype allows intuitive data exploration, and that it is beneficial over traditional data examination methods. While most participants mentioned the manual interaction as best aspect, they also found it the most improvable. We conclude that a multimodal XR application with improved manual interaction adds value for volumetric biomedical data examination. We will proceed with our open-source research project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to serve medical education, therapeutic decisions, surgery preparations, or research data analysis.
Fostering Human Learning in Sequential Decision-Making: Understanding the Role of Evaluative Feedback

Cognitive rehabilitation, STEM skill acquisition, and coaching games such as chess often require tutoring decision-making strategies. The advancement of AI-driven tutoring systems for facilitating human learning requires an understanding of the impact of evaluative feedback on human decision-making and skill development. To this end, we conduct human experiments using Amazon Mechanical Turk to study the influence of evaluative feedback on human decision-making in sequential tasks. In these experiments, participants solve the Tower of Hanoi puzzle and receive AI-generated feedback while solving it. We examine how this feedback affects their learning and skill transfer to related tasks. We also explore various computational models to understand how people incorporate evaluative feedback into their decision-making processes.
Principal modes of multimode fibers resisting fiber bending

Multimode fibers (MMFs) have found wide application across various fields, such as optical communications, mode-locked lasers, and endoscopy. However, the practical use of MMFs is limited by the challenges posed by fiber bending, which leads to mode coupling. In this study, we present evidence that MMFs possess principal modes, named curved principal modes, that can resist significant bending. These curved principal modes are identified by extending the Wigner-Smith operator to curved MMFs, and are demonstrated for arbitrary bending by numerical simulations. These findings have substantial implications for mode-divide-multiplexed optical fiber communications, MMF-based endoscopy, and other related applications.
Learning Super-Resolution Ultrasound Localization Microscopy from Radio-Frequency Data

Ultrasound Localization Microscopy (ULM) enables imaging of vascular structures in the micrometer range by accumulating contrast agent particle locations over time. Precise and efficient target localization accuracy remains an active research topic in the ULM field to further push the boundaries of this promising medical imaging technology. Existing work incorporates Delay-And-Sum (DAS) beamforming into particle localization pipelines, which ultimately determines the ULM image resolution capability. In this paper we propose to feed unprocessed Radio-Frequency (RF) data into a super-resolution network while bypassing DAS beamforming and its limitations. To facilitate this, we demonstrate label projection and inverse point transformation between B-mode and RF coordinate space as required by our approach. We assess our method against state-of-the-art techniques based on a public dataset featuring in silico and in vivo data. Results from our RF-trained network suggest that excluding DAS beamforming offers a great potential to optimize on the ULM resolution performance.
Distributed Parameter Estimation with Gaussian Observation Noises in Time-varying Digraphs

In this paper, we consider the problem of distributed parameter estimation in sensor networks. Each sensor makes successive observations of an unknown $d$-dimensional parameter, which might be subject to Gaussian random noises. The sensors aim to infer the true value of the unknown parameter by cooperating with each other. To this end, we first generalize the so-called dynamic regressor extension and mixing (DREM) algorithm to stochastic systems, with which the problem of estimating a $d$-dimensional vector parameter is transformed to that of $d$ scalar ones: one for each of the unknown parameters. For each of the scalar problem, both combine-then-adapt (CTA) and adapt-then-combine (ATC) diffusion-based estimation algorithms are given, where each sensor performs a combination step to fuse the local estimates in its in-neighborhood, alongside an adaptation step to process its streaming observations. Under weak conditions on network topology and excitation of regressors, we show that the proposed estimators guarantee that each sensor infers the true parameter, even if any individual of them cannot by itself. Specifically, it is required that the union of topologies over an interval with fixed length is strongly connected. Moreover, the sensors must collectively satisfy a cooperative persistent excitation (PE) condition, which relaxes the traditional PE condition. Numerical examples are finally provided to illustrate the established results.
Low frequency electrodynamics in the mixed state of superconducting NbN and a-MoGe films using two-coil mutual inductance technique

We investigate the low-frequency electrodynamics in the vortex state of two type-II superconducting films, namely, a moderate-to-strongly pinned Niobium Nitride (NbN) and a very weakly pinned amorphous Molybdenum Germanium (a-MoGe). We employ a two-coil mutual inductance technique to extract the complex penetration depth, $\tilde{\lambda}$. The sample response is studied through the temperature variation of $\tilde{\lambda}$ in the mixed state, where we employ a model developed by Coffey and Clem (CC model) to extract the different vortex lattice (VL) parameters such as the restoring pinning force constant (Labusch parameter), VL drag coefficient and pinning potential barrier. We observe that a consistent description of the inductive and dissipative part of the response is only possible when we take the viscous drag on the vortices to be several orders of magnitudes larger than viscous drag estimated from the Bardeen-Stephen model.
Unscrambling the Rectification of Adversarial Attacks Transferability across Computer Networks

Convolutional neural networks (CNNs) models play a vital role in achieving state-of-the-art performances in various technological fields. CNNs are not limited to Natural Language Processing (NLP) or Computer Vision (CV) but also have substantial applications in other technological domains, particularly in cybersecurity. The reliability of CNN's models can be compromised because of their susceptibility to adversarial attacks, which can be generated effortlessly, easily applied, and transferred in real-world scenarios. In this paper, we present a novel and comprehensive method to improve the strength of attacks and assess the transferability of adversarial examples in CNNs when such strength changes, as well as whether the transferability property issue exists in computer network applications. In the context of our study, we initially examined six distinct modes of attack: the Carlini and Wagner (C&W), Fast Gradient Sign Method (FGSM), Iterative Fast Gradient Sign Method (I-FGSM), Jacobian-based Saliency Map (JSMA), Limited-memory Broyden fletcher Goldfarb Shanno (L-BFGS), and Projected Gradient Descent (PGD) attack. We applied these attack techniques on two popular datasets: the CIC and UNSW datasets. The outcomes of our experiment demonstrate that an improvement in transferability occurs in the targeted scenarios for FGSM, JSMA, LBFGS, and other attacks. Our findings further indicate that the threats to security posed by adversarial examples, even in computer network applications, necessitate the development of novel defense mechanisms to enhance the security of DL-based techniques.
Inertial Guided Uncertainty Estimation of Feature Correspondence in Visual-Inertial Odometry/SLAM

Visual odometry and Simultaneous Localization And Mapping (SLAM) has been studied as one of the most important tasks in the areas of computer vision and robotics, to contribute to autonomous navigation and augmented reality systems. In case of feature-based odometry/SLAM, a moving visual sensor observes a set of 3D points from different viewpoints, correspondences between the projected 2D points in each image are usually established by feature tracking and matching. However, since the corresponding point could be erroneous and noisy, reliable uncertainty estimation can improve the accuracy of odometry/SLAM methods. In addition, inertial measurement unit is utilized to aid the visual sensor in terms of Visual-Inertial fusion. In this paper, we propose a method to estimate the uncertainty of feature correspondence using an inertial guidance robust to image degradation caused by motion blur, illumination change and occlusion. Modeling a guidance distribution to sample possible correspondence, we fit the distribution to an energy function based on image error, yielding more robust uncertainty than conventional methods. We also demonstrate the feasibility of our approach by incorporating it into one of recent visual-inertial odometry/SLAM algorithms for public datasets.
Osprey: Multi-Session Autonomous Aerial Mapping with LiDAR-based SLAM and Next Best View Planning

Aerial mapping systems are important for many surveying applications (e.g., industrial inspection or agricultural monitoring). Aerial platforms that can fly GPS-guided preplanned missions semi-autonomously are already widely available but fully autonomous systems can significantly improve efficiency. Autonomously mapping complex 3D structures requires a system that performs online mapping and mission planning. This paper presents Osprey, an autonomous aerial mapping system with state-of-the-art multi-session LiDAR-based mapping capabilities. It enables a non-expert operator to specify a bounded target area that the aerial platform can then map autonomously over multiple flights. Field experiments with Osprey demonstrate that this system can achieve greater map coverage of large industrial sites than manual surveys with a pilot-flown aerial platform or a terrestrial laser scanner (TLS). Three sites, with a total ground coverage of $2528$ m$^2$ and a maximum height of $27$ m, were mapped in separate missions using $112$ minutes of autonomous flight time. True colour maps were created from images captured by Osprey using pointcloud and NeRF reconstruction methods. These maps provide useful data for structural inspection tasks.
Beyond Traditional Beamforming: Singular Vector Projection Techniques for MU-MIMO Interference Management

This paper introduces low-complexity beamforming algorithms for multi-user multiple-input multiple-output (MU-MIMO) systems to minimize inter-user interference and enhance spectral efficiency (SE). A Singular-Vector Beamspace Search (SVBS) algorithm is initially presented, wherein all the singular vectors are assessed to determine the most effective beamforming scheme. We then establish a mathematical proof demonstrating that the total inter-user interference of a MU-MIMO beamforming system can be efficiently calculated from the mutual projections of orthonormal singular vectors. Capitalizing on this, we present an Interference-optimized Singular Vector Beamforming (IOSVB) algorithm for optimal singular vector selection. For further reducing the computational burden, we propose a Dimensionality-reduced IOSVB (DR-IOSVB) algorithm by integrating the principal component analysis (PCA). The numerical results demonstrate the superiority of the SVBS algorithm over the existing algorithms, with the IOSVB offering near-identical SE and the DR-IOSVB balancing the performance and computational efficiency. This work establishes a new benchmark for high-performance and low-complexity beamforming in MU-MIMO wireless communication systems.
In-Context Exemplars as Clues to Retrieving from Large Associative Memory

Recently, large language models (LLMs) have made remarkable progress in natural language processing. The most representative ability of LLMs is in-context learning (ICL), which enables LLMs to learn patterns from in-context exemplars without training. The performance of ICL greatly depends on the exemplars used. However, how to choose exemplars remains unclear due to the lack of understanding of how in-context learning works. In this paper, we present a novel perspective on ICL by conceptualizing it as contextual retrieval from a model of associative memory. We establish a theoretical framework of ICL based on Hopfield Networks. Based on our framework, we look into how in-context exemplars influence the performance of ICL and propose more efficient active exemplar selection. Our study sheds new light on the mechanism of ICL by connecting it to memory retrieval, with potential implications for advancing the understanding of LLMs.
Separating and Learning Latent Confounders to Enhancing User Preferences Modeling

Recommender models aim to capture user preferences from historical feedback and then predict user-specific feedback on candidate items. However, the presence of various unmeasured confounders causes deviations between the user preferences in the historical feedback and the true preferences, resulting in models not meeting their expected performance. Existing debias models either (1) specific to solving one particular bias or (2) directly obtain auxiliary information from user historical feedback, which cannot identify whether the learned preferences are true user preferences or mixed with unmeasured confounders. Moreover, we find that the former recommender system is not only a successor to unmeasured confounders but also acts as an unmeasured confounder affecting user preference modeling, which has always been neglected in previous studies. To this end, we incorporate the effect of the former recommender system and treat it as a proxy for all unmeasured confounders. We propose a novel framework, \textbf{S}eparating and \textbf{L}earning Latent Confounders \textbf{F}or \textbf{R}ecommendation (\textbf{SLFR}), which obtains the representation of unmeasured confounders to identify the counterfactual feedback by disentangling user preferences and unmeasured confounders, then guides the target model to capture the true preferences of users. Extensive experiments in five real-world datasets validate the advantages of our method.
Raman Spectroscopy Reveals Photobiomodulation-Induced {\alpha}-Helix to {\beta}-Sheet Transition in Tubulins: Potential Implications for Alzheimer's and Other Neurodegenerative Diseases

In this study, we employed a Raman spectroscopic analysis of the amide I band of polymerized samples of tubulin exposed to pulsed low-intensity NIR radiation (810 nm, 10 Hz, 22.5 J/cm$^{2}$ dose). Peaks in the Raman fingerprint region (300$\unicode{x2013}$1900 cm$^{-1}$), in particular, in the amide I band (1600$\unicode{x2013}$1700 cm$^{-1}$), can be used to quantify the percentage of protein secondary structures. Under this band, hidden signals of $\mathrm{C}$=$\mathrm{O}$ stretching, belonging to different structures, are superimposed$\unicode{x2014}$producing a complex signal as a result. An accurate decomposition of the amide I band is therefore required for the reliable analysis of the conformation of proteins, which we achieved through a straightforward method employing a Voigt profile. This approach was validated through secondary structure analyses of unexposed control samples, for which comparisons with other values available in the literature could be conducted. Subsequently, using this validated method, we present novel findings of statistically significant alterations in the secondary structures of NIR-exposed tubulin, characterized by a notable decrease in alpha-helix content and a concurrent increase in beta-sheets compared to the control samples. The alpha-helix to beta-sheet transition suggests that PBM reduces microtubule stability and introduces dynamism to allow for the remodeling and, consequently, refreshing of microtubule structures. This newly discovered mechanism could have implications for reducing the risks associated with brain aging, including neurodegenerative diseases like Alzheimer's disease.
Polarization of Intrabinary Shock Emission in Spider Pulsars

In so-called spider pulsars, the X-ray band is dominated by intrabinary shock (IBS) synchrotron emission. While the double-peaked X-ray light curves from these shocks have been well characterized in several spider systems (both black widows and redbacks), the polarization of this emission is yet to be studied. Motivated by the new polarization capability of the Imaging X-ray Polarization Explorer and the confirmation of highly ordered magnetic fields in pulsar wind nebulae, we model the IBS polarization by employing two potential magnetic field configurations: toroidal magnetic fields imposed by the preshock pulsar wind, and tangential shock-generated fields that follow the postshock flow. We find that if IBSs host ordered magnetic fields, the synchrotron X-rays from spider binaries can display a high degree of polarization (≳50%), while the variation in polarization angle provides a good probe of the binary geometry and the magnetic field structure. Our results encourage observational polarization studies of spider pulsars that can distinguish the proposed magnetic models and that constrain the unique properties of these systems better.
ProPath: Disease-Specific Protein Language Model for Variant Pathogenicity

Clinical variant classification of pathogenic versus benign genetic variants remains a pivotal challenge in clinical genetics. Recently, the proposition of protein language models has improved the generic variant effect prediction (VEP) accuracy via weakly-supervised or unsupervised training. However, these VEPs are not disease-specific, limiting their adaptation at point-of-care. To address this problem, we propose a disease-specific \textsc{pro}tein language model for variant \textsc{path}ogenicity, termed ProPath, to capture the pseudo-log-likelihood ratio in rare missense variants through a siamese network. We evaluate the performance of ProPath against pre-trained language models, using clinical variant sets in inherited cardiomyopathies and arrhythmias that were not seen during training. Our results demonstrate that ProPath surpasses the pre-trained ESM1b with an over $5\%$ improvement in AUC across both datasets. Furthermore, our model achieved the highest performances across all baselines for both datasets. Thus, our ProPath offers a potent disease-specific variant effect prediction, particularly valuable for disease associations and clinical applicability.
What is Lost in Knowledge Distillation?

Deep neural networks (DNNs) have improved NLP tasks significantly, but training and maintaining such networks could be costly. Model compression techniques, such as, knowledge distillation (KD), have been proposed to address the issue; however, the compression process could be lossy. Motivated by this, our work investigates how a distilled student model differs from its teacher, if the distillation process causes any information losses, and if the loss follows a specific pattern. Our experiments aim to shed light on the type of tasks might be less or more sensitive to KD by reporting data points on the contribution of different factors, such as the number of layers or attention heads. Results such as ours could be utilized when determining effective and efficient configurations to achieve optimal information transfers between larger (teacher) and smaller (student) models.
Asynchronous Local Computations in Distributed Bayesian Learning

Due to the expanding scope of machine learning (ML) to the fields of sensor networking, cooperative robotics and many other multi-agent systems, distributed deployment of inference algorithms has received a lot of attention. These algorithms involve collaboratively learning unknown parameters from dispersed data collected by multiple agents. There are two competing aspects in such algorithms, namely, intra-agent computation and inter-agent communication. Traditionally, algorithms are designed to perform both synchronously. However, certain circumstances need frugal use of communication channels as they are either unreliable, time-consuming, or resource-expensive. In this paper, we propose gossip-based asynchronous communication to leverage fast computations and reduce communication overhead simultaneously. We analyze the effects of multiple (local) intra-agent computations by the active agents between successive inter-agent communications. For local computations, Bayesian sampling via unadjusted Langevin algorithm (ULA) MCMC is utilized. The communication is assumed to be over a connected graph (e.g., as in decentralized learning), however, the results can be extended to coordinated communication where there is a central server (e.g., federated learning). We theoretically quantify the convergence rates in the process. To demonstrate the efficacy of the proposed algorithm, we present simulations on a toy problem as well as on real world data sets to train ML models to perform classification tasks. We observe faster initial convergence and improved performance accuracy, especially in the low data range. We achieve on average 78% and over 90% classification accuracy respectively on the Gamma Telescope and mHealth data sets from the UCI ML repository.
Incentive Design for Eco-driving in Urban Transportation Networks

Eco-driving emerges as a cost-effective and efficient strategy to mitigate greenhouse gas emissions in urban transportation networks. Acknowledging the persuasive influence of incentives in shaping driver behavior, this paper presents the `eco-planner,' a digital platform devised to promote eco-driving practices in urban transportation. At the outset of their trips, users provide the platform with their trip details and travel time preferences, enabling the eco-planner to formulate personalized eco-driving recommendations and corresponding incentives, while adhering to its budgetary constraints. Upon trip completion, incentives are transferred to users who comply with the recommendations and effectively reduce their emissions. By comparing our proposed incentive mechanism with a baseline scheme that offers uniform incentives to all users, we demonstrate that our approach achieves superior emission reductions and increased user compliance with a smaller budget.