Miracle-dz/UniFAR-FTUs huggingface dataset:
Substitution and Flip BDDs

In a microscope, a nosepiece support assembly and a coarse and fine adjustment mechanism in direct operative control of the support assembly, the support assembly including a nosepiece mounting carriage with a depending rod rigid therewith and mounting a cam follower which rides on the edge of a cam, rotation of which is controlled by the adjustment mechanism. The adjustment mechanism in turn includes a reduction gear assembly utilizing dual gear trains and mounted to a cam-mounting shaft externally of the frame of the microscope and housed within a coarse adjustment handwheel for immediate access thereto. One of the gear trains incorporates a compound gear having a torsion spring between the individual gears to enhance gear train interengagement throughout the gear assembly.
Models for exceedances over high thresholds

We discuss the analysis of the extremes of data by modelling the sizes and occurrence of exceedances over high thresholds. The natural distribution for such exceedances, the generalized Pareto distribution, is described and its properties elucidated. Estimation and model-checking procedures for univariate and regression data are developed, and the influence of and information contained in the most extreme observations in a sample are studied. Models for seasonality and serial dependence in the point process of exceedances are described. Sets of data on river flows and wave heights are discussed, and an application to the siting of nuclear installations is described
Decision-Focused Learning: Through the Lens of Learning to Rank

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the objective function of a discrete combinatorial optimization problem for decision making. Decision-focused learning proposes to train the ML models, often neural network models, by directly optimizing the quality of decisions made by the optimization solvers. Based on a recent work that proposed a noise contrastive estimation loss over a subset of the solution space, we observe that decision-focused learning can more generally be seen as a learning-to-rank problem, where the goal is to learn an objective function that ranks the feasible points correctly. This observation is independent of the optimization method used and of the form of the objective function. We develop pointwise, pairwise and listwise ranking loss functions, which can be differentiated in closed form given a subset of solutions. We empirically investigate the quality of our generic methods compared to existing decision-focused learning approaches with competitive results. Furthermore, controlling the subset of solutions allows controlling the runtime considerably, with limited effect on regret.
Coupled effects of channels and synaptic dynamics in stochastic modelling of healthy and Parkinson's-disease-affected brains

Our brain is a complex information processing network in which the nervous system receives information from the environment to quickly react to incoming events or learns from experience to sharp our memory. In the nervous system, the brain states translate collective activities of neurons interconnected via synaptic connections. In this paper, we study coupled effects of channels and synaptic dynamics under the stochastic influence of healthy brain cells with applications to Parkinson's disease (PD). In particular, we investigate the effects of random inputs in a subthalamic nucleus (STN) cell membrane potential model. The STN bursting phenomena and parkinsonian hypokinetic motor symptoms are closely connected, as electrical and chemical maneuvers modulating STN bursts are sufficient to ameliorate or mimic parkinsonian motor deficits. Deep brain stimulation (DBS) of the STN is an important surgical technique used in the treatment to improve PD symptoms. Our numerical results show that the random inputs strongly affect the spiking activities of the STN neuron not only in the case of healthy cells but also in the case of PD cells in the presence of DBS treatment. Specifically, the existence of a random refractory period together with random input current in the system may substantially influence an increased irregularity of spike trains of the output neurons.
Adapting the Linearised Laplace Model Evidence for Modern Deep Learning

The linearised Laplace method for estimating model uncertainty has received renewed attention in the Bayesian deep learning community. The method provides reliable error bars and admits a closed-form expression for the model evidence, allowing for scalable selection of model hyperparameters. In this work, we examine the assumptions behind this method, particularly in conjunction with model selection. We show that these interact poorly with some now-standard tools of deep learning--stochastic approximation methods and normalisation layers--and make recommendations for how to better adapt this classic method to the modern setting. We provide theoretical support for our recommendations and validate them empirically on MLPs, classic CNNs, residual networks with and without normalisation layers, generative autoencoders and transformers.
Search engine effects on news consumption: ranking and representativeness outweigh familiarity on news selection

While individuals’ trust in search engine results is well-supported, little is known about their preferences when selecting news. We use web-tracked behavioral data across a 2-month period (280 participants) and we analyze three competing factors, two algorithmic (ranking and representativeness) and one psychological (familiarity), that could influence the selection of search results. We use news engagement as a proxy for familiarity and investigate news articles presented on Google search pages ( n = 1221). We find a significant effect of algorithmic factors but not of familiarity. We find that ranking plays a lesser role for news compared to non-news, suggesting a more careful decision-making process. We confirm that Google Search drives individuals to unfamiliar sources, and find that it increases the diversity of the political audience of news sources. We tackle the challenge of measuring social science theories in contexts shaped by algorithms, demonstrating their leverage over the behaviors of individuals.
GMI-DRL: Empowering Multi-GPU Deep Reinforcement Learning with GPU Spatial Multiplexing

With the increasing popularity of robotics in industrial control and autonomous driving, deep reinforcement learning (DRL) raises the attention of various ﬁelds. However, DRL computation on the modern powerful GPU platform is still inefﬁcient due to its heterogeneous workloads and interleaved execution paradigm. To this end, we propose GMI-DRL , a systematic design to accelerate multi-GPU DRL via GPU spatial multiplexing. We introduce a novel design of resource-adjustable GPU multiplexing instances (GMIs) to match the actual needs of DRL tasks, an adaptive GMI management strategy to si-multaneously achieve high GPU utilization and computation throughput, and a highly efﬁcient inter-GMI communication support to meet the demands of various DRL communication patterns. Comprehensive experiments reveal that GMI-DRL outperforms state-of-the-art NVIDIA Isaac Gym with NCCL (up to 2.81 × ) and Horovod (up to 2.34 × ) support in training throughput on the latest DGX-A100 platform. Our work provides an initial user experience with GPU spatial multiplexing in processing heterogeneous workloads with a mixture of computation and communication.
Edge-Aided Sensor Data Sharing in Vehicular Communication Networks

Sensor data sharing in vehicular networks can significantly improve the range and accuracy of environmental perception for connected automated vehicles. Different concepts and schemes for dissemination and fusion of sensor data have been developed. It is common to these schemes that measurement errors of the sensors impair the perception quality and can result in road traffic accidents. Specifically, when the measurement error from the sensors - also referred as measurement noise - is unknown and time varying, the performance of the data fusion process is restricted, which represents a major challenge in the calibration of sensors. In this paper, we consider sensor data sharing and fusion in a vehicular network with both, vehicle-to-infrastructure and vehicle-to-vehicle communication. We propose a method, named Bidirectional Feedback Noise Estimation (BiFNoE), in which an edge server collects and caches sensor measurement data from vehicles. The edge estimates the noise and the targets alternately in double dynamic sliding time windows and enhances the distributed cooperative environment sensing at each vehicle with low communication costs. We evaluate the proposed algorithm and data dissemination strategy in an application scenario by simulation and show that the perception accuracy is on average improved by around 80% with only 12 kbps uplink and 28 kbps downlink bandwidth.
Understanding Decision-Time vs. Background Planning in Model-Based Reinforcement Learning

In model-based reinforcement learning, an agent can leverage a learned model to improve its way of behaving in different ways. Two prevalent approaches are decision-time planning and background planning. In this study, we are interested in understanding under what conditions and in which settings one of these two planning styles will perform better than the other in domains that require fast responses. After viewing them through the lens of dynamic programming, we first consider the classical instantiations of these planning styles and provide theoretical results and hypotheses on which one will perform better in the pure planning, planning&learning, and transfer learning settings. We then consider the modern instantiations of these planning styles and provide hypotheses on which one will perform better in the last two of the considered settings. Lastly, we perform several illustrative experiments to empirically validate both our theoretical results and hypotheses. Overall, our findings suggest that even though decision-time planning does not perform as well as background planning in their classical instantiations, in their modern instantiations, it can perform on par or better than background planning in both the planning&learning and transfer learning settings.
On Efficient Real-Time Semantic Segmentation: A Survey

Semantic segmentation is the problem of assigning a class label to every pixel in an image, and is an important component of an autonomous vehicle vision stack for facilitating scene understanding and object detection. However, many of the top performing semantic segmentation models are extremely complex and cumbersome, and as such are not suited to deployment onboard autonomous vehicle platforms where computational resources are limited and low-latency operation is a vital requirement. In this survey, we take a thorough look at the works that aim to address this misalignment with more compact and efficient models capable of deployment on low-memory embedded systems while meeting the constraint of real-time inference. We discuss several of the most prominent works in the field, placing them within a taxonomy based on their major contributions, and finally we evaluate the inference speed of the discussed models under consistent hardware and software setups that represent a typical research environment with high-end GPU and a realistic deployed scenario using low-memory embedded GPU hardware. Our experimental results demonstrate that many works are capable of real-time performance on resource-constrained hardware, while illustrating the consistent trade-off between latency and accuracy.
Physics Informed Neural Networks for Two Dimensional Incompressible Thermal Convection Problems

Physics informed neural networks (PINNs) have drawn attention in recent years in engineering problems due to their effectiveness and ability to tackle the problems without generating complex meshes. PINNs use automatic differentiation to evaluate differential operators in conservation laws and hence do not need to have a discretization scheme. Using this ability, PINNs satisfy governing laws of physics in the loss function without any training data. In this work, we solve various incompressible thermal convection problems including real applications and problems with comparable numerical or analytical results. We ﬁrst consider a channel problem with an analytical solution to show the accuracy of our network. Then, we solve a thermal convection problem in a closed enclosure in which the ﬂow is only due to the temperature gradients on the boundaries. Lastly, we consider steady and unsteady partially blocked channel problems that resemble industrial applications to power electronics.
Revisiting Self-Distillation

Knowledge distillation is the procedure of transferring"knowledge"from a large model (the teacher) to a more compact one (the student), often being used in the context of model compression. When both models have the same architecture, this procedure is called self-distillation. Several works have anecdotally shown that a self-distilled student can outperform the teacher on held-out data. In this work, we systematically study self-distillation in a number of settings. We first show that even with a highly accurate teacher, self-distillation allows a student to surpass the teacher in all cases. Secondly, we revisit existing theoretical explanations of (self) distillation and identify contradicting examples, revealing possible drawbacks of these explanations. Finally, we provide an alternative explanation for the dynamics of self-distillation through the lens of loss landscape geometry. We conduct extensive experiments to show that self-distillation leads to flatter minima, thereby resulting in better generalization.
TLETA: Deep Transfer Learning and Integrated Cellular Knowledge for Estimated Time of Arrival Prediction

Estimated time of arrival (ETA) is a critical component of intelligent transportation systems. Though many tools exist for ETA, ETA for special vehicles, such as ambulances, fire engines, etc., is still challenging due to the limited amount of traffic data for special vehicles. Existing works use one model for all types of vehicles, which can lead to low accuracy. To tackle this, as the first in the field, we propose a deep transfer learning framework TLETA for the driving time prediction. TLETA constructs cellular spatial-temporal knowledge grids for extracting driving patterns, combined with the road network structure embedding to build a deep neural network for ETA. TLETA also supports knowledge transfer between different categories of vehicles. Importantly, our transfer models only train the last layers to map the transferred knowledge, which reduces the training time significantly. The experimental studies show that our model outperforms many state-of-the-art approaches in training efficiency and prediction accuracy.
Language with Vision: a Study on Grounded Word and Sentence Embeddings

Grounding language in vision is an active field of research seeking to construct cognitively plausible word and sentence representations by incorporating perceptual knowledge from vision into text-based representations. Despite many attempts at language grounding, achieving an optimal equilibrium between textual representations of the language and our embodied experiences remains an open field. Some common concerns are the following. Is visual grounding advantageous for abstract words, or is its effectiveness restricted to concrete words? What is the optimal way of bridging the gap between text and vision? To what extent is perceptual knowledge from images advantageous for acquiring high-quality embeddings? Leveraging the current advances in machine learning and natural language processing, the present study addresses these questions by proposing a simple yet very effective computational grounding model for pre-trained word embeddings. Our model effectively balances the interplay between language and vision by aligning textual embeddings with visual information while simultaneously preserving the distributional statistics that characterize word usage in text corpora. By applying a learned alignment, we are able to indirectly ground unseen words including abstract words. A series of evaluations on a range of behavioral datasets shows that visual grounding is beneficial not only for concrete words but also for abstract words, lending support to the indirect theory of abstract concepts. Moreover, our approach offers advantages for contextualized embeddings, such as those generated by BERT (Devlin et al, 2018), but only when trained on corpora of modest, cognitively plausible sizes. Code and grounded embeddings for English are available at ( https://github.com/Hazel1994/Visually_Grounded_Word_Embeddings_2 ).
Leveraging Uncertainty in Deep Learning for Pancreatic Adenocarcinoma Grading

Pancreatic cancers have one of the worst prognoses compared to other cancers, as they are diagnosed when cancer has progressed towards its latter stages. The current manual histological grading for diagnosing pancreatic adenocarcinomas is time-consuming and often results in misdiagnosis. In digital pathology, AI-based cancer grading must be extremely accurate in prediction and uncertainty quantification to improve reliability and explainability and are essential for gaining clinicians trust in the technology. We present Bayesian Convolutional Neural Networks for automated pancreatic cancer grading from MGG and HE stained images to estimate uncertainty in model prediction. We show that the estimated uncertainty correlates with prediction error. Specifically, it is useful in setting the acceptance threshold using a metric that weighs classification accuracy-reject trade-off and misclassification cost controlled by hyperparameters and can be employed in clinical settings.
What can Speech and Language Tell us About the Working Alliance in Psychotherapy

We are interested in the problem of conversational analysis and its application to the health domain. Cognitive Behavioral Therapy is a structured approach in psychotherapy, allowing the therapist to help the patient to identify and modify the malicious thoughts, behavior, or actions. This cooperative effort can be evaluated using the Working Alliance Inventory Observer-rated Shortened – a 12 items inventory covering task, goal, and relationship – which has a relevant influence on therapeutic outcomes. In this work, we investigate the relation between this alliance inventory and the spoken conversations (sessions) between the patient and the psychotherapist. We have delivered eight weeks of e-therapy, collected their audio and video call sessions, and manually transcribed them. The spoken conversations have been annotated and evaluated with WAI ratings by professional therapists. We have investigated speech and language features and their association with WAI items. The feature types include turn dynamics, lexical entrainment, and conversational descriptors extracted from the speech and language signals. Our findings provide strong evidence that a subset of these features are strong indicators of working alliance. To the best of our knowledge, this is the first and a novel study to exploit speech and language for characterising working alliance.
A novel design of industrial real-time CT system based on sparse-view reconstruction and deep-learning image enhancement

Industrial CT is useful for defect detection, dimensional inspection and geometric analysis. While it does not meet the needs of industrial mass production, because of its time-consuming imaging procedure. This article proposes a novel stationary real-time CT system with multiple X-ray sources and detectors, which is able to refresh the CT reconstructed slices to the detector frame frequency. This kind of structure avoids the movement of the X-ray sources and detectors. Projections from different angles can be acquired with the objects' translation, which makes it easier to be integrated into pipeline. All the detectors are arranged along the conveyor, and observe the objects in different angle of view. With the translation of objects, their X-ray projections are obtained for CT reconstruction. To decrease the mechanical size and reduce the number of X-ray sources and detectors, the FBP reconstruction algorithm was combined with deep-learning image enhancement. Medical CT images were applied to train the deep-learning network for its quantity advantage in comparison with industrial ones. It is the first time to adopt this source-detector layout strategy. Data augmentation and regularization were used to elevate the generalization of the network. Time consumption of the CT imaging process was also calculated to prove its high efficiency. It is an innovative design for the 4th industrial revolution, providing an intelligent quality inspection solution for digital production.
Influence of the surface states on the nonlinear Hall effect in Weyl semimetals

We investigate the inﬂuence of surface states on the nonlinear Hall response of noncentrosymmetric time-reversal invariant Weyl semimetals. To do so, we perform a tomography of the Berry curvature dipole in a slab system using a minimal two-band model. We ﬁnd that in the type-I phase, the nonlinear Hall response is not particularly sensitive to the presence of Fermi arcs or other trivial surface states. However, in the type-II phase, we ﬁnd that these surface states contribute substantially to the Berry curvature dipole, leading to a strong thickness dependence of the nonlinear Hall response. This feature depends on the nature of the surface states and, henceforth, on the slab geometry adopted. In order to assess the validity of this scenario for realistic systems, we performed Berry curvature dipole calculations by ﬁrst principles on the WTe 2 , conﬁrming the dramatic impact of surface states for selected slab geometries. Our results suggest that surface states, being topological or not, can contribute much more eﬃciently to the nonlinear Hall response than bulk states. This prediction is not limited to topological semimetals and should apply to topologically trivial non-centrosymmetric materials and heterostructures, paving the way to interfacial engineering of the nonlinear Hall eﬀect.
An Algorithm for the SE(3)-Transformation on Neural Implicit Maps for Remapping Functions

Implicit representations are widely used for object reconstruction due to their efficiency and flexibility. In 2021, a novel structure named neural implicit map has been invented for incremental reconstruction. A neural implicit map alleviates the problem of inefficient memory cost of previous online 3D dense reconstruction while producing better quality. However, the neural implicit map suffers the limitation that it does not support remapping as the frames of scans are encoded into a deep prior after generating the neural implicit map. This means, that neither this generation process is invertible, nor a deep prior is transformable. The non-remappable property makes it not possible to apply loop-closure techniques. We present a neural implicit map based transformation algorithm to fill this gap. As our neural implicit map is transformable, our model supports remapping for this special map of latent features. Experiments show that our remapping module is capable to well-transform neural implicit maps to new poses. Embedded into a SLAM framework, our mapping model is able to tackle the remapping of loop closures and demonstrates high-quality surface reconstruction. Our implementation is available at github11https://github.com/Jarrome/IMT_Mapping for the research community.