Miracle-dz/UniFAR-FTUs huggingface dataset:
RusTitW: Russian Language Text Dataset for Visual Text in-the-Wild Recognition

Information surrounds people in modern life. Text is a very efficient type of information that people use for communication for centuries. However, automated text-in-the-wild recognition remains a challenging problem. The major limitation for a DL system is the lack of training data. For the competitive performance, training set must contain many samples that replicate the real-world cases. While there are many high-quality datasets for English text recognition; there are no available datasets for Russian language. In this paper, we present a large-scale human-labeled dataset for Russian text recognition in-the-wild. We also publish a synthetic dataset and code to reproduce the generation process
Magnetic imaging of ion-irradiation patterned Co/Pt multilayers using complementary electron and photon probes

The three-dimensional magnetic structure and reversal mechanism of patterned Co/Pt multilayers, were imaged using complementary Lorentz transmission electron microscopy (LTEM) (in-plane component) and magnetic transmission x-ray microscopy (M-TXM) (perpendicular magnetization). The Co/Pt films with perpendicular anisotropy were patterned by ion irradiation through a stencil mask to produce in-plane magnetization in the irradiated regions. The boundaries of the patterns, defined by the transition from out-of-plane to in-plane magnetization, were found to be determined by the stencil mask, whilst the scale of the magnetic reversal by the physical microstructure. The nucleation fields were substantially reduced to 50 Oe for the in-plane regions and 1 kOe for the perpendicular regions, comparing to 4.5 kOe for the as-grown film. The perpendicular reversals were found to always originate at the pattern boundaries.
NerVE: Neural Volumetric Edges for Parametric Curve Extraction from Point Cloud

Extracting parametric edge curves from point clouds is a fundamental problem in 3D vision and geometry processing. Existing approaches mainly rely on keypoint detection, a challenging procedure that tends to generate noisy out-put, making the subsequent edge extraction error-prone. To address this issue, we propose to directly detect structured edges to circumvent the limitations of the previous point-wise methods. We achieve this goal by presenting NerVE, a novel neural volumetric edge representation that can be easily learned through a volumetric learning framework. NerVE can be seamlessly converted to a versatile piece-wise lin-ear (PWL) curve representation, enabling a unified strategy for learning all types offree-form curves. Furthermore, as NerVE encodes rich structural information, we show that edge extraction based on NerVE can be reduced to a simple graph search problem. After converting NerVE to the PWL representation, parametric curves can be obtained via off-the-shelf spline fitting algorithms. We evaluate our method on the challenging ABC dataset [19]. We show that a sim-ple network based on NerVE can already outperform the previous state-of-the-art methods by a great margin.
The Need for Inherently Privacy-Preserving Vision in Trustworthy Autonomous Systems

Vision is a popular and effective sensor for robotics from which we can derive rich information about the environment: the geometry and semantics of the scene, as well as the age, gender, identity, activity and even emotional state of humans within that scene. This raises important questions about the reach, lifespan, and potential misuse of this information. This paper is a call to action to consider privacy in the context of robotic vision. We propose a specific form privacy preservation in which no images are captured or could be reconstructed by an attacker even with full remote access. We present a set of principles by which such systems can be designed, and through a case study in localisation demonstrate in simulation a specific implementation that delivers an important robotic capability in an inherently privacy-preserving manner. This is a first step, and we hope to inspire future works that expand the range of applications open to sighted robotic systems.
Systematic KMTNet Planetary Anomaly Search. X. Complete Sample of 2017 Prime-field Planets

We complete the analysis of planetary candidates found by the KMT AnomalyFinder for the 2017 prime fields that cover ∼13 deg2. We report three unambiguous planets: OGLE-2017-BLG-0640, OGLE-2017-BLG-1275, and OGLE-2017-BLG-1237. The first two of these were not previously identified, while the last was not previously published due to technical complications induced by a nearby variable. We further report that a fourth anomalous event, the previously recognized OGLE-2017-BLG-1777, is very likely to be planetary, although its light curve requires unusually complex modeling because the lens and source both have orbiting companions. One of the three unambiguous planets, OGLE-2017-BLG-1275, is the first AnomalyFinder discovery that has a Spitzer microlens parallax measurement, π E ≃ 0.045 ± 0.015, implying that this planetary system almost certainly lies in the Galactic bulge. In the order listed, the four planetary events have planet-host mass ratios q and normalized projected separations s of ( log q , s ) = ( − 2.31 , 0.61 ) , (−2.06, 0.63/1.09), (−2.10, 1.04), and (−2.86, 0.72). Combined with previously published events, the 2017 prime fields contain 11 unambiguous planets with well-measured q and one very likely candidate, of which three are AnomalyFinder discoveries. In addition to these 12, there are three other unambiguous planets with large uncertainties in q.
The starburst model for active galactic nuclei : the broad-line region as supernova remnants evolving in a high-density medium

It is shown that the broad permitted and semipermitted emission lines of the broad-line region (BLR) of radio-quiet active galactic nuclei (AGN) can be generated by strongly radiative (rapidly cooling) supernova remnants expected to occur in the central regions of early-type galaxies undergoing a starburst. Supernova remnants interacting with a circumstellar medium with a density of about n ∼ 10 7 cm -3 become strongly radiative while still expanding at several thousand km/s, and miss the adiabatic Sedov track. Radiative cooling becomes important well before the thermalization of the ejecta is completed, and the shocked matter undergoes a fast condensation behind both the outgoing forward shock and the reverse shock. Two concentric, high-density, and fast-moving thin shells are then formed
Decision Making for Autonomous Driving in Interactive Merge Scenarios via Learning-based Prediction

Autonomous agents that drive on roads shared with human drivers must reason about the nuanced interactions among traffic participants. This poses a highly challenging decision making problem since human behavior is influenced by a multitude of factors (e.g., human intentions and emotions) that are hard to model. This paper presents a decision making approach for autonomous driving, focusing on the complex task of merging into moving traffic where uncertainty emanates from the behavior of other drivers and imperfect sensor measurements. We frame the problem as a partially observable Markov decision process (POMDP) and solve it online with Monte Carlo tree search. The solution to the POMDP is a policy that performs high-level driving maneuvers, such as giving way to an approaching car, keeping a safe distance from the vehicle in front or merging into traffic. Our method leverages a model learned from data to predict the future states of traffic while explicitly accounting for interactions among the surrounding agents. From these predictions, the autonomous vehicle can anticipate the future consequences of its actions on the environment and optimize its trajectory accordingly. We thoroughly test our approach in simulation, showing that the autonomous vehicle can adapt its behavior to different situations. We also compare against other methods, demonstrating an improvement with respect to the considered performance metrics.
Tetra-AML: Automatic Machine Learning via Tensor Networks

Neural networks have revolutionized many aspects of society but in the era of huge models with billions of parameters, optimizing and deploying them for commercial applications can require significant computational and financial resources. To address these challenges, we introduce the Tetra-AML toolbox, which automates neural architecture search and hyperparameter optimization via a custom-developed black-box Tensor train Optimization algorithm, TetraOpt. The toolbox also provides model compression through quantization and pruning, augmented by compression using tensor networks. Here, we analyze a unified benchmark for optimizing neural networks in computer vision tasks and show the superior performance of our approach compared to Bayesian optimization on the CIFAR-10 dataset. We also demonstrate the compression of ResNet-18 neural networks, where we use 14.5 times less memory while losing just 3.2% of accuracy. The presented framework is generic, not limited by computer vision problems, supports hardware acceleration (such as with GPUs and TPUs) and can be further extended to quantum hardware and to hybrid quantum machine learning models.
Neuro-symbolic Rule Learning in Real-world Classification Tasks

Neuro-symbolic rule learning has attracted lots of attention as it offers better interpretability than pure neural models and scales better than symbolic rule learning. A recent approach named pix2rule proposes a neural Disjunctive Normal Form (neural DNF) module to learn symbolic rules with feed-forward layers. Although proved to be effective in synthetic binary classification, pix2rule has not been applied to more challenging tasks such as multi-label and multi-class classifications over real-world data. In this paper, we address this limitation by extending the neural DNF module to (i) support rule learning in real-world multi-class and multi-label classification tasks, (ii) enforce the symbolic property of mutual exclusivity (i.e. predicting exactly one class) in multi-class classification, and (iii) explore its scalability over large inputs and outputs. We train a vanilla neural DNF model similar to pix2rule's neural DNF module for multi-label classification, and we propose a novel extended model called neural DNF-EO (Exactly One) which enforces mutual exclusivity in multi-class classification. We evaluate the classification performance, scalability and interpretability of our neural DNF-based models, and compare them against pure neural models and a state-of-the-art symbolic rule learner named FastLAS. We demonstrate that our neural DNF-based models perform similarly to neural networks, but provide better interpretability by enabling the extraction of logical rules. Our models also scale well when the rule search space grows in size, in contrast to FastLAS, which fails to learn in multi-class classification tasks with 200 classes and in all multi-label settings.
Deep transfer learning for detecting Covid-19, Pneumonia and Tuberculosis using CXR images - A Review

Chest X-rays remains to be the most common imaging modality used to diagnose lung diseases. However, they necessitate the interpretation of experts (radiologists and pulmonologists), who are few. This review paper investigates the use of deep transfer learning techniques to detect COVID-19, pneumonia, and tuberculosis in chest X-ray (CXR) images. It provides an overview of current state-of the-art CXR image classification techniques and discusses the challenges and opportunities in applying transfer learning to this domain. The paper provides a thorough examination of recent research studies that used deep transfer learning algorithms for COVID-19, pneumonia, and tuberculosis detection, highlighting the advantages and disadvantages of these approaches. Finally, the review paper discusses future research directions in the field of deep transfer learning for CXR image classification, as well as the potential for these techniques to aid in the diagnosis and treatment of lung diseases.
ProductAE: Toward Deep Learning Driven Error-Correction Codes of Large Dimensions

While decades of theoretical research have led to the invention of several classes of error-correction codes, the design of such codes is an extremely challenging task, mostly driven by human ingenuity. Recent studies demonstrate that such designs can be effectively automated and accelerated via tools from machine learning (ML), thus enabling ML-driven classes of error-correction codes with promising performance gains compared to classical designs. A fundamental challenge, however, is that it is prohibitively complex, if not impossible, to design and train fully ML-driven encoder and decoder pairs for large code dimensions. In this paper, we propose Product Autoencoder (ProductAE) -- a computationally-efficient family of deep learning driven (encoder, decoder) pairs -- aimed at enabling the training of relatively large codes (both encoder and decoder) with a manageable training complexity. We build upon ideas from classical product codes and propose constructing large neural codes using smaller code components. ProductAE boils down the complex problem of training the encoder and decoder for a large code dimension $k$ and blocklength $n$ to less-complex sub-problems of training encoders and decoders for smaller dimensions and blocklengths. Our training results show successful training of ProductAEs of dimensions as large as $k = 300$ bits with meaningful performance gains compared to state-of-the-art classical and neural designs. Moreover, we demonstrate excellent robustness and adaptivity of ProductAEs to channel models different than the ones used for training.
Ensemble Learning Model on Artificial Neural Network-Backpropagation (ANN-BP) Architecture for Coal Pillar Stability Classification

Pillars are important structural units used to ensure mining safety in underground hard rock mines. Unstable pillars can significantly increase worker safety hazards and sudden roof collapse. Therefore, precise predictions regarding the stability of underground pillars are required. One common index that is often used to assess pillar stability is the Safety Factor (SF). Unfortunately, such crisp boundaries in pillar stability assessment using SF are unreliable. This paper presents a novel application of Artificial Neural Network-Backpropagation (ANN-BP) and Deep Ensemble Learning for pillar stability classification. There are three types of ANN-BP used for the classification of pillar stability distinguished by their activation functions: ANN-BP ReLU, ANN-BP ELU, and ANN-BP GELU. These three activation functions were chosen because they can solve the vanishing gradient problem in ANN-BP. In addition, a Deep Ensemble Learning process was carried out on these three types of ANN-BP to reduce the prediction variance and improve the classification results. This study also presents two labeling alternatives for pillar stability by considering its suitability with the SF. Thus, pillar stability is expanded into four categories: failed with a suitable safety factor, intact with a suitable safety factor, failed without a suitable safety factor, and intact without a suitable safety factor. There are five features used for each model: pillar width, mining height, bord width, depth to floor, and ratio. In constructing the model, the initial dataset is divided into training data, validation data, and testing data. In this case, four type of proportions are used. For training-testing division the proportions are: 80 % : 20 %, 70 % : 30 %, for training-validation-testing division the proportions are: 80 % : 10 % : 10 %, 70 % : 15 % : 15 %. Average accuracy, F1-score, and F2-score from 10 trials were used as performance indicators for each model. The results showed that the ANN-BP model with Ensemble Learning could improve ANN-BP performance with an average accuracy 86.48 % and an F2-score 96.35 % for the category of failed with a suitable safety factor.
How can Deep Learning Retrieve the Write-Missing Additional Diagnosis from Chinese Electronic Medical Record For DRG

The purpose of write-missing diagnosis detection is to find diseases that have been clearly diagnosed from medical records but are missed in the discharge diagnosis. Unlike the definition of missed diagnosis, the write-missing diagnosis is clearly manifested in the medical record without further reasoning. The write-missing diagnosis is a common problem, often caused by physician negligence. The write-missing diagnosis will result in an incomplete diagnosis of medical records. While under DRG grouping, the write-missing diagnoses will miss important additional diagnoses (CC, MCC), thus affecting the correct rate of DRG enrollment. Under the circumstance that countries generally start to adopt DRG enrollment and payment, the problem of write-missing diagnosis is a common and serious problem. The current manual-based method is expensive due to the complex content of the full medical record. We think this problem is suitable to be solved as natural language processing. But to the best of our knowledge, no researchers have conducted research on this problem based on natural language processing methods. We propose a framework for solving the problem of write-missing diagnosis, which mainly includes three modules: disease recall module, disease context logic judgment module, and disease relationship comparison module. Through this framework, we verify that the problem of write-missing diagnosis can be solved well, and the results are interpretable. At the same time, we propose advanced solutions for the disease context logic judgment module and disease relationship comparison module, which have obvious advantages compared with the mainstream methods of the same type of problems. Finally, we verified the value of our proposed framework under DRG medical insurance payment in a tertiary hospital.
Spatial Capture–Recapture Models

There has been a rapid growth in spatial capture–recapture (SCR) methods in the last decade. This paper provides an overview of existing SCR models and suggestions on how they might develop in future. The core of the paper is a likelihood framework that synthesises existing SCR models. This is used to illustrate similarities and differences between models. The key difference between conventional capture–recapture models and SCR models is that the latter include a spatial point process model for individuals’ locations and allow capture probability to depend on location. This extends the kinds of inferences that can be drawn from capture–recapture surveys, allowing them to address questions of a fundamentally spatial nature, relating to animal distribution, habitat preference, movement patterns, spatial connectivity of habitats and dependence of demographic parameters on spatial variables.
Backtracking Dynamical Cavity Method

The cavity method is one of the cornerstones of the statistical physics of disordered systems such as spin glasses and other complex systems. It is able to analytically and asymptotically exactly describe the equilibrium properties of a broad range of models. Exact solutions for dynamical, out-of-equilibrium properties of disordered systems are traditionally much harder to obtain. Even very basic questions such as the limiting energy of a fast quench are so far open. The dynamical cavity method partly fills this gap by considering short trajectories and leveraging the static cavity method. However, being limited to a couple of steps forward from the initialization it typically does not capture dynamical properties related to attractors of the dynamics. We introduce the backtracking dynamical cavity method that instead of analysing the trajectory forward from initialization, analyses trajectories that are found by tracking them backward from attractors. We illustrate that this rather elementary twist on the dynamical cavity method leads to new insight into some of the very basic questions about the dynamics of complex disordered systems. This method is as versatile as the cavity method itself and we hence anticipate that our paper will open many avenues for future research of dynamical, out-of-equilibrium, properties in complex systems.
Structural and thermodynamic properties of heavily mechanically deformed Ru and AlRu

We report on high‐energy ball milling of Ru and AlRu. The deformation results in a drastic decrease of the crystal size to a nanometer scale and in an increase of atomic‐level strain. This is accompanied by a disordering of the crystal lattice as is shown by means of the long‐range‐order parameter in AlRu. The specific heat increases by more than 15%–20%, indicating large changes in the vibrational and configurational part of the entropy. The stored energy of cold work is up to 6 kJ/mol for AlRu and 10 kJ/mol for Ru. This is almost 40% of the heat of fusion of Ru and exceeds by far the energies stored by other deformation processes.
Exploring Asymmetric Tunable Blind-Spots for Self-supervised Denoising in Real-World Scenarios

Self-supervised denoising has attracted widespread attention due to its ability to train without clean images. However, noise in real-world scenarios is often spatially correlated, which causes many self-supervised algorithms based on the pixel-wise independent noise assumption to perform poorly on real-world images. Recently, asymmetric pixel-shuffle downsampling (AP) has been proposed to disrupt the spatial correlation of noise. However, downsampling introduces aliasing effects, and the post-processing to eliminate these effects can destroy the spatial structure and high-frequency details of the image, in addition to being time-consuming. In this paper, we systematically analyze downsampling-based methods and propose an Asymmetric Tunable Blind-Spot Network (AT-BSN) to address these issues. We design a blind-spot network with a freely tunable blind-spot size, using a large blind-spot during training to suppress local spatially correlated noise while minimizing damage to the global structure, and a small blind-spot during inference to minimize information loss. Moreover, we propose blind-spot self-ensemble and distillation of non-blind-spot network to further improve performance and reduce computational complexity. Experimental results demonstrate that our method achieves state-of-the-art results while comprehensively outperforming other self-supervised methods in terms of image texture maintaining, parameter count, computation cost, and inference time.
Multi-scale CLEAN in hard X-ray solar imaging

Multi-scale deconvolution is an ill-posed inverse problem in imaging, with applications ranging from microscopy, through medical imaging, to astronomical remote sensing. In the case of high-energy space telescopes, multi-scale deconvolution algorithms need to account for the peculiar property of native measurements, which are sparse samples of the Fourier transform of the incoming radiation. The present paper proposes a multi-scale version of CLEAN, which is the most popular iterative deconvolution method in Fourier space imaging. Using synthetic data generated according to a simulated but realistic source configuration, we show that this multi-scale version of CLEAN performs better than the original one in terms of accuracy, photometry, and regularization. Further, the application to a data set measured by the NASA Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI) shows the ability of multi-scale CLEAN to reconstruct rather complex topographies, characteristic of a real flaring event.