Reviewerly/exHarmony huggingface dataset:
Self-supervised learning-based Multi-Scale feature Fusion Network for survival analysis from whole slide images

Understanding prognosis and mortality is critical for evaluating the treatment plan of patients. Advances in digital pathology and deep learning techniques have made it practical to perform survival analysis in whole slide images (WSIs). Current methods are usually based on a multi-stage framework which includes patch sampling, feature extraction and prediction. However, the random patch sampling strategy is highly unstable and prone to sampling non-ROI. Feature extraction typically relies on hand-crafted features or convolutional neural networks (CNNs) pre-trained on ImageNet, while the artificial error or domain gaps may affect the survival prediction performance. Besides, the limited information representation of local sampling patches will create a bottleneck limitation on the effectiveness of prediction. To address the above challenges, we propose a novel patch sampling strategy based on image information entropy and construct a Multi-Scale feature Fusion Network (MSFN) based on self-supervised feature extractor. Specifically, we adopt image information entropy as a criterion to select representative sampling patches, thereby avoiding the noise interference caused by random to blank regions. Meanwhile, we pretrain the feature extractor utilizing self-supervised learning mechanism to improve the efficiency of feature extraction. Furthermore, a global-local feature fusion prediction network based on the attention mechanism is constructed to improve the survival prediction effect of WSIs with comprehensive multi-scale information representation. The proposed method is validated by adequate experiments and achieves competitive results on both of the most popular WSIs survival analysis datasets, TCGA-GBM and TCGA-LUSC. Code and trained models are made available at: https://github.com/Mercuriiio/MSFN.
Photonic online learning: a perspective

Emerging neuromorphic hardware promises to solve certain problems faster and with higher energy efficiency than traditional computing by using physical processes that take place at the device level as the computational primitives in neural networks. While initial results in photonic neuromorphic hardware are very promising, such hardware requires programming or "training" that is often power-hungry and time-consuming. In this article, we examine the online learning paradigm, where the machinery for training is built deeply into the hardware itself. We argue that some form of online learning will be necessary if photonic neuromorphic hardware is to achieve its true potential.
Conditional Contextual Refinement

Much work in formal verification of low-level systems is based on one of two approaches: refinement or separation logic. These two approaches have complementary benefits: refinement supports the use of programs as specifications, as well as transitive composition of proofs, whereas separation logic supports conditional specifications, as well as modular ownership reasoning about shared state. A number of verification frameworks employ these techniques in tandem, but in all such cases the benefits of the two techniques remain separate. For example, in frameworks that use relational separation logic to prove contextual refinement, the relational separation logic judgment does not support transitive composition of proofs, while the contextual refinement judgment does not support conditional specifications. In this paper, we propose Conditional Contextual Refinement (or CCR, for short), the first verification system to not only combine refinement and separation logic in a single framework but also to truly marry them together into a unified mechanism enjoying all the benefits of refinement and separation logic simultaneously. Specifically, unlike in prior work, CCR’s refinement specifications are both conditional (with separation logic pre- and post-conditions) and transitively composable. We implement CCR in Coq and evaluate its effectiveness on a range of interesting examples.
Skeleton-Based Action and Gesture Recognition for Human-Robot Collaboration

Human action recognition plays a major role in enabling an effective and safe collaboration between humans and robots. Considering for example a collaborative assembly task, the human worker can use gestures to communicate with the robot while the robot can exploit the recognized actions to anticipate the next steps in the assembly process, improving safety and the overall productivity. In this work, we propose a novel framework for human action recognition based on 3D pose estimation and ensemble techniques. In such framework, we first estimate the 3D coordinates of the human hands and body joints by means of OpenPose and RGB-D data. The estimated joints are then fed to a set of graph convolutional networks derived from Shift-GCN, one network for each set of joints (i.e., body, left hand and right hand). Finally, using an ensemble approach we average the output scores of all the networks to predict the final human action. The proposed framework was evaluated on a dedicated dataset, named IAS-Lab Collaborative HAR dataset, which includes both actions and gestures commonly used in human-robot collaboration tasks. The experimental results demonstrated how the ensemble of the different action recognition models helps improving the accuracy and the robustness of the overall system.
Saliency-CCE: Exploiting colour contextual extractor and saliency-based biomedical image segmentation

Biomedical image segmentation is one critical component in computer-aided system diagnosis. However, various non-automatic segmentation methods are usually designed to segment target objects with single-task driven, ignoring the potential contribution of multi-task, such as the salient object detection (SOD) task and the image segmentation task. In this paper, we propose a novel dual-task framework for white blood cell (WBC) and skin lesion (SL) saliency detection and segmentation in biomedical images, called Saliency-CCE. Saliency-CCE consists of a preprocessing of hair removal for skin lesions images, a novel colour contextual extractor (CCE) module for the SOD task and an improved adaptive threshold (AT) paradigm for the image segmentation task. In the SOD task, we perform the CCE module to extract hand-crafted features through a novel colour channel volume (CCV) block and a novel colour activation mapping (CAM) block. We first exploit the CCV block to generate a target object’s region of interest (ROI). After that, we employ the CAM block to yield a refined salient map as the final salient map from the extracted ROI. We propose a novel adaptive threshold (AT) strategy in the segmentation task to automatically segment the WBC and SL from the final salient map. We evaluate our proposed Saliency-CCE on the ISIC-2016, the ISIC-2017, and the SCISC datasets, which outperform representative state-of-the-art SOD and biomedical image segmentation approaches. Our code is available at https://github.com/zxg3017/Saliency-CCE.
Towards a high-density photonic tensor core enabled by intensity-modulated microrings and photonic wire bonding

Abstract We propose a photonic processing unit for high-density analog computation using intensity-modulation-based microring modulators (IM-MRMs). The output signal at the fixed resonance wavelength is directly intensity modulated by changing the extinction ratio (ER) of the IM-MRM . Thanks to the intensity-modulated approach, the proposed photonic processing unit is less sensitive to the inter-channel crosstalk. Simulation results reveal that the proposed design offers a maximum of 17-fold increase in wavelength channel density compared to its wavelength-modulated counterpart. Therefore, a photonic tensor core of size 512 $$\times $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mo>×</mml:mo> </mml:math> 512 can be realized by current foundry lines. A convolutional neural network (CNN) simulator with 6-bit precision is built for handwritten digit recognition task using the proposed modulator. Simulation results show an overall accuracy of 96.76%, when the wavelength channel spacing suffers a 3-dB power penalty. To experimentally validate the system, 1000 dot product operations are carried out with a 4-bit signed system on a co-packaged photonic chip, where optical and electrical I/Os are realized using photonic and electrical wire bonding techniques. Study of the measurement results show a mean squared error (MSE) of 3.09 $$\times $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mo>×</mml:mo> </mml:math> 10 $$^{-3}$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:msup> <mml:mrow /> <mml:mrow> <mml:mo>-</mml:mo> <mml:mn>3</mml:mn> </mml:mrow> </mml:msup> </mml:math> for dot product calculations. The proposed IM-MRM, therefore, renders the crosstalk issue tractable and provides a solution for the development of large-scale optical information processing systems with multiple wavelengths.
Camera Calibration

Camera calibration has the purpose to use the feature point coordinates (X, Y, Z) of a given 3-D space object and its image coordinates (x, y) in 2-D image space to calculate the internal and external parameters of the camera, thereby establishing the quantitative relationship between the objective scene and the captured image. This chapter will introduce the basic linear camera model, gives a typical calibration procedure, and discusses the internal and external parameters of the camera. This chapter will discuss typical nonlinear camera models, analyzes various types of distortions in detail, and summarizes the criteria and results for the classification of calibration methods. This chapter will introduce the traditional camera calibration method, analyzes its characteristics, and describes an example of a typical two-stage calibration method. In addition, an improved method is analyzed. This chapter will also introduce the self-calibration method (including the calibration method based on active vision). In addition to analyzing the advantages and disadvantages of this type of method, a simple calibration method is also specifically introduced.
Energetics of Microwaves Probed by Double Quantum Dot Absorption

We explore the energetics of microwaves interacting with a double quantum dot photodiode and show wave-particle aspects in photon-assisted tunneling. The experiments show that the single-photon energy sets the relevant absorption energy in a weak-drive limit, which contrasts the strong-drive limit where the wave amplitude determines the relevant-energy scale and opens up microwave-induced bias triangles. The threshold condition between these two regimes is set by the fine-structure constant of the system. The energetics are determined here with the detuning conditions of the double dot system and stopping-potential measurements that constitute a microwave version of the photoelectric effect.
Zero-Shot Machine Unlearning

Modern privacy regulations grant citizens the right to be forgotten by products, services and companies. In case of machine learning (ML) applications, this necessitates deletion of data not only from storage archives but also from ML models. Due to an increasing need for regulatory compliance required for ML applications, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">machine unlearning</i> is becoming an emerging research problem. The right to be forgotten requests come in the form of removal of a certain set or class of data from the already trained ML model. Practical considerations preclude retraining of the model from scratch after discarding the deleted data. The few existing studies use either the whole training data, or a subset of training data, or some metadata stored during training to update the model weights for unlearning. However, strict regulatory compliance requires time-bound deletion of data. Thus, in many cases, no data related to the training process or training samples may be accessible even for the unlearning purpose. We therefore ask the question: <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">is it possible to achieve unlearning with zero training samples?</i> In this paper, we introduce the novel problem of <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">zero-shot machine unlearning</i> that caters for the extreme but practical scenario where zero original data samples are available for use. We then propose two novel solutions for <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">zero-shot machine unlearning</i> based on (a) error minimizing-maximizing noise and (b) gated knowledge transfer. These methods remove the information of the forget data from the model while maintaining the model efficacy on the retain data. The zero-shot approach offers good protection against the model inversion attacks and membership inference attacks. We introduce a new evaluation metric, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Anamnesis Index</i> (AIN) to effectively measure the quality of the unlearning method. The experiments show promising results for unlearning in deep learning models on benchmark vision data-sets. The source code is available here: https://github.com/ayu987/zero-shot-unlearning.
Challenges in the Use of Quantum Computing Hardware-Efficient Ansätze in Electronic Structure Theory

Advances in quantum computation for electronic structure, and particularly heuristic quantum algorithms, create an ongoing need to characterize the performance and limitations of these methods. Here we discuss some potential pitfalls connected with the use of hardware-efficient Ansätze in variational quantum simulations of electronic structure. We illustrate that hardware-efficient Ansätze may break Hamiltonian symmetries and yield nondifferentiable potential energy curves, in addition to the well-known difficulty of optimizing variational parameters. We discuss the interplay between these limitations by carrying out a comparative analysis of hardware-efficient Ansätze versus unitary coupled cluster and full configuration interaction, and of second- and first-quantization strategies to encode Fermionic degrees of freedom to qubits. Our analysis should be useful in understanding potential limitations and in identifying possible areas of improvement in hardware-efficient Ansätze.
Linguistic Intelligence for Intelligent Vehicles: ChatGPT and Future Logistics and Mobility

Summary form only. Includes summaries of articles presented in this issue of the publication.
Continuous Remote Sensing Image Super-Resolution Based on Context Interaction in Implicit Function Space

Despite its fruitful applications in remote sensing, image super-resolution is troublesome to train and deploy as it handles different resolution magnifications with separate models. Accordingly, we propose a highly-applicable super-resolution framework called FunSR, which settles different magnifications with a unified model by exploiting context interaction within implicit function space. FunSR composes a functional representor, a functional interactor, and a functional parser. Specifically, the representor transforms the low-resolution image from Euclidean space to multi-scale pixel-wise function maps; the interactor enables pixel-wise function expression with global dependencies; and the parser, which is parameterized by the interactor’s output, converts the discrete coordinates with additional attributes to RGB values. Extensive experimental results demonstrate that FunSR reports state-of-the-art performance on both fixed-magnification and continuous-magnification settings, meanwhile, it provides many friendly applications thanks to its unified nature. Our code is available at https://github.com/KyanChen/FunSR.
Voice-activated wheelchair: An affordable solution for individuals with physical disabilities

The Low-Cost Voice Controlled Wheelchair with Raspberry Pi is an innovative assistive technology designed to improve the mobility and independence of people with disabilities. This research aims to develop a wheelchair system that can be operated using voice commands at an affordable price, making it accessible to a wider range of individuals with limited mobility. The device is built on the Raspberry Pi, a reasonably priced, credit-card-sized computer, and uses an easy-to-use yet efficient voice recognition technique to let users control the wheelchair with their vocal commands. A Raspberry Pi, a microphone, and motor controllers are some of the system's hardware components. The software uses Python programming language and open-source voice recognition technology to recognize voice commands, making it easy for users to navigate their environment independently. The system has been tested on a prototype and has shown promising results in terms of accuracy and reliability. The Low-Cost Voice Controlled Wheelchair with Raspberry Pi can give disabled persons new levels of mobility and independence, enhancing their quality of life and enhancing their capacity to carry out daily tasks.
A systematic review of privacy-preserving methods deployed with blockchain and federated learning for the telemedicine

The unexpected and rapid spread of the COVID-19 pandemic has amplified the acceptance of remote healthcare systems such as telemedicine. Telemedicine effectively provides remote communication, better treatment recommendation, and personalized treatment on demand. It has emerged as the possible future of medicine. From a privacy perspective, secure storage, preservation, and controlled access to health data with consent are the main challenges to the effective deployment of telemedicine. It is paramount to fully overcome these challenges to integrate the telemedicine system into healthcare. In this regard, emerging technologies such as blockchain and federated learning have enormous potential to strengthen the telemedicine system. These technologies help enhance the overall healthcare standard when applied in an integrated way. The primary aim of this study is to perform a systematic literature review of previous research on privacy-preserving methods deployed with blockchain and federated learning for telemedicine. This study provides an in-depth qualitative analysis of relevant studies based on the architecture, privacy mechanisms, and machine learning methods used for data storage, access, and analytics. The survey allows the integration of blockchain and federated learning technologies with suitable privacy techniques to design a secure, trustworthy, and accurate telemedicine model with a privacy guarantee.
Reservoir computing based on solitary-like waves dynamics of liquid film flows: A proof of concept

Abstract Several theoretical works have shown that solitons —waves that self-maintain constant shape and velocity as they propagate— can be used as a physical computational reservoir, a concept where machine learning algorithms designed for digital computers are replaced by analog physical systems that exhibit nonlinear dynamical behaviour. Here we propose and experimentally validate a novel reservoir computing (RC) system that for the first time employs solitary-like (SL) waves propagating on the surface of a liquid film flowing over an inclined surface. We demonstrate the ability of the SL wave RC system (SLRC) to forecast chaotic time series, also producing experimental evidence of the possibility to combine RC with nonlinear vector autoregression techniques not only in a computer program but also in a physical system.
Small Target Detection Algorithm for UAV Aerial Photography Based on Improved YOLOv5s

At present, UAV aerial photography has a good prospect in agricultural production, disaster response, and other aspects. The application of UAVs can greatly improve work efficiency and decision-making accuracy. However, owing to inherent features such as a wide field of view and large differences in the target scale in UAV aerial photography images, this can lead to existing target detection algorithms missing small targets or causing incorrect detections. To solve these problems, this paper proposes a small target detection algorithm for UAV aerial photography based on improved YOLOv5s. Firstly, a small target detection layer is applied in the algorithm to improve the detection performance of small targets in aerial images. Secondly, the enhanced weighted bidirectional characteristic pyramid Mul-BiFPN is adopted to replace the PANet network to improve the speed and accuracy of target detection. Then, CIoU was replaced by Focal EIoU to accelerate network convergence and improve regression accuracy. Finally, a non-parametric attention mechanism called the M-SimAM module is added to enhance the feature extraction capability. The proposed algorithm was evaluated on the VisDrone-2019 dataset. Compared with the YOLOV5s, the algorithm improved by 7.30%, 4.60%, 5.60%, and 6.10%, respectively, in mAP@50, mAP@0.5:0.95, the accuracy rate (P), and the recall rate (R). The experiments show that the proposed algorithm has greatly improved performance on small targets compared to YOLOv5s.
<scp>OpenMindat</scp>: Open and FAIR mineralogy data from the Mindat database

Abstract The open data movement has brought revolutionary changes to the field of mineralogy. With a growing number of datasets made available through community efforts, researchers are now able to explore new scientific topics such as mineral ecology, mineral evolution and new classification systems. The recent results have shown that the necessary open data coupled with data science skills and expertise in mineralogy will lead to impressive new scientific discoveries. Yet, feedback from researchers also reflects the needs for better FAIRness of open data, that is, findable, accessible, interoperable and reusable for both humans and machines. In this paper, we present our recent work on building the open data service of Mindat, one of the largest mineral databases in the world. In the past years, Mindat has supported numerous scientific studies but a machine interface for data access has never been established. Through the OpenMindat project we have achieved solid progress on two activities: (1) cleanse data and improve data quality, and (2) build a data sharing platform and establish a machine interface for data query and access. We hope OpenMindat will help address the increasing data needs from researchers in mineralogy for an internationally recognized authoritative database that is fully compliant with the FAIR guiding principles and helps accelerate scientific discoveries.