Reviewerly/exHarmony huggingface dataset:
AutoGCL: Automated Graph Contrastive Learning via Learnable View Generators

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined view generation methods, e.g., node drop or edge perturbation, which usually cannot adapt to input data or preserve the original semantic structures well. To address this issue, we propose a novel framework named Automated Graph Contrastive Learning (AutoGCL) in this paper. Specifically, AutoGCL employs a set of learnable graph view generators orchestrated by an auto augmentation strategy, where every graph view generator learns a probability distribution of graphs conditioned by the input. While the graph view generators in AutoGCL preserve the most representative structures of the original graph in generation of every contrastive sample, the auto augmentation learns policies to introduce adequate augmentation variances in the whole contrastive learning procedure. Furthermore, AutoGCL adopts a joint training strategy to train the learnable view generators, the graph encoder, and the classifier in an end-to-end manner, resulting in topological heterogeneity yet semantic similarity in the generation of contrastive samples. Extensive experiments on semi-supervised learning, unsupervised learning, and transfer learning demonstrate the superiority of our AutoGCL framework over the state-of-the-arts in graph contrastive learning. In addition, the visualization results further confirm that the learnable view generators can deliver more compact and semantically meaningful contrastive samples compared against the existing view generation methods. Our code is available at https://github.com/Somedaywilldo/AutoGCL.
Scalable and compact photonic neural chip with low learning-capability-loss

Abstract Photonic computation has garnered huge attention due to its great potential to accelerate artificial neural network tasks at much higher clock rate to digital electronic alternatives. Especially, reconfigurable photonic processor consisting of Mach–Zehnder interferometer (MZI) mesh is promising for photonic matrix multiplier. It is desired to implement high-radix MZI mesh to boost the computation capability. Conventionally, three cascaded MZI meshes (two universal N × N unitary MZI mesh and one diagonal MZI mesh) are needed to express N × N weight matrix with O ( N 2 ) MZIs requirements, which limits scalability seriously. Here, we propose a photonic matrix architecture using the real-part of one nonuniversal N × N unitary MZI mesh to represent the real-value matrix. In the applications like photonic neural network, it probable reduces the required MZIs to O ( N log 2 N ) level while pay low cost on learning capability loss. Experimentally, we implement a 4 × 4 photonic neural chip and benchmark its performance in convolutional neural network for handwriting recognition task. Low learning-capability-loss is observed in our 4 × 4 chip compared to its counterpart based on conventional architecture using O ( N 2 ) MZIs. While regarding the optical loss, chip size, power consumption, encoding error, our architecture exhibits all-round superiority.
Situation-Aware BDI Reasoning to Detect Early Symptoms of Covid 19 Using Smartwatch

Ambient intelligence plays a crucial role in healthcare situations. It provides a certain way to deal with emergencies to provide the essential resources such as nearest hospitals and emergency stations promptly to avoid deaths. Since the outbreak of Covid-19, several artificial intelligence techniques have been used. However, situation awareness is a key aspect to handling any pandemic situation. The situation-awareness approach gives patients a routine life where they are continuously monitored by caregivers through wearable sensors and alert the practitioners in case of any patient emergency. Therefore, in this paper, we propose a situation-aware mechanism to detect Covid-19 systems early and alert the user to be self-aware regarding the situation to take precautions if the situation seems unlikely to be normal. We provide Belief-Desire-Intention intelligent reasoning mechanism for the system to analyze the situation after acquiring the data from the wearable sensors and alert the user according to their environment. We use the case study for further demonstration of our proposed framework. We model the proposed system by temporal logic and map the system illustration into a simulation tool called NetLogo to determine the results of the proposed system.
Deep learning-based single image super-resolution for low-field MR brain images

Low-field MRI scanners are significantly less expensive than their high-field counterparts, which gives them the potential to make MRI technology more accessible all around the world. In general, images acquired using low-field MRI scanners tend to be of a relatively low resolution, as signal-to-noise ratios are lower. The aim of this work is to improve the resolution of these images. To this end, we present a deep learning-based approach to transform low-resolution low-field MR images into high-resolution ones. A convolutional neural network was trained to carry out single image super-resolution reconstruction using pairs of noisy low-resolution images and their noise-free high-resolution counterparts, which were obtained from the publicly available NYU fastMRI database. This network was subsequently applied to noisy images acquired using a low-field MRI scanner. The trained convolutional network yielded sharp super-resolution images in which most of the high-frequency components were recovered. In conclusion, we showed that a deep learning-based approach has great potential when it comes to increasing the resolution of low-field MR images.
NRT-YOLO: Improved YOLOv5 Based on Nested Residual Transformer for Tiny Remote Sensing Object Detection

To address the problems of tiny objects and high resolution of object detection in remote sensing imagery, the methods with coarse-grained image cropping have been widely studied. However, these methods are always inefficient and complex due to the two-stage architecture and the huge computation for split images. For these reasons, this article employs YOLO and presents an improved architecture, NRT-YOLO. Specifically, the improvements can be summarized as: extra prediction head and related feature fusion layers; novel nested residual Transformer module, C3NRT; nested residual attention module, C3NRA; and multi-scale testing. The C3NRT module presented in this paper could boost accuracy and reduce complexity of the network at the same time. Moreover, the effectiveness of the proposed method is demonstrated by three kinds of experiments. NRT-YOLO achieves 56.9% mAP0.5 with only 38.1 M parameters in the DOTA dataset, exceeding YOLOv5l by 4.5%. Also, the results of different classifications show its excellent ability to detect small sample objects. As for the C3NRT module, the ablation study and comparison experiment verified that it has the largest contribution to accuracy increment (2.7% in mAP0.5) among the improvements. In conclusion, NRT-YOLO has excellent performance in accuracy improvement and parameter reduction, which is suitable for tiny remote sensing object detection.
On-demand directional microwave photon emission using waveguide quantum electrodynamics

Routing quantum information between non-local computational nodes is a foundation for extensible networks of quantum processors. Quantum information transfer between arbitrary nodes is generally mediated either by photons that propagate between them or by resonantly coupling nearby nodes. The utility is determined by the type of emitter, propagation channel and receiver. Conventional approaches involving propagating microwave photons have limited fidelity due to photon loss and are often unidirectional, whereas architectures that use direct resonant coupling are bidirectional in principle but can generally accommodate only a few local nodes. Here we demonstrate high-fidelity, on-demand, directional, microwave photon emission. We do this using an artificial molecule comprising two superconducting qubits strongly coupled to a bidirectional waveguide, effectively creating a chiral microwave waveguide. Quantum interference between the photon emission pathways from the molecule generates single photons that selectively propagate in a chosen direction. This circuit will also be capable of photon absorption, making it suitable for building interconnects within extensible quantum networks. Light could be used to carry quantum information in networks, but this requires methods to prepare and control individual photons. A superconducting circuit can controllably emit photons in either direction along a microwave waveguide.
Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets With Multi-Stream Inputs

Understanding driver activity is vital for in-vehicle systems that aim to reduce the incidence of car accidents rooted in cognitive distraction. Automating real-time behavior recognition while ensuring actions classification with high accuracy is however challenging, given the multitude of circumstances surrounding drivers, the unique traits of individuals, and the computational constraints imposed by in-vehicle embedded platforms. Prior work fails to jointly meet these runtime/accuracy requirements and mostly rely on a single sensing modality, which in turn can be a single point of failure. In this paper, we harness the exceptional feature extraction abilities of deep learning and propose a dedicated Interwoven Deep Convolutional Neural Network (InterCNN) architecture to tackle the problem of accurate classification of driver behaviors in real-time. The proposed solution exploits information from multi-stream inputs, i.e., in-vehicle cameras with different fields of view and optical flows computed based on recorded images, and merges through multiple fusion layers abstract features that it extracts. This builds a tight ensembling system, which significantly improves the robustness of the model. In addition, we introduce a temporal voting scheme based on historical inference instances, in order to enhance the classification accuracy. Experiments conducted with a dataset that we collect in a mock-up car environment demonstrate that the proposed InterCNN with MobileNet convolutional blocks can classify 9 different behaviors with 73.97% accuracy, and 5 `aggregated' behaviors with 81.66% accuracy. We further show that our architecture is highly computationally efficient, as it performs inferences within 15 ms, which satisfies the real-time constraints of intelligent cars. Nevertheless, our InterCNN is robust to lossy input, as the classification remains accurate when two input streams are occluded.
Noise-Tolerant Zeroing Neural Network for Solving Non-Stationary Lyapunov Equation

As a crucial means for stability analysis in control systems, the Lyapunov equation is applied in many fields of science and engineering. There are some methods proposed and studied for solving the non-stationary Lyapunov equation, such as the zeroing neural network (ZNN) model. However, a common drawback these methods have is that they rarely tolerate noises. Therefore, given that the existence of various types of noises during computation, a noise-tolerant ZNN (NTZNN) model with anti-noise ability is proposed for solving the non-stationary Lyapunov equation in this paper. For comparison, the conventional ZNN (CZNN) model is also applied to solve the same problem. Furthermore, theoretical analyses are provided to prove the global and exponential convergence performance of the proposed NTZNN model in the absence of noises. On this basis, the anti-noise performance of the proposed NTZNN model is proven. Finally, by adopting the proposed NTZNN model and the CZNN model to solve the non-stationary Lyapunov equation, computer simulations are conducted under the noise-free case and the noisy case, respectively. The simulation results indicate that the proposed NTZNN model is practicable for solving the non-stationary Lyapunov equation and superior to the CZNN model at the existence of noises.
Building deep learning models for evidence classification from the open access biomedical literature

We investigate the application of deep learning to biocuration tasks that involve classification of text associated with biomedical evidence in primary research articles. We developed a large-scale corpus of molecular papers derived from PubMed and PubMed Central open access records and used it to train deep learning word embeddings under the GloVe, FastText and ELMo algorithms. We applied those models to a distant supervised method classification task based on text from figure captions or fragments surrounding references to figures in the main text using a variety or models and parameterizations. We then developed document classification (triage) methods for molecular interaction papers by using deep learning mechanisms of attention to aggregate classification-based decisions over selected paragraphs in the document. We were able to obtain triage performance with an accuracy of 0.82 using a combined convolutional neural network, bi-directional long short-term memory architecture augmented by attention to produce a single decision for triage. In this work, we hope to encourage biocuration systems developers to apply deep learning methods to their specialized tasks by repurposing large-scale word embedding to apply to their data.
Using Shape Expressions (ShEx) to Share RDF Data Models and to Guide Curation with Rigorous Validation

Abstract We discuss Shape Expressions (ShEx), a concise, formal, modeling and validation language for RDF structures. For instance, a Shape Expression could prescribe that subjects in a given RDF graph that fall into the shape “Paper” are expected to have a section called “Abstract”, and any ShEx implementation can confirm whether that is indeed the case for all such subjects within a given graph or subgraph. There are currently five actively maintained ShEx implementations. We discuss how we use the JavaScript, Scala and Python implementations in RDF data validation workflows in distinct, applied contexts. We present examples of how ShEx can be used to model and validate data from two different sources, the domain-specific Fast Healthcare Interoperability Resources (FHIR) and the domain-generic Wikidata knowledge base, which is the linked database built and maintained by the Wikimedia Foundation as a sister project to Wikipedia. Example projects that are using Wikidata as a data curation platform are presented as well, along with ways in which they are using ShEx for modeling and validation. When reusing RDF graphs created by others, it is important to know how the data is represented. Current practices of using human-readable descriptions or ontologies to communicate data structures often lack sufficient precision for data consumers to quickly and easily understand data representation details. We provide concrete examples of how we use ShEx as a constraint and validation language that allows humans and machines to communicate unambiguously about data assets. We use ShEx to exchange and understand data models of different origins, and to express a shared model of a resource’s footprint in a Linked Data source. We also use ShEx to agilely develop data models, test them against sample data, and revise or refine them. The expressivity of ShEx allows us to catch disagreement, inconsistencies, or errors efficiently, both at the time of input, and through batch inspections. ShEx addresses the need of the Semantic Web community to ensure data quality for RDF graphs. It is currently being used in the development of FHIR/RDF. The language is sufficiently expressive to capture constraints in FHIR, and the intuitive syntax helps people to quickly grasp the range of conformant documents. The publication workflow for FHIR tests all of these examples against the ShEx schemas, catching non-conformant data before they reach the public. ShEx is also currently used in Wikidata projects such as Gene Wiki and WikiCite to develop quality-control pipelines to maintain data integrity and incorporate or harmonize differences in data across different parts of the pipelines.
Research on ELM Soft Fault Diagnosis of Analog Circuit Based on KSLPP Feature Extraction

In order to improve the capability of soft fault diagnosis in an analog circuit, an integrated diagnosis method based on KSLPP feature extraction and ELM is proposed. The KSLPP feature extraction ability is firstly used to construct the principal component feature set from the fault sample set. Then, the advantage of ELM on solving the complicated nonlinearity problem is applied to build the fault identification model from the principal component feature. Finally, the sample sets of soft fault diagnosis for the analog circuit are respectively established by waveform parameter and wavelet packet transform to conduct the diagnostic test for the built model. The simulation of Elliptic Filter shows that, based on the fault sample set gotten by waveform parameter, the total correct rate of the integrated method is 98.2%; on the basis of the fault sample set built by wavelet packet transform, the total correct rate is 100%. The feasibility and effectiveness of this method are also validated.
Spatial Video Forgery Detection and Localization using Texture Analysis of Consecutive Frames

Now-a-days, videos can be easily recorded and forged with user-friendly editing tools. These videos can be shared on social networks to make false propaganda. During the process of spa ...
Decision making for the multi-armed bandit problem using lag synchronization of chaos in mutually coupled semiconductor lasers

We numerically and experimentally demonstrate the utilization of the synchronization of chaotic lasers for decision making. We perform decision making to solve the multi-armed bandit problem using lag synchronization of chaos in mutually coupled semiconductor lasers. We observe the spontaneous exchanges of the leader-laggard relationship under lag synchronization of chaos, and we find that the leader laser can be controlled by changing the coupling strengths between the two lasers. To solve the multi-armed bandit problem, we select one of the slot machines with unknown hit probabilities based only on the identity of the leader laser while reconfiguring the coupling strength to determine the correct decision. We successfully perform an on-line experimental demonstration of the decision making based on the two-laser coupled architecture. This is the first time that synchronization in chaotic lasers is utilized for decision making, and this study paves the way for novel resources for future photonic intelligence.
A computer‐aided diagnosis system for differentiation and delineation of malignant regions on whole‐slide prostate histopathology image using spatial statistics and multidimensional DenseNet

Purpose Prostate cancer (PCa) is a major health concern in aging males, and proper management of the disease depends on accurately interpreting pathology specimens. However, reading prostatectomy histopathology slides, which is basically for staging, is usually time consuming and differs from reading small biopsy specimens, which is mainly used for diagnosis. Generally, each prostatectomy specimen generates tens of large tissue sections and for each section, the malignant region needs to be delineated to assess the amount of tumor and its burden. With the aim of reducing the workload of pathologists, in this study, we focus on developing a computer‐aided diagnosis (CAD) system based on a densely connected convolutional neural network (DenseNet) for whole‐slide histopathology images to outline the malignant regions. Methods We use an efficient color normalization process based on ranklet transformation to automatically correct the intensity of the images. Additionally, we use spatial probability to segment the tissue structure regions for different tissue recognition patterns. Based on the segmentation, we incorporate a multidimensional structure into DenseNet to determine if a particular prostatic region is benign or malignant. Results As demonstrated by the experimental results with a test set of 2,663 images from 32 whole‐slide prostate histopathology images, our proposed system achieved 0.726, 0.6306, and 0.5209 in the average of the Dice coefficient, Jaccard similarity coefficient, and Boundary F1 score measures, respectively. Then, the accuracy, sensitivity, specificity, and the area under the ROC curve (AUC) of the proposed classification method were observed to be 95.0% (2544/2663), 96.7% (1210/1251), 93.9% (1334/1412), and 0.9831, respectively. Discussions We provide a detailed discussion on how our proposed system demonstrates considerable improvement compared with similar methods considered in previous researches as well as how it can be used for delineating malignant regions.
MicroExpNet: An Extremely Small and Fast Model For Expression Recognition From Face Images

This paper is aimed at creating extremely small and fast convolutional neural networks (CNN) for the problem of facial expression recognition (FER) from frontal face images. To this end, we employed the popular knowledge distillation (KD) method and identified two major shortcomings with its use: 1) a fine-grained grid search is needed for tuning the temperature hyperparameter and 2) to find the optimal size-accuracy balance, one needs to search for the final network size (or the compression rate). On the other hand, KD is proved to be useful for model compression for the FER problem, and we discovered that its effects get more and more significant with decreasing model size. In addition, we hypothesized that translation invariance achieved using max-pooling layers would not be useful for the FER problem as the expressions are sensitive to small, pixelwise changes around the eye and the mouth. However, we have found an intriguing improvement in generalization when max-pooling is used. We conducted experiments on two widelyused FER datasets, CK+ and Oulu-CASIA. Our smallest model (MicroExpNet), obtained using knowledge distillation, is less than 1MB in size and works at 1851 frames per second on an Intel i7 CPU. Despite being less accurate than the state-of-the-art, MicroExpNet still provides significant insights for designing a microarchitecture for the FER problem.
Variational quantum circuits for quantum state tomography

Quantum state tomography is a key process in most quantum experiments. In this work, we employ quantum machine learning for state tomography. Given an unknown quantum state, it can be learned by maximizing the fidelity between the output of a variational quantum circuit and this state. The number of parameters of the variational quantum circuit grows linearly with the number of qubits and the circuit depth, so that only polynomial measurements are required, even for highly-entangled states. After that, a subsequent classical circuit simulator is used to transform the information of the target quantum state from the variational quantum circuit into a familiar format. We demonstrate our method by performing numerical simulations for the tomography of the ground state of a one-dimensional quantum spin chain, using a variational quantum circuit simulator. Our method is suitable for near-term quantum computing platforms, and could be used for relatively large-scale quantum state tomography for experimentally relevant quantum states.