Reviewerly/exHarmony huggingface dataset:
AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove

Sign language recognition, especially the sentence recognition, is of great significance for lowering the communication barrier between the hearing/speech impaired and the non-signers. The general glove solutions, which are employed to detect motions of our dexterous hands, only achieve recognizing discrete single gestures (i.e., numbers, letters, or words) instead of sentences, far from satisfying the meet of the signers' daily communication. Here, we propose an artificial intelligence enabled sign language recognition and communication system comprising sensing gloves, deep learning block, and virtual reality interface. Non-segmentation and segmentation assisted deep learning model achieves the recognition of 50 words and 20 sentences. Significantly, the segmentation approach splits entire sentence signals into word units. Then the deep learning model recognizes all word elements and reversely reconstructs and recognizes sentences. Furthermore, new/never-seen sentences created by new-order word elements recombination can be recognized with an average correct rate of 86.67%. Finally, the sign language recognition results are projected into virtual space and translated into text and audio, allowing the remote and bidirectional communication between signers and non-signers.
The state of play of blockchain technology in the financial services sector: A systematic literature review

The modern trends of digitalization have completely transformed and reshaped business practices, whole businesses, and even a number of industries. Blockchain technology is believed to be the latest advancement in industries such as the financial sector, where trust is of prime significance. Blockchain technology is a decentralized and coded security system which provides the capability for new digital services and platforms to be created through this emerging technology. This research presents a systematic review of scholarly articles on blockchain technology in the financial sector. We commenced by considering 227 articles and subsequently filtered this list down to 87 articles. From this, we present a classification framework that has three dimensions: blockchain-enabled financial benefits, challenges, and functionality. This research identifies implications for future research and practice within the blockchain paradigm.
FAMNet: Joint Learning of Feature, Affinity and Multi-Dimensional Assignment for Online Multiple Object Tracking

Data association-based multiple object tracking (MOT) involves multiple separated modules processed or optimized differently, which results in complex method design and requires non-trivial tuning of parameters. In this paper, we present an end-to-end model, named FAMNet, where Feature extraction, Affinity estimation and Multi-dimensional assignment are refined in a single network. All layers in FAMNet are designed differentiable thus can be optimized jointly to learn the discriminative features and higher-order affinity model for robust MOT, which is supervised by the loss directly from the assignment ground truth. In addition, we integrate single object tracking technique and a dedicated target management scheme into the FAMNet-based tracking system to further recover false negatives and inhibit noisy target candidates generated by the external detector. The proposed method is evaluated on a diverse set of benchmarks including MOT2015, MOT2017, KITTI-Car and UA-DETRAC, and achieves promising performance on all of them in comparison with state-of-the-arts.
Large Scale Adversarial Representation Learning

Adversarially trained generative models (GANs) have recently achieved compelling image synthesis results. But despite early successes in using GANs for unsupervised representation learning, they have since been superseded by approaches based on self-supervision. In this work we show that progress in image generation quality translates to substantially improved representation learning performance. Our approach, BigBiGAN, builds upon the state-of-the-art BigGAN model, extending it to representation learning by adding an encoder and modifying the discriminator. We extensively evaluate the representation learning and generation capabilities of these BigBiGAN models, demonstrating that these generation-based models achieve the state of the art in unsupervised representation learning on ImageNet, as well as compelling results in unconditional image generation.
Towards Scene Understanding: Unsupervised Monocular Depth Estimation With Semantic-Aware Representation

Monocular depth estimation is a challenging task in scene understanding, with the goal to acquire the geometric properties of 3D space from 2D images. Due to the lack of RGB-depth image pairs, unsupervised learning methods aim at deriving depth information with alternative supervision such as stereo pairs. However, most existing works fail to model the geometric structure of objects, which generally results from considering pixel-level objective functions during training. In this paper, we propose SceneNet to overcome this limitation with the aid of semantic understanding from segmentation. Moreover, our proposed model is able to perform region-aware depth estimation by enforcing semantics consistency between stereo pairs. In our experiments, we qualitatively and quantitatively verify the effectiveness and robustness of our model, which produces favorable results against the state-of-the-art approaches do.
Revisiting Perspective Information for Efficient Crowd Counting

Crowd counting is the task of estimating people numbers in crowd images. Modern crowd counting methods employ deep neural networks to estimate crowd counts via crowd density regressions. A major challenge of this task lies in the perspective distortion, which results in drastic person scale change in an image. Density regression on the small person area is in general very hard. In this work, we propose a perspective-aware convolutional neural network (PACNN) for efficient crowd counting, which integrates the perspective information into density regression to provide additional knowledge of the person scale change in an image. Ground truth perspective maps are firstly generated for training; PACNN is then specifically designed to predict multi-scale perspective maps and encode them as perspective-aware weighting layers in the network to adaptively combine the outputs of multi-scale density maps. The weights are learned at every pixel of the maps such that the final density combination is robust to the perspective distortion. We conduct extensive experiments on the ShanghaiTech, WorldExpo'10, UCF_CC_50, and UCSD datasets, and demonstrate the effectiveness and efficiency of PACNN over the state-of-the-art.
Scene Perception in the Human Brain

Humans are remarkably adept at perceiving and understanding complex real-world scenes. Uncovering the neural basis of this ability is an important goal of vision science. Neuroimaging studies have identified three cortical regions that respond selectively to scenes: parahippocampal place area, retrosplenial complex/medial place area, and occipital place area. Here, we review what is known about the visual and functional properties of these brain areas. Scene-selective regions exhibit retinotopic properties and sensitivity to low-level visual features that are characteristic of scenes. They also mediate higher-level representations of layout, objects, and surface properties that allow individual scenes to be recognized and their spatial structure ascertained. Challenges for the future include developing computational models of information processing in scene regions, investigating how these regions support scene perception under ecologically realistic conditions, and understanding how they operate in the context of larger brain networks.
Solar radiation prediction using recurrent neural network and artificial neural network: A case study with comparisons

With the rapid advancement of the high-performance computing technology and the increasing availability of the mass-storage memory device, the application of the data-driven models (e.g., the artificial neural network (ANN) model) for solar radiation prediction is appearing in abundance in the past decade. Although the performances of these models have been discussed in a large number of studies, how to further enhance the forecasting accuracies of these data-driven approaches to better facilitate the advanced controls in the building system such as model predictive control (MPC) in smart buildings remains a challenge. Deep learning, which is considered as a powerful tool to move machine learning closer to one of its original goals, i.e., Artificial Intelligence (AI), is a viable solution to this problem. In this study, an ANN model and a recurrent neural network (RNN) model are developed to investigate the performances of the deep learning algorithms for the solar radiation prediction. The actual meteorological data (AMY) from a local weather station in Alabama is used for the training process. Various scenarios, including different sampling frequencies and moving window algorithms, are included for a comprehensive evaluation of the accuracies and efficiencies. The results suggest that compared with the ANN model, the solar radiation prediction using the RNN model has a higher prediction accuracy, with a 47% improvement in Normalized Mean Bias Error (NMBE) and a 26% improvement in Root-Mean-Squared Error (RMSE). Besides, this forecasting accuracy could even be taken to a higher level by increasing the granularity of the data or adding a moving-window algorithm to the prediction model. By increasing the sampling frequency of the training data from 1 h to 10 min, the Root-Coefficient of Variation Mean-Squared Error (CV(RMSE)) of the ANN model dropped from 30.9% to 9.41%, while the CV(RMSE) of the RNN model dropped from 9.83% to 7.64%. For the RNN model, the NMBE was improved from 0.9% to 0.2% after the implementation of the moving-window algorithm. Besides, it was found that the cloud cover could have a significant impact on the prediction accuracy.
Photonic Multiply-Accumulate Operations for Neural Networks

It has long been known that photonic communication can alleviate the data movement bottlenecks that plague conventional microelectronic processors. More recently, there has also been interest in its capabilities to implement low precision linear operations, such as matrix multiplications, fast and efficiently. We characterize the performance of photonic and electronic hardware underlying neural network models using multiply-accumulate operations. First, we investigate the limits of analog electronic crossbar arrays and on-chip photonic linear computing systems. Photonic processors are shown to have advantages in the limit of large processor sizes (>100 μm), large vector sizes (N > 500), and low noise precision (≤4 bits). We discuss several proposed tunable photonic MAC systems, and provide a concrete comparison between deep learning and photonic hardware using several empiricallyvalidated device and system models. We show significant potential improvements over digital electronics in energy (>10 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ), speed (>10 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> ), and compute density (>10 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ).
Exploring the Attack Surface of Blockchain: A Comprehensive Survey

In this paper, we systematically explore the attack surface of the Blockchain technology, with an emphasis on public Blockchains. Towards this goal, we attribute attack viability in the attack surface to 1) the Blockchain cryptographic constructs, 2) the distributed architecture of the systems using Blockchain, and 3) the Blockchain application context. To each of those contributing factors, we outline several attacks, including selfish mining, the 51% attack, DNS attacks, distributed denial-of-service (DDoS) attacks, consensus delay (due to selfish behavior or distributed denial-of-service attacks), Blockchain forks, orphaned and stale blocks, block ingestion, wallet thefts, smart contract attacks, and privacy attacks. We also explore the causal relationships between these attacks to demonstrate how various attack vectors are connected to one another. A secondary contribution of this work is outlining effective defense measures taken by the Blockchain technology or proposed by researchers to mitigate the effects of these attacks and patch associated vulnerabilities.
Invertible Residual Networks

We show that standard ResNet architectures can be made invertible, allowing the same model to be used for classification, density estimation, and generation. Typically, enforcing invertibility requires partitioning dimensions or restricting network architectures. In contrast, our approach only requires adding a simple normalization step during training, already available in standard frameworks. Invertible ResNets define a generative model which can be trained by maximum likelihood on unlabeled data. To compute likelihoods, we introduce a tractable approximation to the Jacobian log-determinant of a residual block. Our empirical evaluation shows that invertible ResNets perform competitively with both state-of-the-art image classifiers and flow-based generative models, something that has not been previously achieved with a single architecture.
A Novel GAN-Based Network for Unmasking of Masked Face

Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate plausible results for removing large objects of complex nature, especially in facial images. The objective of this work is to remove mask objects in facial images. This problem is challenging because (1) most of the time facial masks cover quite a large region of face that even extends beyond the actual face boundary below chin, and (2) facial image pairs with and without mask object do not exist for training. We break the problem into two stages: mask object detection and image completion of the removed mask region. The first stage of our model automatically produces binary segmentation for the mask region. Then, the second stage removes the mask and synthesizes the affected region with fine details while retaining the global coherency of face structure. For this, we have employed a GAN-based network using two discriminators where one discriminator helps learn the global structure of the face and then another discriminator comes in to focus learning on the deep missing region. To train our model in a supervised manner, we create a paired synthetic dataset using publicly available CelebA dataset and evaluated on real world images collected from the Internet. Our model outperforms others representative state-of-the-art approaches both qualitatively and quantitatively.
Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction

Off-policy reinforcement learning aims to leverage experience collected from prior policies for sample-efficient learning. However, in practice, commonly used off-policy approximate dynamic programming methods based on Q-learning and actor-critic methods are highly sensitive to the data distribution, and can make only limited progress without collecting additional on-policy data. As a step towards more robust off-policy algorithms, we study the setting where the off-policy experience is fixed and there is no further interaction with the environment. We identify \emph{bootstrapping error} as a key source of instability in current methods. Bootstrapping error is due to bootstrapping from actions that lie outside of the training data distribution, and it accumulates via the Bellman backup operator. We theoretically analyze bootstrapping error, and demonstrate how carefully constraining action selection in the backup can mitigate it. Based on our analysis, we propose a practical algorithm, bootstrapping error accumulation reduction (BEAR). We demonstrate that BEAR is able to learn robustly from different off-policy distributions, including random data and suboptimal demonstrations, on a range of continuous control tasks.
Exploring Simple Siamese Representation Learning

Siamese networks have become a common structure in various recent models for unsupervised visual representation learning. These models maximize the similarity between two augmentations of one image, subject to certain conditions for avoiding collapsing solutions. In this paper, we report surprising empirical results that simple Siamese networks can learn meaningful representations even using none of the following: (i) negative sample pairs, (ii) large batches, (iii) momentum encoders. Our experiments show that collapsing solutions do exist for the loss and structure, but a stop-gradient operation plays an essential role in preventing collapsing. We provide a hypothesis on the implication of stop-gradient, and further show proof-of-concept experiments verifying it. Our "SimSiam" method achieves competitive results on ImageNet and downstream tasks. We hope this simple baseline will motivate people to rethink the roles of Siamese architectures for unsupervised representation learning. Code will be made available.
Cross-lingual Language Model Pretraining

Recent studies have demonstrated the efficiency of generative pretraining for English natural language understanding. In this work, we extend this approach to multiple languages and show the effectiveness of cross-lingual pretraining. We propose two methods to learn cross-lingual language models (XLMs): one unsupervised that only relies on monolingual data, and one supervised that leverages parallel data with a new cross-lingual language model objective. We obtain state-of-the-art results on cross-lingual classification, unsupervised and supervised machine translation. On XNLI, our approach pushes the state of the art by an absolute gain of 4.9% accuracy. On unsupervised machine translation, we obtain 34.3 BLEU on WMT'16 German-English, improving the previous state of the art by more than 9 BLEU. On supervised machine translation, we obtain a new state of the art of 38.5 BLEU on WMT'16 Romanian-English, outperforming the previous best approach by more than 4 BLEU. Our code and pretrained models will be made publicly available.
Smart contract-based approach for efficient shipment management

Efficient tracking of shipments is critical in managing global trade and logistics activities. The volume of global container movement combined with information opaqueness and process complexity necessitates implementing a robust technology solution with real time tracking capabilities. Blockchain is an emerging technology that offers the necessary platform to track and manage shipment movements in the supply chain using a peer-to-peer, secured, distributed ledger, and without intermediaries or trusted third parties. In this paper, we propose a blockchain-based solution for efficient supply chain management involving items shipped via smart containers. Our proposed solution utilizes the features of smart contracts in Ethereum blockchain to govern and manage interactions between the sender and receiver. Shipped items are included in smart containers equipped with Internet of Things (IoT) sensors that can be used to track and monitor predefined shipping conditions related to temperature, geographical location, humidity, pressure, light exposure, sudden fall, broken seal, etc. Ethereum smart contracts are used to manage shipment conditions, automate payments, legitimize receiver and also issue a refund in case of violations to predefined conditions. In the paper, we present and discuss key aspects related to architectural design, entity relations, interactions among participants, information flow, implementation and testing of the overall system functionality with a potential business case applied to vaccine supply chain. The Smart contracts were implemented in Solidity language and tested using Remix IDE environment, the code has been made publicly available for academic, research and practice community.
Waveguide quantum electrodynamics with superconducting artificial giant atoms

Models of light–matter interactions in quantum electrodynamics typically invoke the dipole approximation1,2, in which atoms are treated as point-like objects when compared to the wavelength of the electromagnetic modes with which they interact. However, when the ratio between the size of the atom and the mode wavelength is increased, the dipole approximation no longer holds and the atom is referred to as a ‘giant atom’2,3. So far, experimental studies with solid-state devices in the giant-atom regime have been limited to superconducting qubits that couple to short-wavelength surface acoustic waves4–10, probing the properties of the atom at only a single frequency. Here we use an alternative architecture that realizes a giant atom by coupling small atoms to a waveguide at multiple, but well separated, discrete locations. This system enables tunable atom–waveguide couplings with large on–off ratios3 and a coupling spectrum that can be engineered by the design of the device. We also demonstrate decoherence-free interactions between multiple giant atoms that are mediated by the quasi-continuous spectrum of modes in the waveguide—an effect that is not achievable using small atoms11. These features allow qubits in this architecture to switch between protected and emissive configurations in situ while retaining qubit–qubit interactions, opening up possibilities for high-fidelity quantum simulations and non-classical itinerant photon generation12,13. Superconducting giant atoms are realized in a waveguide by coupling small atoms to the waveguide at multiple discrete locations, producing tunable atom–waveguide coupling and enabling decoherence-free interactions.
Diversity With Cooperation: Ensemble Methods for Few-Shot Classification

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that advocates the ability to "learn to adapt''. Recent works have shown, however, that simple learning strategies without meta-learning could be competitive. In this paper, we go a step further and show that by addressing the fundamental high-variance issue of few-shot learning classifiers, it is possible to significantly outperform current meta-learning techniques. Our approach consists of designing an ensemble of deep networks to leverage the variance of the classifiers, and introducing new strategies to encourage the networks to cooperate, while encouraging prediction diversity. Evaluation is conducted on the mini-ImageNet, tiered-ImageNet and CUB datasets, where we show that even a single network obtained by distillation yields state-of-the-art results.