Reviewerly/exHarmony huggingface dataset:
Leader-Based Multi-Scale Attention Deep Architecture for Person Re-Identification

Person re-identification (re-id) aims to match people across non-overlapping camera views in a public space. This is a challenging problem because the people captured in surveillance videos often wear similar clothing. Consequently, the differences in their appearance are typically subtle and only detectable at particular locations and scales. In this paper, we propose a deep re-id network (MuDeep) that is composed of two novel types of layers - a multi-scale deep learning layer, and a leader-based attention learning layer. Specifically, the former learns deep discriminative feature representations at different scales, while the latter utilizes the information from multiple scales to lead and determine the optimal weightings for each scale. The importance of different spatial locations for extracting discriminative features is learned explicitly via our leader-based attention learning layer. Extensive experiments are carried out to demonstrate that the proposed MuDeep outperforms the state-of-the-art on a number of benchmarks and has a better generalization ability under a domain generalization setting.
A Just and Comprehensive Strategy for Using NLP to Address Online Abuse

Online abusive behavior affects millions and the NLP community has attempted to mitigate this problem by developing technologies to detect abuse.However, current methods have largely focused on a narrow definition of abuse to detriment of victims who seek both validation and solutions.In this position paper, we argue that the community needs to make three substantive changes: (1) expanding our scope of problems to tackle both more subtle and more serious forms of abuse, (2) developing proactive technologies that counter or inhibit abuse before it harms, and (3) reframing our effort within a framework of justice to promote healthy communities.
Response Generation by Context-Aware Prototype Editing

Open domain response generation has achieved remarkable progress in recent years, but sometimes yields short and uninformative responses. We propose a new paradigm, prototypethen-edit for response generation, that first retrieves a prototype response from a pre-defined index and then edits the prototype response according to the differences between the prototype context and current context. Our motivation is that the retrieved prototype provides a good start-point for generation because it is grammatical and informative, and the post-editing process further improves the relevance and coherence of the prototype. In practice, we design a contextaware editing model that is built upon an encoder-decoder framework augmented with an editing vector. We first generate an edit vector by considering lexical differences between a prototype context and current context. After that, the edit vector and the prototype response representation are fed to a decoder to generate a new response. Experiment results on a large scale dataset demonstrate that our new paradigm significantly increases the relevance, diversity and originality of generation results, compared to traditional generative models. Furthermore, our model outperforms retrieval-based methods in terms of relevance and originality.
Performance Evaluation in Machine Learning: The Good, the Bad, the Ugly, and the Way Forward

This paper gives an overview of some ways in which our understanding of performance evaluation measures for machine-learned classifiers has improved over the last twenty years. I also highlight a range of areas where this understanding is still lacking, leading to ill-advised practices in classifier evaluation. This suggests that in order to make further progress we need to develop a proper measurement theory of machine learning. I then demonstrate by example what such a measurement theory might look like and what kinds of new results it would entail. Finally, I argue that key properties such as classification ability and data set difficulty are unlikely to be directly observable, suggesting the need for latent-variable models and causal inference.
Projection Convolutional Neural Networks for 1-bit CNNs via Discrete Back Propagation

The advancement of deep convolutional neural networks (DCNNs) has driven significant improvement in the accuracy of recognition systems for many computer vision tasks. However, their practical applications are often restricted in resource-constrained environments. In this paper, we introduce projection convolutional neural networks (PCNNs) with a discrete back propagation via projection (DBPP) to improve the performance of binarized neural networks (BNNs). The contributions of our paper include: 1) for the first time, the projection function is exploited to efficiently solve the discrete back propagation problem, which leads to a new highly compressed CNNs (termed PCNNs); 2) by exploiting multiple projections, we learn a set of diverse quantized kernels that compress the full-precision kernels in a more efficient way than those proposed previously; 3) PCNNs achieve the best classification performance compared to other state-ofthe-art BNNs on the ImageNet and CIFAR datasets.
Context-Aware Monolingual Repair for Neural Machine Translation

Modern sentence-level NMT systems often produce plausible translations of isolated sentences.However, when put in context, these translations may end up being inconsistent with each other.We propose a monolingual DocRepair model to correct inconsistencies between sentence-level translations.DocRepair performs automatic post-editing on a sequence of sentence-level translations, refining translations of sentences in context of each other.For training, the DocRepair model requires only monolingual document-level data in the target language.It is trained as a monolingual sequence-to-sequence model that maps inconsistent groups of sentences into consistent ones.The consistent groups come from the original training data; the inconsistent groups are obtained by sampling roundtrip translations for each isolated sentence.We show that this approach successfully imitates inconsistencies we aim to fix: using contrastive evaluation, we show large improvements in the translation of several contextual phenomena in an English→Russian translation task, as well as improvements in the BLEU score.We also conduct a human evaluation and show a strong preference of the annotators to corrected translations over the baseline ones.Moreover, we analyze which discourse phenomena are hard to capture using monolingual data only. 1
Data Management in Supply Chain Using Blockchain: Challenges and a Case Study

Supply chain management (SCM) is fundamental for gaining financial, environmental and social benefits in the supply chain industry. However, traditional SCM mechanisms usually suffer from a wide scope of issues such as lack of information sharing, long delays for data retrieval, and unreliability in product tracing. Recent advances in blockchain technology show great potential to tackle these issues due to its salient features including immutability, transparency, and decentralization. Although there are some proof-of-concept studies and surveys on blockchain-based SCM from the perspective of logistics, the underlying technical challenges are not clearly identified. In this paper, we provide a comprehensive analysis of potential opportunities, new requirements, and principles of designing blockchain-based SCM systems. We summarize and discuss four crucial technical challenges in terms of scalability, throughput, access control, data retrieval and review the promising solutions. Finally, a case study of designing blockchain-based food traceability system is reported to provide more insights on how to tackle these technical challenges in practice.
How to Design More Sustainable Financial Systems: The Roles of Environmental, Social, and Governance Factors in the Decision-Making Process

A literature review showed that finance is a driver of sustainability. However, to achieve sustainability through finance, it is necessary to rebuild and adapt the financial system to the specifics of sustainable development. Modern financial systems can be described as one-dimensional, focusing on ensuring the economic security of transactions. Meanwhile, the growing role of risk related to non-financial factors means that the factors referred to as ESG (environmental, social, governance) become the main source threatening the stability of financial systems. Adaptation activities toward the design of so-called three-dimensional financial systems rely on incorporating ESG risk into the financial decisions of the financial institutions that make up the financial system. This is found, among other factors, in the risk assessment methodology. The general goal of the paper is to investigate which ESG criteria are incorporated into the decision-making process of financial institutions and to verify the level of sustainability of financial systems in selected OECD (Organization for Economic Cooperation and Development) countries. The main research hypothesis assumes that incorporating ESG factors into the decision-making process of financial institutions makes financial systems more sustainable. A two-stage research procedure was used to achieve the research goal. In the first stage, to determine the ESG factors that affect the level of sustainability of financial systems and identify dependencies between ESG factors incorporated by financial institutions into the decision-making process, a fuzzy cognitive map (FCM) was used. The collective map elaborating on the basis of the opinions of experts participating in the study was built using the software FCMapper_bugfix_27.1.2016. In the second stage, based on multiple-criteria decision analysis (MCDA) using the PROMETHEE method (Preference Ranking Organization Method of Enrichment Evaluation), 23 OECD countries that respect the Equator Principles were ranked according to seven groups of criteria defined for financial system assessment (financial depth, development, vulnerability, soundness, fragility, stability, and sustainability), based on a literature review. The ranking confirmed the strong position of Scandinavian countries for assuring best sustainability practices in financial institutions and in the economy. The added value of this paper can be considered at two levels: theoretical and empirical. From the theoretical point of view, it should be noted that it is the first of this kind of analysis which prioritizes ESG factors in financial decisions and ranks financial systems according to fulfilling sustainability criteria. The original empirical approach based on the two-stage research procedure provided analysis of 62 factors, of which 21 represented the environmental scope, 25 the social scope, and 16 the governance scope, which is the main advantage of the empirical study presented in the paper.
Learning physical properties in complex visual scenes: An intelligent machine for perceiving blood flow dynamics from static CT angiography imaging

Humans perceive physical properties such as motion and elastic force by observing objects in visual scenes. Recent research has proven that computers are capable of inferring physical properties from camera images like humans. However, few studies perceive the physical properties in more complex environment, i.e. humans have difficulty estimating physical quantities directly from the visual observation, or encounter difficulty visualizing the physical process in mind according to their daily experiences. As an appropriate example, fractional flow reserve (FFR), which measures the blood pressure difference across the vessel stenosis, becomes an important physical quantitative value determining the likelihood of myocardial ischemia in clinical coronary intervention procedure. In this study, we propose a novel deep neural network solution (TreeVes-Net) that allows machines to perceive FFR values directly from static coronary CT angiography images. Our framework fully utilizes a tree-structured recurrent neural network (RNN) with a coronary representation encoder. The encoder captures coronary geometric information providing the blood fluid-related representation. The tree-structured RNN builds a long-distance spatial dependency of blood flow information inside the coronary tree. The experiments performed on 13000 synthetic coronary trees and 180 real coronary trees from clinical patients show that the values of the area under ROC curve (AUC) are 0.92 and 0.93 under two clinical criterions. These results can demonstrate the effectiveness of our framework and its superiority to seven FFR computation methods based on machine learning.
Probing the universality of topological defect formation in a quantum annealer: Kibble-Zurek mechanism and beyond

The number of topological defects created in a system driven through a quantum phase transition exhibits a power-law scaling with the driving time. This universal scaling law is the key prediction of the Kibble-Zurek mechanism (KZM), and testing it using a hardware-based quantum simulator is a coveted goal of quantum information science. Here we provide such a test using quantum annealing. Specifically, we report on extensive experimental tests of topological defect formation via the one-dimensional transverse-field Ising model on two different D-Wave quantum annealing devices. We find that the quantum simulator results can indeed be explained by the KZM for open-system quantum dynamics with phase-flip errors, with certain quantitative deviations from the theory likely caused by factors such as random control errors and transient effects. In addition, we probe physics beyond the KZM by identifying signatures of universality in the distribution and cumulants of the number of kinks and their decay, and again find agreement with the quantum simulator results. This implies that the theoretical predictions of the generalized KZM theory, which assumes isolation from the environment, applies beyond its original scope to an open system. We support this result by extensive numerical computations. To check whether an alternative, classical interpretation of these results is possible, we used the spin-vector Monte Carlo model, a candidate classical description of the D-Wave device. We find that the degree of agreement with the experimental data from the D-Wave annealing devices is better for the KZM, a quantum theory, than for the classical spin-vector Monte Carlo model, thus favoring a quantum description of the device. Our work provides an experimental test of quantum critical dynamics in an open quantum system, and paves the way to new directions in quantum simulation experiments.
German’s Next Language Model

In this work we present the experiments which lead to the creation of our BERT and ELECTRA based German language models, GBERT and GELECTRA.By varying the input training data, model size, and the presence of Whole Word Masking (WWM) we were able to attain SoTA performance across a set of document classification and named entity recognition (NER) tasks for both models of base and large size.We adopt an evaluation driven approach in training these models and our results indicate that both adding more data and utilizing WWM improve model performance.By benchmarking against existing German models, we show that these models are the best German models to date.Our trained models will be made publicly available to the research community.
How many data points is a prompt worth?

When fine-tuning pretrained models for classification, researchers either use a generic model head or a task-specific prompt for prediction. Proponents of prompting have argued that prompts provide a method for injecting task-specific guidance, which is beneficial in low-data regimes. We aim to quantify this benefit through rigorous testing of prompts in a fair setting: comparing prompted and head-based fine-tuning in equal conditions across many tasks and data sizes. By controlling for many sources of advantage, we find that prompting does indeed provide a benefit, and that this benefit can be quantified per task. Results show that prompting is often worth 100s of data points on average across classification tasks.
Quantum convolutional neural network for classical data classification

With the rapid advance of quantum machine learning, several proposals for the quantum-analogue of convolutional neural network (CNN) have emerged. In this work, we benchmark fully parameterized quantum convolutional neural networks (QCNNs) for classical data classification. In particular, we propose a quantum neural network model inspired by CNN that only uses two-qubit interactions throughout the entire algorithm. We investigate the performance of various QCNN models differentiated by structures of parameterized quantum circuits, quantum data encoding methods, classical data pre-processing methods, cost functions and optimizers on MNIST and Fashion MNIST datasets. In most instances, QCNN achieved excellent classification accuracy despite having a small number of free parameters. The QCNN models performed noticeably better than CNN models under the similar training conditions. Since the QCNN algorithm presented in this work utilizes fully parameterized and shallow-depth quantum circuits, it is suitable for Noisy Intermediate-Scale Quantum (NISQ) devices.
Blockchain applications in health care for COVID-19 and beyond: a systematic review

The COVID-19 pandemic has had a substantial and global impact on health care, and has greatly accelerated the adoption of digital technology. One of these emerging digital technologies, blockchain, has unique characteristics (eg, immutability, decentralisation, and transparency) that can be useful in multiple domains (eg, management of electronic medical records and access rights, and mobile health). We conducted a systematic review of COVID-19-related and non-COVID-19-related applications of blockchain in health care. We identified relevant reports published in MEDLINE, SpringerLink, Institute of Electrical and Electronics Engineers Xplore, ScienceDirect, arXiv, and Google Scholar up to July 29, 2021. Articles that included both clinical and technical designs, with or without prototype development, were included. A total of 85 375 articles were evaluated, with 415 full length reports (37 related to COVID-19 and 378 not related to COVID-19) eventually included in the final analysis. The main COVID-19-related applications reported were pandemic control and surveillance, immunity or vaccine passport monitoring, and contact tracing. The top three non-COVID-19-related applications were management of electronic medical records, internet of things (eg, remote monitoring or mobile health), and supply chain monitoring. Most reports detailed technical performance of the blockchain prototype platforms (277 [66·7%] of 415), whereas nine (2·2%) studies showed real-world clinical application and adoption. The remaining studies (129 [31·1%] of 415) were themselves of a technical design only. The most common platforms used were Ethereum and Hyperledger. Blockchain technology has numerous potential COVID-19-related and non-COVID-19-related applications in health care. However, much of the current research remains at the technical stage, with few providing actual clinical applications, highlighting the need to translate foundational blockchain technology into clinical use.
InfoGCN: Representation Learning for Human Skeleton-based Action Recognition

Human skeleton-based action recognition offers a valuable means to understand the intricacies of human behavior because it can handle the complex relationships between physical constraints and intention. Although several studies have focused on encoding a skeleton, less attention has been paid to embed this information into the latent representations of human action. InfoGCN proposes a learning framework for action recognition combining a novel learning objective and an encoding method. First, we design an information bottleneck-based learning objective to guide the model to learn informative but compact latent representations. To provide discriminative information for classifying action, we introduce attention-based graph convolution that captures the context-dependent intrinsic topology of human action. In addition, we present a multi-modal representation of the skeleton using the relative position of joints, designed to provide complementary spatial information for joints. InfoGcn <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> Code is available at github.com/stnoahl/infogcn surpasses the known state-of-the-art on multiple skeleton-based action recognition benchmarks with the accuracy of 93.0% on NTU RGB+D 60 cross-subject split, 89.8% on NTU RGB+D 120 cross-subject split, and 97.0% on NW-UCLA.
Lightweight Sharable and Traceable Secure Mobile Health System

Mobile health (mHealth) has emerged as a new patient centric model which allows real-time collection of patient data via wearable sensors, aggregation and encryption of these data at mobile devices, and then uploading the encrypted data to the cloud for storage and access by healthcare staff and researchers. However, efficient and scalable sharing of encrypted data has been a very challenging problem. In this paper, we propose a Lightweight Sharable and Traceable (LiST) secure mobile health system in which patient data are encrypted end-to-end from a patient's mobile device to data users. LiST enables efficient keyword search and fine-grained access control of encrypted data, supports tracing of traitors who sell their search and access privileges for monetary gain, and allows on-demand user revocation. LiST is lightweight in the sense that it offloads most of the heavy cryptographic computations to the cloud while only lightweight operations are performed at the end user devices. We formally define the security of LiST and prove that it is secure without random oracle. We also conduct extensive experiments to access the system's performance.
Object Detection in Videos by High Quality Object Linking

Compared with object detection in static images, object detection in videos is more challenging due to degraded image qualities. An effective way to address this problem is to exploit temporal contexts by linking the same object across video to form tubelets and aggregating classification scores in the tubelets. In this paper, we focus on obtaining high quality object linking results for better classification. Unlike previous methods that link objects by checking boxes between neighboring frames, we propose to link in the same frame. To achieve this goal, we extend prior methods in following aspects: (1) a cuboid proposal network that extracts spatio-temporal candidate cuboids which bound the movement of objects; (2) a short tubelet detection network that detects short tubelets in short video segments; (3) a short tubelet linking algorithm that links temporally-overlapping short tubelets to form long tubelets. Experiments on the ImageNet VID dataset show that our method outperforms both the static image detector and the previous state of the art. In particular, our method improves results by 8.8 percent over the static image detector for fast moving objects.