Reviewerly/exHarmony huggingface dataset:
Database reasoning over text

Neural models have shown impressive performance gains in answering queries from natural language text.However, existing works are unable to support database queries, such as "List/Count all female athletes who were born in 20th century", which require reasoning over sets of relevant facts with operations such as join, filtering and aggregation.We show that while state-of-the-art transformer models perform very well for small databases, they exhibit limitations in processing noisy data, numerical operations, and queries that aggregate facts.We propose a modular architecture to answer these database-style queries over multiple spans from text and aggregating these at scale.We evaluate the architecture using WIKINLDB, 1 a novel dataset for exploring such queries.Our architecture scales to databases containing thousands of facts whereas contemporary models are limited by how many facts can be encoded.In direct comparison on small databases, our approach increases overall answer accuracy from 85% to 90%.On larger databases, our approach retains its accuracy whereas transformer baselines could not encode the context.
Learning Complex 3D Human Self-Contact

Monocular estimation of three dimensional human self-contact is fundamental for detailed scene analysis including body language understanding and behaviour modeling. Existing 3d reconstruction methods do not focus on body regions in self-contact and consequently recover configurations that are either far from each other or self-intersecting, when they should just touch. This leads to perceptually incorrect estimates and limits impact in those very fine-grained analysis domains where detailed 3d models are expected to play an important role. To address such challenges we detect self-contact and design 3d losses to explicitly enforce it. Specifically, we develop a model for Self-Contact Prediction (SCP), that estimates the body surface signature of self-contact, leveraging the localization of self-contact in the image, during both training and inference. We collect two large datasets to support learning and evaluation: (1) HumanSC3D, an accurate 3d motion capture repository containing 1,032 sequences with 5,058 contact events and 1,246,487 ground truth 3d poses synchronized with images collected from multiple views, and (2) FlickrSC3D, a repository of 3,969 images, containing 25,297 surface-to-surface correspondences with annotated image spatial support. We also illustrate how more expressive 3d reconstructions can be recovered under self-contact signature constraints and present monocular detection of face-touch as one of the multiple applications made possible by more accurate self-contact models.
Image Captioning with Context-Aware Auxiliary Guidance

Image captioning is a challenging computer vision task, which aims to generate a natural language description of an image. Most recent researches follow the encoder-decoder framework which depends heavily on the previous generated words for the current prediction. Such methods can not effectively take advantage of the future predicted information to learn complete semantics. In this paper, we propose Context-Aware Auxiliary Guidance (CAAG) mechanism that can guide the captioning model to perceive global contexts. Upon the captioning model, CAAG performs semantic attention that selectively concentrates on useful information of the global predictions to reproduce the current generation. To validate the adaptability of the method, we apply CAAG to three popular captioners and our proposal achieves competitive performance on the challenging Microsoft COCO image captioning benchmark, e.g. 132.2 CIDEr-D score on Karpathy split and 130.7 CIDEr-D (c40) score on official online evaluation server.
Efficient Data Communication Using Distributed Ledger Technology and IOTA-Enabled Internet of Things for a Future Machine-to-Machine Economy

A potential rise in interest in the Internet of Things in the upcoming years is expected in the fields of healthcare, supply chain, logistics, industries, smart cities, smart homes, cyber physical systems, etc. This paper discloses the fusion of the Internet of Things (IoT) with the so-called “distributed ledger technology” (DLT). IoT sensors like temperature sensors, motion sensors, GPS or connected devices convey the activity of the environment. Sensor information acquired by such IoT devices are then stored in a blockchain. Data on a blockchain remains immutable however its scalability still remains a challenging issue and thus represents a hindrance for its mass adoption in the IoT. Here a communication system based on IOTA and DLT is discussed with a systematic architecture for IoT devices and a future machine-to-machine (M2M) economy. The data communication between IoT devices is analyzed using multiple use cases such as sending DHT-11 sensor data to the IOTA tangle. The value communication is analyzed using a novel “micro-payment enabled over the top” (MP-OTT) streaming platform that is based on the “pay-as-you-go” and “consumption based” models to showcase IOTA value transactions. In this paper, we propose an enhancement to the classical “masked authenticated message” (MAM) communication protocol and two architectures called dual signature masked authenticated message (DSMAM) and index-based address value transaction (IBAVT). Further, we provided an empirical analysis and discussion of the proposed techniques. The implemented solution provides better address management with secured sharing and communication of IoT data, complete access control over the ownership of data and high scalability in terms of number of transactions that can be handled.
Rethinking of Radar’s Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment

Radar has long been a common sensor on autonomous vehicles for obstacle ranging and speed estimation. However, as a robust sensor to all-weather conditions, radar’s capability has not been well-exploited, compared with camera or LiDAR. Instead of just serving as a supplementary sensor, radar’s rich information hidden in the radio frequencies can potentially provide useful clues to achieve more complicated tasks, like object classification and detection. In this paper, we propose a new dataset, named CRUW <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> , with a systematic annotator and performance evaluation system to address the radar object detection (ROD) task, which aims to classify and localize the objects in 3D purely from radar’s radio frequency (RF) images. To the best of our knowledge, CRUW is the first public large-scale dataset with a systematic annotation and evaluation system, which involves camera RGB images and radar RF images, collected in various driving scenarios.
SQL Injection Detection Using Machine Learning

SQL Injection attack considered as the one among the foremost vulnerability that exploits in terms of privacy exposure also as money loss. SQL Injection attacks are the amount one vulnerability within the most up-to-date OWASP top 10 report, and therefore the amount of those attacks continues to extend. Machine learning algorithms are used to solve the SQL Injection detection challenge. The next traffic is classified as SQL Injection or plain text using a classification algorithm. The machine learning classification algorithm is used in the matter, they are, Naive Bayes Classifier, Passive Aggressive Classifier, SVM, CNN, Logistic Regression. As a result, CNN was chosen to be used in the detection of SQL Injection attacks.
Artificial intelligence for solid tumour diagnosis in digital pathology

Tumour diagnosis relies on the visual examination of histological slides by pathologists through a microscope eyepiece. Digital pathology, the digitalization of histological slides at high magnification with slides scanners, has raised the opportunity to extract quantitative information due to image analysis. In the last decade, medical image analysis has made exceptional progress due to the development of artificial intelligence (AI) algorithms. AI has been successfully used in the field of medical imaging and more recently in digital pathology. The feasibility and usefulness of AI assisted pathology tasks have been demonstrated in the very last years and we can expect those developments to be applied to routine histopathology in the future. In this review, we will describe and illustrate this technique and present the most recent applications in the field of tumour histopathology. LINKED ARTICLES This article is part of a themed issue on Molecular imaging ‐ visual themed issue. To view the other articles in this section visit http://onlinelibrary.wiley.com/doi/10.1111/bph.v178.21/issuetoc
Norm-guided Adaptive Visual Embedding for Zero-Shot Sketch-Based Image Retrieval

Zero-shot sketch-based image retrieval (ZS-SBIR), which aims to retrieve photos with sketches under the zero-shot scenario, has shown extraordinary talents in real-world applications. Most existing methods leverage language models to generate class-prototypes and use them to arrange the locations of all categories in the common space for photos and sketches. Although great progress has been made, few of them consider whether such pre-defined prototypes are necessary for ZS-SBIR, where locations of unseen class samples in the embedding space are actually determined by visual appearance and a visual embedding actually performs better. To this end, we propose a novel Norm-guided Adaptive Visual Embedding (NAVE) model, for adaptively building the common space based on visual similarity instead of language-based pre-defined prototypes. To further enhance the representation quality of unseen classes for both photo and sketch modality, modality norm discrepancy and noisy label regularizer are jointly employed to measure and repair the modality bias of the learned common embedding. Experiments on two challenging datasets demonstrate the superiority of our NAVE over state-of-the-art competitors.
Research landscape of smart education: a bibliometric analysis

Purpose This paper aims to present a comprehensive review of the present state and trends of smart education research. It addresses the need to have a systematic review of smart education to depict its research landscape in view of the growing volume of related publications. Design/methodology/approach A bibliometric analysis of publications on smart education published in 2011 to 2020 was conducted, covering their patterns and trends in terms of collaboration, key publications, major topics and trends. A total of 1,317 publications with 29,317 cited references were collected from the Web of Science and Scopus for the bibliometric analysis. Findings Research on smart education has been widely published in various sources. The most frequently cited references are all theoretical or discussion articles. Researchers in the USA, China, South Korea, India and Russia have been most active in research collaborations. However, international collaborations have remained infrequent except for those involving the USA. The research on smart education broadly covered smart technologies as well as teaching and learning. The emerging topics have addressed areas such as the Internet of Things, big data, flipped learning and gamification. Originality/value This study depicts the intellectual landscape of smart education research, and illustrated the evolution and emerging trends in the field. The results highlight its latest developments and research needs, and suggest future work related to research collaborations on a larger scale and more studies on smart pedagogies.
Visual Relationship Detection Using Part-and-Sum Transformers with Composite Queries

Computer vision applications such as visual relationship detection and human object interaction can be formulated as a composite (structured) set detection problem in which both the parts (subject, object, and predicate) and the sum (triplet as a whole) are to be detected in a hierarchical fashion. In this paper, we present a new approach, denoted Part-and-Sum detection Transformer (PST), to perform end-to-end visual composite set detection. Different from existing Transformers in which queries are at a single level, we simultaneously model the joint part and sum hypotheses/interactions with composite queries and attention modules. We explicitly incorporate sum queries to enable better modeling of the part-and-sum relations that are absent in the standard Transformers. Our approach also uses novel tensor-based part queries and vector-based sum queries, and models their joint interaction. We report experiments on two vision tasks, visual relationship detection and human object interaction and demonstrate that PST achieves state of the art results among single-stage models, while nearly matching the results of custom designed two-stage models.
Quantum Circuits for Exact Unitary <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline" overflow="scroll"><mml:mi>t</mml:mi></mml:math> -Designs and Applications to Higher-Order Randomized Benchmarking

A unitary $t$-design is a powerful tool in quantum information science and fundamental physics. Despite its usefulness, only approximate implementations were known for general $t$. In this paper, we provide for the first time quantum circuits that generate exact unitary $t$-designs for any $t$ on an arbitrary number of qubits. Our construction is inductive and is of practical use in small systems. We then introduce a $t$-th order generalization of randomized benchmarking ($t$-RB) as an application of exact $2t$-designs. We particularly study the $2$-RB in detail and show that it reveals self-adjointness of quantum noise, a new metric related to the feasibility of quantum error correction (QEC). We numerically demonstrate that the $2$-RB in one- and two-qubit systems is feasible, and experimentally characterize background noise of a superconducting qubit by the $2$-RB. It is shown from the experiment that interactions with adjacent qubits induce the noise that may result in an obstacle toward the realization of QEC.
Voting for the Right Answer: Adversarial Defense for Speaker Verification

Automatic speaker verification (ASV) is a well developed technology for biometric identification, and has been ubiquitous implemented in security-critic applications, such as banking and access control. However, previous works have shown that ASV is under the radar of adversarial attacks, which are very similar to their original counterparts from human's perception, yet will manipulate the ASV render wrong prediction. Due to the very late emergence of adversarial attacks for ASV, effective countermeasures against them are limited. Given that the security of ASV is of high priority, in this work, we propose the idea of voting for the right answer to prevent risky decisions of ASV in blind spot areas, by employing random sampling and voting. Experimental results show that our proposed method improves the robustness against both the limited-knowledge attackers by pulling the adversarial samples out of the blind spots, and the perfect-knowledge attackers by introducing randomness and increasing the attackers' budgets.
BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation

The success of bidirectional encoders using masked language models, such as BERT, on numerous natural language processing tasks has prompted researchers to attempt to incorporate these pre-trained models into neural machine translation (NMT) systems.However, proposed methods for incorporating pretrained models are non-trivial and mainly focus on BERT, which lacks a comparison of the impact that other pre-trained models may have on translation performance.In this paper, we demonstrate that simply using the output (contextualized embeddings) of a tailored and suitable bilingual pre-trained language model (dubbed BIBERT) as the input of the NMT encoder achieves state-of-the-art translation performance.Moreover, we also propose a stochastic layer selection approach and a concept of dual-directional translation model to ensure the sufficient utilization of contextualized embeddings.In the case of without using back translation, our best models achieve BLEU scores of 30.45 for En→De and 38.61 for De→En on the IWSLT'14 dataset, and 31.26 for En→De and 34.94 for De→En on the WMT'14 dataset, which exceeds all published numbers 12 .
Machine Learning Based Hand Gesture Recognition via EMG Data

Electromyography (EMG) data gives information about the electrical activity related to muscles. EMG data obtained from arm through sensors helps to understand hand gestures. For this work, hand gesture data were taken from UCI2019 EMG dataset obtained from MYO thalmic armband were classied with six dierent machine learning algorithms. Articial Neural Network (ANN), Support Vector Machine (SVM), k-Nearest Neighbor (k-NN), Naive Bayes (NB), Decision Tree (DT) and Random Forest (RF) methods were preferred for comparison based on several performance metrics which are accuracy, precision, sensitivity, specicity, classication error, kappa, root mean squared error (RMSE) and correlation. The data belongs to seven hand gestures. 700 samples from 7 classes (100 samples per group) were used in the experiments. The splitting ratio in the classication was 0.8-0.2, i.e. 80% of the samples were used in training and 20% of data were used in testing phase of the classier. NB was found to be the best among other methods because of high accuracy (96.43%) and sensitivity (96.43%) and the lowest RMSE (0.189). Considering the results of the performance parameters, it can be said that this study recognizes and classies seven hand gestures successfully in comparison with the literature.
The success rate of online illicit drug transactions during a global pandemic

In the months following the onset of the COVID-19 pandemic, the European Monitoring Centre for Drugs and Drug Addiction (EMCDDA; 2020) observed an increased use of cryptomarkets, which led them to question whether cryptomarkets constituted a more convenient channel via which to distribute illicit drugs without any in-person contact. However, as more countries' borders closed, the likelihood is that cryptomarkets have been negatively impacted. We aim to measure and understand the success rate of transactions on cryptomarkets during the ongoing COVID-19 pandemic, through recourse to self-reported data that documents the outcome of cryptomarket transactions.To collect self-reported data on cryptomarket transactions, we launched a platform where participants can enter information about their prior activities on cryptomarkets. The sample consists of 591 valid self-reports that were received between January 1st, 2020 and August 21st, 2020.The number of unsuccessful transactions increased concurrently with the global spread of the pandemic. Both the international and inter-continental nature of the transactions and the severity of the crisis in the vendor's country are significantly associated with delivery failure.Drug cryptomarkets may have been disrupted due to the pandemic. The results lead to two opposing explanations for unsuccessful transactions. One explanation for the lower success rate is the inability of drug dealers to deliver on past promises that were made in good faith, while the second points towards opportunistic and abusive behaviour by drug dealers.
Feature selection for proximity estimation in COVID-19 contact tracing apps based on Bluetooth Low Energy (BLE)

During the COVID-19 pandemic, contact tracing apps based on the Bluetooth Low Energy (BLE) technology found in smartphones have been deployed by multiple countries despite BLE’s debatable performance for determining close contacts among users. Current solutions estimate proximity based on a single feature: the mean attenuation of the BLE signal. In this context, a new generation of these apps which better exploits data from the BLE signal and other sensors available on phones can be fostered. Collected data can be used to extract multiple features that feed machine learning models which can potentially improve the accuracy of today’s solutions. In this work, we consider the use of machine learning models to evaluate different feature sets that can be extracted from the received BLE signal, and assess the performance gain as more features are introduced in these models. Since indoor conditions have a strong impact in assessing the risk of being exposed to the SARS-CoV-2, we analyze the environment (indoor or outdoor) role in these models, aiming at understanding the need for apps that could increase proximity accuracy if aware of its environment. Results show that a better accuracy can be obtained in outdoor locations with respect to indoor ones, and that indoor proximity estimation can benefit more from the introduction of more features with respect to the outdoor estimation case. Accuracy can be increased about 10% when multiple features are considered if the device is aware of its environment, reaching a performance of up to 83% in indoor spaces and up to 91% in outdoor ones. These results encourage future contact tracing apps to integrate this awareness not only to better assess the associated risk of a given environment but also to improve the proximity accuracy for detecting close contacts.
Attention is not Enough: Mitigating the Distribution Discrepancy in Asynchronous Multimodal Sequence Fusion

Videos flow as the mixture of language, acoustic, and vision modalities. A thorough video understanding needs to fuse time-series data of different modalities for prediction. Due to the variable receiving frequency for sequences from each modality, there usually exists inherent asynchrony across the collected multimodal streams. Towards an efficient multimodal fusion from asynchronous multimodal streams, we need to model the correlations between elements from different modalities. The recent Multimodal Transformer (MulT) approach extends the self-attention mechanism of the original Transformer network to learn the crossmodal dependencies between elements. However, the direct replication of self-attention will suffer from the distribution mismatch across different modality features. As a result, the learnt crossmodal dependencies can be unreliable. Motivated by this observation, this work proposes the Modality-Invariant Crossmodal Attention (MICA) approach towards learning crossmodal interactions over modality-invariant space in which the distribution mismatch between different modalities is well bridged. To this end, both the marginal distribution and the elements with high-confidence correlations are aligned over the common space of the query and key vectors which are computed from different modalities. Experiments on three standard benchmarks of multimodal video understanding clearly validate the superiority of our approach.