Reviewerly/exHarmony huggingface dataset:
Speech Vision: An End-to-End Deep Learning-Based Dysarthric Automatic Speech Recognition System

Dysarthria is a disorder that affects an individual’s speech intelligibility due to the paralysis of muscles and organs involved in the articulation process. As the condition is often associated with physically debilitating disabilities, not only do such individuals face communication problems, but also interactions with digital devices can become a burden. For these individuals, automatic speech recognition (ASR) technologies can make a significant difference in their lives as computing and portable digital devices can become an interaction medium, enabling them to communicate with others and computers. However, ASR technologies have performed poorly in recognizing dysarthric speech, especially for severe dysarthria, due to multiple challenges facing dysarthric ASR systems. We identified these challenges are due to the alternation and inaccuracy of dysarthric phonemes, the scarcity of dysarthric speech data, and the phoneme labeling imprecision. This paper reports on our second dysarthric-specific ASR system, called Speech Vision (SV) that tackles these challenges by adopting a novel approach towards dysarthric ASR in which speech features are extracted visually, then SV learns to see the shape of the words pronounced by dysarthric individuals. This visual acoustic modeling feature of SV eliminates phoneme-related challenges. To address the data scarcity problem, SV adopts visual data augmentation techniques, generates synthetic dysarthric acoustic visuals, and leverages transfer learning. Benchmarking with other state-of-the-art dysarthric ASR considered in this study, SV outperformed them by improving recognition accuracies for 67% of UA-Speech speakers, where the biggest improvements were achieved for severe dysarthria.
Applications of deep learning to decorated ceramic typology and classification: A case study using Tusayan White Ware from Northeast Arizona

In this study, we present an alternate approach to archaeological typology, using deep learning to classify digital images of decorated pottery sherds into an existing typological framework. The study focuses on a specific kind of ancient painted pottery from the American Southwest, Tusayan White Ware, but we believe it has broader implications for a wide range of geographical settings and artifact types. Our results show that when properly trained, a deep learning model can assign types to digital images of decorated sherds with an accuracy comparable to, and sometimes higher than, four expert-level contemporary archaeologists. The technique also offers novel tools for visualizing both the importance of diagnostic design elements and overall design relationships between groups of pottery sherds. We demonstrate that this method can objectively match a specific unclassified sherd image to its most similar counterparts through a search of thousands of digital photos. This discovery has important archaeological implications for analyzing time relationships, monitoring stylistic trends, reconstructing fragmentary artifacts, identifying ancient artisans, and studying the evolution and spread of ancient technologies and styles. It also shows how deep learning models can potentially supplement or supplant traditional typologies in favor of more direct groupings and comparisons of artifacts.
Recent advances in deep learning based dialogue systems: a systematic survey

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on this task are carried out, and most of them are deep learning based due to their outstanding performance. In this survey, we mainly focus on the deep learning based dialogue systems. We comprehensively review state-of-the-art research outcomes in dialogue systems and analyze them from two angles: model type and system type. Specifically, from the angle of model type, we discuss the principles, characteristics, and applications of different models that are widely used in dialogue systems. This will help researchers acquaint these models and see how they are applied in state-of-the-art frameworks, which is rather helpful when designing a new dialogue system. From the angle of system type, we discuss task-oriented and open-domain dialogue systems as two streams of research, providing insight into the hot topics related. Furthermore, we comprehensively review the evaluation methods and datasets for dialogue systems to pave the way for future research. Finally, some possible research trends are identified based on the recent research outcomes. To the best of our knowledge, this survey is the most comprehensive and up-to-date one at present for deep learning based dialogue systems, extensively covering the popular techniques. We speculate that this work is a good starting point for academics who are new to the dialogue systems or those who want to quickly grasp up-to-date techniques in this area.
Exposing GAN-Generated Faces Using Inconsistent Corneal Specular Highlights

Sophisticated generative adversary network (GAN) models are now able to synthesize highly realistic human faces that are difficult to discern from real ones visually. In this work, we show that GAN synthesized faces can be exposed with the inconsistent corneal specular highlights between two eyes. The inconsistency is caused by the lack of physical/physiological constraints in the GAN models. We show that such artifacts exist widely in high-quality GAN synthesized faces and further describe an automatic method to extract and compare corneal specular highlights from two eyes. Qualitative and quantitative evaluations of our method suggest its simplicity and effectiveness in distinguishing GAN synthesized faces.
Implementing Public Health Strategies—The Need for Educational Initiatives: A Systematic Review

In the absence of a specific treatment or vaccines, public health strategies are the main measures to use in the initial stages of a pandemic to allow surveillance of infectious diseases. During the ongoing global pandemic of coronavirus disease 2019 (COVID-19), several countries initiated various public health strategies, such as contact tracing and quarantine. The present study aims to conduct a systematic literature review to identify the presence of educational initiatives that promote the implementation of public health strategies before public health emergencies, with a special focus on contact tracing applications. Using Science Direct, PubMed, Scopus, and Gothenburg University search engines, all published scientific articles were included, while conference, reports, and non-scientific papers were excluded. The outcomes of the reviewed studies indicate that the effective implementation of public health strategies depends on the peoples' willingness to participate and collaborate with local authorities. Several factors may influence such willingness, of which ethical, psychological, and practical factors seem to be the most important and frequently discussed. Moreover, individual willingness and readiness of a community may also vary based on the acquired level of knowledge about the incident and its cause and available management options. Educational initiatives, proper communication, and timely information at the community level were found to be the necessary steps to counteract misinformation and to promote a successful implementation of public health strategies and attenuate the effects of a pandemic. The systematic review conducted as a part of this study would benefit the relevant stakeholders and policy makers and assist with effective designing and implementation.
Predicting Brain Age Using Machine Learning Algorithms: A Comprehensive Evaluation

Machine learning (ML) algorithms play a vital role in the brain age estimation frameworks. The impact of regression algorithms on prediction accuracy in the brain age estimation frameworks have not been comprehensively evaluated. Here, we sought to assess the efficiency of different regression algorithms on brain age estimation. To this end, we built a brain age estimation framework based on a large set of cognitively healthy (CH) individuals ( N = 788) as a training set followed by different regression algorithms (22 different algorithms in total). We then quantified each regression-algorithm on independent test sets composed of 88 CH individuals, 70 mild cognitive impairment patients as well as 30 Alzheimer's disease patients. The prediction accuracy in the independent test set (i.e., CH set) varied in regression algorithms mean absolute error (MAE) from 4.63 to 7.14 yrs, R2 from 0.76 to 0.88. The highest and lowest prediction accuracies were achieved by Quadratic Support Vector Regression algorithm (MAE = 4.63 yrs, R2 = 0.88, 95% CI = [-1.26, 1.42]) and Binary Decision Tree algorithm (MAE = 7.14 yrs, R2 = 0.76, 95% CI = [-1.50, 2.62]), respectively. Our experimental results demonstrate that the prediction accuracy in brain age frameworks is affected by regression algorithms, indicating that advanced machine learning algorithms can lead to more accurate brain age predictions in clinical settings.
Recent progress of integrated circuits and optoelectronic chips

Integrated circuits (ICs) and optoelectronic chips are the foundation stones of the modern information society. The IC industry has been driven by the so-called “Moore’s law” in the past 60 years, and now has entered the post Moore’s law era. In this paper, we review the recent progress of ICs and optoelectronic chips. The research status, technical challenges and development trend of devices, chips and integrated technologies of typical IC and optoelectronic chips are focused on. The main contents include the development law of IC and optoelectronic chip technology, the IC design and processing technology, emerging memory and chip architecture, brain-like chip structure and its mechanism, heterogeneous integration, quantum chip technology, silicon photonics chip technology, integrated microwave photonic chip, and optoelectronic hybrid integrated chip.
Novel <scp>computer‐aided</scp> lung cancer detection based on <scp>convolutional neural network</scp>‐based and feature‐based classifiers using metaheuristics

Abstract This study proposes a lung cancer diagnosis system based on computed tomography (CT) scan images for the detection of the disease. The proposed method uses a sequential approach to achieve this goal. Consequently, two well‐organized classifiers, the convolutional neural network (CNN) and feature‐based methodology, have been used. In the first step, the CNN classifier is optimized using a newly designed optimization method called the improved Harris hawk optimizer. This method is applied to the dataset, and the classification is commenced. If the disease cannot be detected via this method, the results are conveyed to the second classifier, that is, the feature‐based method. This classifier, including Haralick and LBP features, is subsequently applied to the received dataset from the CNN classifier. Finally, if the feature‐based method also does not detect cancer, the case study is healthy; otherwise, the case study is cancerous.
Mutual Attention Inception Network for Remote Sensing Visual Question Answering

Remote sensing images (RSIs) containing various ground objects have been applied in many fields. To make semantic understanding of RSIs objective and interactive, the task remote sensing <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">visual question answering</i> (VQA) has appeared. Given an RSI, the goal of remote sensing VQA is to make an intelligent agent answer a question about the remote sensing scene. Existing remote sensing VQA methods utilized a nonspatial fusion strategy to fuse the image features and question features, which ignores the spatial information of images and word-level information of questions. A novel method is proposed to complete the task considering these two aspects. First, convolutional features of the image are included to represent spatial information, and the word vectors of questions are adopted to present semantic word information. Second, attention mechanism and bilinear technique are introduced to enhance the feature considering the alignments between spatial positions and words. Finally, a fully connected layer with softmax is utilized to output an answer from the perspective of the multiclass classification task. To benchmark this task, a <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">RSIVQA</i> dataset is introduced in this article. For each of more than 37 000 RSIs, the proposed dataset contains at least one or more questions, plus corresponding answers. Experimental results demonstrate that the proposed method can capture the alignments between images and questions. The code and dataset are available at <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><uri>https://github.com/spectralpublic/RSIVQA</uri></i> .
The Challenges of IoT Addressing Security, Ethics, Privacy, and Laws

• The greatest threats of IoT arise in the domains of security, privacy, ethics, and laws • The majority of the research on IoT vulnerabilities is focused only on security while neglecting the equally crucial ethical and privacy aspects • The common user must be made aware of the security, ethical, and privacy threats imposed by modern IoT devices • Only a handful of nations have implemented IoT-specific laws • Statement of Intent Regarding the Security of the Internet of Things is currently the only legal document pertaining to IoT on a truly international level apart from international standards Internet of Things or IoT is a rapidly growing network of interconnected ‘things’ embedded with sensors to collect and exchange data over the internet without the need for human intervention. As the applications of IoT continue to skyrocket, it introduces major security, ethical, privacy, and legal challenges that have a substantial impact on our lives. There is a need for a comprehensive overview covering all of these challenges. Therefore, this paper provides a clear overview of the security, ethical, and privacy challenges faced by the common users and examines the current and emerging IoT laws and standards enacted by governments across different countries to combat the vulnerabilities of IoT. Trust and the potential challenges of smart contracts have also been discussed. In addition, the multitude of use cases described in this paper provides an insight into how the threats and vulnerabilities of IoT influence our lives. This study emphasizes a need for globalized IoT laws and that the common user be made aware of the security, ethical, and privacy threats imposed by modern IoT devices. Lastly, this paper identifies the gaps and proposes certain recommendations to direct future researchers.
Blockchain and Smart Contracts: A Solution for Payment Issues in Construction Supply Chains

The construction industry has dynamic supply chains with multiple suppliers usually engaged in short-term relationships. Government legislation, novel types of payment agreements, conventional information technology solutions, and supply chain management best practices have endeavoured to solve payment-related financial issues in the construction industry, which are mainly caused by the complexities of the construction supply chain. Nevertheless, payment-related issues persist as one of the key challenges in the industry. Applications of blockchain technology–a trusted, distributed data storing mechanism–along with smart contracts are gaining focus as solutions for complex interorganisational processes. A smart contract is a self-executing script that codifies a set of rules or agreements between multiple parties and runs across the blockchain network. This paper identifies the suitability of blockchain and smart contract technologies in solving payment issues in the construction industry. An expert forum of construction industry stakeholders served as the primary data collection method through a structured questionnaire. The key finding of the paper is that blockchain and smart contract powered solutions can significantly mitigate the payment and related financial issues in the construction industry, including partial payments, nonpayments, cost of finance, long payment cycle, retention, and security of payments.
How Teachers Conduct Online Teaching During the COVID-19 Pandemic: A Case Study of Taiwan

Although online teaching has been encouraged for many years, the COVID-19 pandemic has promoted it on a large scale. During the COVID-19 pandemic, students at all levels (college, secondary school, and elementary school) were unable to attend school. To maintain student learning, most schools have adopted online teaching. Therefore, the purpose of this study was to explore the design of online teaching activities and online teaching processes adopted by teachers at all levels during the pandemic. Online questionnaires were administered to teachers in Taiwan who had conducted online teaching (including during the formal suspension of classes or simulation exercises) due to the pandemic. According to a quantitative analysis and lag sequential analysis, the instructional behaviors most frequently performed by teachers were roll calls, lectures with a presentation screen, in-class task (assignment) allocation, and whole-class synchronous video-/audio-based discussion. Thus, there were six common significant sequential behaviors among teachers at all levels that were categorized into the four instructional stages of identifying the teaching environment, teaching the class, discussing and evaluating learning effectiveness. College teachers reminded students of some matters first and then called the roll after the students went online. Secondary school teachers were more likely to arrange practical or experimental courses and to use synchronous and asynchronous interactive activities. Finally, elementary school teachers were more likely to use homemade videos and share their screens for teaching and to arrange a large variety of teaching interactions. The differences among colleges, secondary schools, and elementary schools were identified, and suggestions were made accordingly.
End-to-End Temporal Action Detection With Transformer

Temporal action detection (TAD) aims to determine the semantic label and the temporal interval of every action instance in an untrimmed video. It is a fundamental and challenging task in video understanding. Previous methods tackle this task with complicated pipelines. They often need to train multiple networks and involve hand-designed operations, such as non-maximal suppression and anchor generation, which limit the flexibility and prevent end-to-end learning. In this paper, we propose an end-to-end Transformer-based method for TAD, termed TadTR. Given a small set of learnable embeddings called action queries, TadTR adaptively extracts temporal context information from the video for each query and directly predicts action instances with the context. To adapt Transformer to TAD, we propose three improvements to enhance its locality awareness. The core is a temporal deformable attention module that selectively attends to a sparse set of key snippets in a video. A segment refinement mechanism and an actionness regression head are designed to refine the boundaries and confidence of the predicted instances, respectively. With such a simple pipeline, TadTR requires lower computation cost than previous detectors, while preserving remarkable performance. As a self-contained detector, it achieves state-of-the-art performance on THUMOS14 (56.7% mAP) and HACS Segments (32.09% mAP). Combined with an extra action classifier, it obtains 36.75% mAP on ActivityNet-1.3. Code is available at https://github.com/xlliu7/TadTR.
Fast and Accurate Model Scaling

In this work we analyze strategies for convolutional neural network scaling; that is, the process of scaling a base convolutional network to endow it with greater computational complexity and consequently representational power. Example scaling strategies may include increasing model width, depth, resolution, etc. While various scaling strategies exist, their tradeoffs are not fully understood. Existing analysis typically focuses on the interplay of accuracy and flops (floating point operations). Yet, as we demonstrate, various scaling strategies affect model parameters, activations, and consequently actual runtime quite differently. In our experiments we show the surprising result that numerous scaling strategies yield networks with similar accuracy but with widely varying properties. This leads us to propose a simple fast compound scaling strategy that encourages primarily scaling model width, while scaling depth and resolution to a lesser extent. Unlike currently popular scaling strategies, which result in about O(s) increase in model activation w.r.t. scaling flops by a factor of s, the proposed fast compound scaling results in close to $O\left( {\sqrt s } \right)$ increase in activations, while achieving excellent accuracy. Fewer activations leads to speedups on modern memory-bandwidth limited hardware (e.g., GPUs). More generally, we hope this work provides a framework for analyzing scaling strategies under various computational constraints.
Blockchain technology – recent research and future trend

Blockchain, as a decentralized platform and distributed ledger database, will promote the centralized system to form a comprehensive ecosystem. A systematic review of blockchain research on information systems during the five-year period from 2016 to 2020 selected 46 papers from 16 leading journals. This paper introduces the technological characteristics and implementation models, highlighting its research status and development. Moreover, this paper illustrates the future research directions for blockchain. The objective of this paper is to discuss the emerging technology of blockchain in its early development stage and to depict the relevant IS issues that are worthy of further investigation.
Uncertainty Guided Collaborative Training for Weakly Supervised Temporal Action Detection

Weakly supervised temporal action detection aims to localize temporal boundaries of actions and identify their categories simultaneously with only video-level category labels during training. Among existing methods, attention based methods have achieved superior performance by separating action and non-action segments. However, without the segment-level ground-truth supervision, the quality of the attention weight hinders the performance of these methods. To alleviate this problem, we propose a novel Uncertainty Guided Collaborative Training (UGCT) strategy, which mainly includes two key designs: (1) The first design is an online pseudo label generation module, in which the RGB and FLOW streams work collaboratively to learn from each other. (2) The second design is an uncertainty aware learning module, which can mitigate the noise in the generated pseudo labels. These two designs work together to promote the model performance effectively and efficiently by imposing pseudo label supervision on attention weight learning. Experimental results on three state-of-the-art attention based methods demonstrate that the proposed training strategy can significantly improve the performance of these methods, e.g., more than 4% for all three methods in terms of mAP@IoU=0.5 on the THUMOS14 dataset.