Reviewerly/exHarmony huggingface dataset:
ATCSpeechNet: A multilingual end-to-end speech recognition framework for air traffic control systems

In this paper, a multilingual end-to-end framework, called ATCSpeechNet, is proposed to tackle the issue of translating communication speech into human-readable text in air traffic control (ATC) systems. In the proposed framework, we focus on integrating multilingual automatic speech recognition (ASR) into one model, in which an end-to-end paradigm is developed to convert speech waveforms into text directly, without any feature engineering or lexicon. To compensate the deficiency of handcrafted feature engineering caused by ATC challenges, including multilingual, multispeaker dialog and unstable speech rates, a speech representation learning (SRL) network is proposed to capture robust and discriminative speech representations from raw waves. The self-supervised training strategy is adopted to optimize the SRL network from unlabeled data, and to further predict the speech features, i.e., wave-to-feature. An end-to-end architecture is improved to complete the ASR task, in which a grapheme-based modeling unit is applied to address the multilingual ASR issue. Facing the problem of small transcribed samples in the ATC domain, an unsupervised approach with mask prediction is applied to pretrain the backbone network of the ASR model on unlabeled data by a feature-to-feature process. Finally, by integrating the SRL with ASR, an end-to-end multilingual ASR framework is formulated in a supervised manner, which is able to translate the raw wave into text in one model, i.e., wave-to-text. Experimental results on the ATCSpeech corpus demonstrate that the proposed approach achieves high performance with a very small labeled corpus and less resource consumption, only a 4.20% label error rate on the 58-hour transcribed corpus. Compared to the baseline model, the proposed approach obtains over 100% relative performance improvement which can be further enhanced with increasing size of the transcribed samples. It is also confirmed that the proposed SRL and training strategies make significant contributions to improving the final performance. In addition, the effectiveness of the proposed framework is also validated on common corpora (AISHELL, LibriSpeech, and cv-fr). More importantly, the proposed multilingual framework not only reduces the system complexity but also obtains higher accuracy compared to that of the independent monolingual ASR models. The proposed approach can also greatly reduce the cost of annotating samples, which benefits to advance the ASR technique to industrial applications.
The time-varying causal relationship between the Bitcoin market and internet attention

Abstract The increasing attention on Bitcoin since 2013 prompts the issue of possible evidence for a causal relationship between the Bitcoin market and internet attention. Taking the Google search volume index as the measure of internet attention, time-varying Granger causality between the global Bitcoin market and internet attention is examined. Empirical results show a strong Granger causal relationship between internet attention and trading volume. Moreover, they indicate, beginning in early 2018, an even stronger impact of trading volume on internet attention, which is consistent with the rapid increase in Bitcoin users following the 2017 Bitcoin bubble. Although Bitcoin returns are found to strongly affect internet attention, internet attention only occasionally affects Bitcoin returns. Further investigation reveals that interactions between internet attention and returns can be amplified by extreme changes in prices, and internet attention is more likely to lead to returns during Bitcoin bubbles. These empirical findings shed light on cryptocurrency investor attention theory and imply trading strategy in Bitcoin markets.
AVA: A Financial Service Chatbot Based on Deep Bidirectional Transformers

We develop a chatbot using deep bidirectional transformer (BERT) models to handle client questions in financial investment customer service. The bot can recognize 381 intents, decides when to say I don’t know, and escalate escalation/uncertain questions to human operators. Our main novel contribution is the discussion about the uncertainty measure for BERT, where three different approaches are systematically compared with real problems. We investigated two uncertainty metrics, information entropy and variance of dropout sampling, in BERT, followed by mixed-integer programming to optimize decision thresholds. Another novel contribution is the usage of BERT as a language model in automatic spelling correction. Inputs with accidental spelling errors can significantly decrease intent classification performance. The proposed approach combines probabilities from masked language model and word edit distances to find the best corrections for misspelled words. The chatbot and the entire conversational AI system are developed using open-source tools and deployed within our company’s intranet. The proposed approach can be useful for industries seeking similar in-house solutions in their specific business domains. We share all our code and a sample chatbot built on a public data set on GitHub.
Feminist Postdigital Inquiry in the Ruins of Pandemic Universities

During Covid-19, higher education made an unprecedented entry into the domestic sphere. However, not all students welcomed the emergency delivery of online courses. Consequently, some learners have been developing resistant practices to technology-driven learning, including being on mute and turning off cameras, but these silences, gaps and evasions are difficult to grasp through normative perspectives. Meanwhile, big tech continues to profit significantly from its encroachment on pedagogy. Conversely, we need alternate conceptions of learners' varying responses to technologies. To develop a novel perspective, the study considers the Middle East's traditional mashrabiyya windows, which are carved through an elaborate wooden latticework screen of geometric patterns and designed to deflect rather than let in the light. This mashrabiyya structure is applied as a theoretical metaphor to consider Arab women learners' technological veiled affordances of filters, avatars and not replying. The mashrabiyya feminist postdigital framework develops unique inquiry into learners' subtle practices; the authors' self-reflexivity; and analysis of a (silent) email exchange and a Twitter avatar. Theorising suggests silences, invisibilities and disconnection are not necessarily a deficit but refractive responses enabling students and educators to stay below the radar.
A heterogeneous stacking ensemble based sentiment analysis framework using multiple word embeddings

Abstract Word embedding techniques have been proposed in the literature to analyze and determine the sentiments expressed in various textual documents such as social media posts, online product reviews, and so forth. However, it is difficult to capture the entire gamut of intricate inter‐dependencies among words in the textual documents using a specific word embedding technique. In this article, we aim to address this issue by proposing a computation‐efficient stacking ensemble based sentiment analysis framework using multiple word embeddings. The proposed framework uses a combination of three distinct word embeddings generated by three different state of the art word embedding techniques, namely, Word2Vec , GloVe , and BERT for performing the sentiment analysis task. It uses an explicitly trained Word2Vec model to generate the first set of 200‐dimensional word embedding. Similarly, pre‐trained GloVe and BERT models are used to generate the other two sets of 200‐dimensional and a 768‐dimensional word embeddings, respectively. These three distinct word embedding sets are then used to train a heterogeneous stacking ensemble based classifier model comprising LSTM , GRU , and Bi‐GRU based base‐level classifiers, and a LSTM based meta‐level classifier. Experimental results on four different datasets, namely, Sentiment140 , IMDB Review , Twitter conversation thread , and Twitter Emotion show that the proposed framework achieves high performance with low false positive rate. The proposed framework is also shown to outperform other sentiment analysis frameworks proposed in the literature.
Enabling cross-continent provider fairness in educational recommender systems

With the widespread diffusion of Massive Online Open Courses (MOOCs), educational recommender systems have become central tools to support students in their learning process. While most of the literature has focused on students and the learning opportunities that are offered to them, the teachers behind the recommended courses get a certain exposure when they appear in the final ranking. Underexposed teachers might have reduced opportunities to offer their services, so accounting for this perspective is of central importance to generate equity in the recommendation process. In this paper, we consider groups of teachers based on their geographic provenience and assess provider (un)fairness based on the continent they belong to. We consider measures of visibility and exposure, to account (i) in how many recommendations and (ii) wherein the ranking of the teachers belonging to different groups appear. We observe disparities that favor the most represented groups, and we overcome these phenomena with a re-ranking approach that provides each group with the expected visibility and exposure, thus controlling fairness of providers coming from different continents (cross-continent provider fairness). Experiments performed on data coming from a real-world MOOC platform show that our approach can provide fairness without affecting recommendation effectiveness.
Transfer Learning for Disruptive 5G-Enabled Industrial Internet of Things

Internet of things (IoT) and 5G network are fundamental building blocks for industrial IoT (IIoT). IoT has enabled real-time monitoring and actuation in industrial floors and machinery, aimed at improving the efficiency and safety of industrial activities and processes. On the other hand, 5G networks will provide ultra-reliable and low-latency communication for the wireless integration of autonomous industrial machinery, mobile vehicles, and robots, and management systems, aimed at the real-time control and management of industrial machinery toward smart factories. In IIoT, machine learning (ML) will also play a fundamental role in handling complex tasks at industrial machinery and 5G networks management, configuration, and control. However, ML suffers from the cold-start problem and needs a large amount of highly accurate data samples for model training, which is costly and difficult to obtain in IIoT applications. In this article, we shed light on the design of transfer learning (TL)-based systems for IIoT. We discuss how TL can overcome the demand for high-quality large data samples required to training ML models in IIoT. We also highlight the work principles and daunting challenges faced during the TL systems for IIoT. Furthermore, we categorize the TL systems for IIoT into TL for IIoT machinery level and for IIoT networking level and provide an in-depth discussion of the design building blocks and challenges of TL systems in each proposed class. Finally, we point out some future research directions for the design of novel TL-based systems for envisioned 5G-enabled IIoT applications.
Emojis and assertive environmental messages in social media campaigns

Purpose The authors aim to examine how emojis interact with assertiveness in social media posts to encourage social media engagement and cooperation in environmental campaigns. Design/methodology/approach Two experiments were used to test three hypotheses. Findings Study 1 shows that when assertive Twitter messages include the smiley-face emoji, study participants indicate stronger social media engagement and behavioral intentions to recycle used jeans. In Study 2, participants indicate stronger social media engagement and behavioral intentions to sign a petition for reducing plastic pollution when (non) assertive Facebook messages (do not) include emojis. Originality/value The current research advances our understanding about how emojis interact with assertive and nonassertive message tonality in environmental social media campaigns. This research also provides new insights showing that positive emotion is the psychological mechanism underlying matching effects of emoji and message assertiveness.
Studying the Impact of Initialization for Population-Based Algorithms with Low-Discrepancy Sequences

To solve different kinds of optimization challenges, meta-heuristic algorithms have been extensively used. Population initialization plays a prominent role in meta-heuristic algorithms for the problem of optimization. These algorithms can affect convergence to identify a robust optimum solution. To investigate the effectiveness of diversity, many scholars have a focus on the reliability and quality of meta-heuristic algorithms for enhancement. To initialize the population in the search space, this dissertation proposes three new low discrepancy sequences for population initialization instead of uniform distribution called the WELL sequence, Knuth sequence, and Torus sequence. This paper also introduces a detailed survey of the different initialization methods of PSO and DE based on quasi-random sequence families such as the Sobol sequence, Halton sequence, and uniform random distribution. For well-known benchmark test problems and learning of artificial neural network, the proposed methods for PSO (TO-PSO, KN-PSO, and WE-PSO), BA (BA-TO, BA-WE, and BA-KN), and DE (DE-TO, DE-WE, and DE-KN) have been evaluated. The synthesis of our strategies demonstrates promising success over uniform random numbers using low discrepancy sequences. The experimental findings indicate that the initialization based on low discrepancy sequences is exceptionally stronger than the uniform random number. Furthermore, our work outlines the profound effects on convergence and heterogeneity of the proposed methodology. It is expected that a comparative simulation survey of the low discrepancy sequence would be beneficial for the investigator to analyze the meta-heuristic algorithms in detail.
Optimization of a Sports Activity Development Model Using Artificial Intelligence under New Curriculum Reform

The recent curriculum reform in China puts forward higher requirements for the development of physical education. In order to further improve students’ physical quality and motor skills, the traditional model was improved to address the lack of accuracy in motion recognition and detection of physical condition so as to assist teachers to improve students’ physical quality. First, the physical education teaching activities required by the new curriculum reform were studied with regard to the actual needs of China’s current social, political, and economic development; next, the application of artificial intelligence technology to physical education teaching activities was proposed; and finally, deep learning technology was studied and a human movement recognition model based on a long short-term memory (LSTM) neural network was established to identify the movement state of students in physical education teaching activities. The designed model includes three components: data acquisition, data calculation, and data visualization. The functions of each layer were introduced; then, the intelligent wearable system was adopted to detect the status of students and a feedback system was established to assist teaching; and finally, the dataset was constructed to train and test the designed model. The experimental results demonstrate that the recognition accuracy and loss value of the training model meet the practical requirements; in the algorithm test, the motion recognition accuracy of the designed model for different subjects was greater than 97.5%. Compared with the traditional human motion recognition algorithm, the designed model had a better recognition effect. Hence, the designed model can meet the actual needs of physical education. This exploration provides a new perspective for promoting the intelligent development of physical education.
Salience-Guided Iterative Asymmetric Mutual Hashing for Fast Person Re-Identification

Person Re-identification (ReID) aims to retrieve the pedestrian with the same identity across different views. Existing studies mainly focus on improving accuracy, while ignoring their efficiency. Recently, several hash based methods have been proposed. Despite their improvement in efficiency, there still exists an unacceptable gap in accuracy between these methods and real-valued ones. Besides, few attempts have been made to simultaneously explicitly reduce redundancy and improve discrimination of hash codes, especially for short ones. Integrating Mutual learning may be a possible solution to reach this goal. However, it fails to utilize the complementary effect of teacher and student models. Additionally, it will degrade the performance of teacher models by treating two models equally. To address these issues, we propose a salience-guided iterative asymmetric mutual hashing (SIAMH) to achieve high-quality hash code generation and fast feature extraction. Specifically, a salience-guided self-distillation branch (SSB) is proposed to enable SIAMH to generate hash codes based on salience regions, thus explicitly reducing the redundancy between codes. Moreover, a novel iterative asymmetric mutual training strategy (IAMT) is proposed to alleviate drawbacks of common mutual learning, which can continuously refine the discriminative regions for SSB and extract regularized dark knowledge for two models as well. Extensive experiment results on five widely used datasets demonstrate the superiority of the proposed method in efficiency and accuracy when compared with existing state-of-the-art hashing and real-valued approaches. The code is released at https://github.com/Vill-Lab/SIAMH.
Lipschitz Continuity Guided Knowledge Distillation

Knowledge distillation has become one of the most important model compression techniques by distilling knowledge from larger teacher networks to smaller student ones. Although great success has been achieved by prior distillation methods via delicately designing various types of knowledge, they overlook the functional properties of neural networks, which makes the process of applying those techniques to new tasks unreliable and non-trivial. To alleviate such problem, in this paper, we initially leverage Lipschitz continuity to better represent the functional characteristic of neural networks and guide the knowledge distillation process. In particular, we propose a novel Lipschitz Continuity Guided Knowledge Distillation framework to faithfully distill knowledge by minimizing the distance between two neural networks’ Lipschitz constants, which enables teacher networks to better regularize student networks and improve the corresponding performance. We derive an explainable approximation algorithm with an explicit theoretical derivation to address the NP-hard problem of calculating the Lipschitz constant. Experimental results have shown that our method outperforms other benchmarks over several knowledge distillation tasks (e.g., classification, segmentation and object detection) on CIFAR-100, ImageNet, and PASCAL VOC datasets. Our code is available at https://github.com/42Shawn/LONDON/tree/master.
A DAG Blockchain-Enhanced User-Autonomy Spectrum Sharing Framework for 6G-Enabled IoT

The rapidly growing number of Internet-of-Things (IoT) devices poses new challenges for spectrum management in future wireless communication networks. It is critical to achieve efficient and dynamic spectrum management in the sixth-generation (6G) wireless communication networks era. To tackle the challenges of managing a large-scale IoT network with heterogeneous devices, we propose a directed acyclic graph (DAG) blockchain-enhanced user-autonomy spectrum sharing model. As the proposed consensus rule is closely related to system utility, the swarm intelligence of users gradually reaches the point of convergence in the process of blockchain consensus. We analyze the effect of the tip selection method of the DAG blockchain on spectrum allocation utility. A dynamic tip selection method is proposed to enhance the global utility, which is related to the spectrum supply–demand. In addition, the ring signature technique is utilized to realize privacy protection during the sharing process. Simulation indicates that the proposed tip selection method achieves a 10% enhancement in terms of the global utility. Furthermore, significant reductions in administrative expense and reliability improvement are demonstrated by simulation results. The stability of the tip number in the proposed model has been proved theoretically, which is also validated by simulation experiments.
Blockchain Based Enhanced ERP Transaction Integrity Architecture and PoET Consensus

Enterprise Resource Planning (ERP) software is extensively used for the management of business processes. ERP offers a system of integrated applications with a shared central database. Storing all business-critical information in a central place raises various issues such as data integrity assurance and a single point of failure, which makes the database vulnerable. This paper investigates database and Blockchain integration, where the Blockchain network works in synchronization with the database system, and offers a mechanism to validate the transactions and ensure data integrity. Limited research exists on Blockchain-based solutions for the single point of failure in ERP. We established in our study that for concurrent access control and monitoring of ERP, private permissioned Blockchain using Proof of Elapsed Time consensus is more suitable. The study also investigated the bottleneck issue of transaction processing rates (TPR) of Blockchain consensus, specifically ERP's TPR. The paper presents system architecture that integrates Blockchain with an ERP system using an application interface.