Reviewerly/exHarmony huggingface dataset:
CaSE: Explaining Text Classifications by Fusion of Local Surrogate Explanation Models with Contextual and Semantic Knowledge

Generating explanations within a local and model-agnostic explanation scenario for text classification is often accompanied by a local approximation task. In order to create a local neighborhood for a document, whose classification shall be explained, sampling techniques are used that most often treat the according features at least semantically independent from each other. Hence, contextual as well as semantic information is lost and therefore cannot be used to update a human’s mental model within the according explanation task. In case of dependent features, such explanation techniques are prone to extrapolation to feature areas with low data density, therefore causing misleading interpretations. Additionally, the ”the whole is greater than the sum of its parts” phenomenon is disregarded when using explanations that treat the according words independently from each other. In this paper, an architecture named CaSE is proposed that either uses Semantic Feature Arrangements or Semantic Interrogations to overcome these drawbacks. Combined with a modified version of Local interpretable model-agnostic explanations (LIME), a state of the art local explanation framework, it is capable of generating meaningful and coherent explanations. The approach utilizes contextual and semantic knowledge from unsupervised topic models in order to enable realistic and semantic sampling and based on that generate understandable explanations for any text classifier. The key concepts of CaSE that are deemed essential for providing humans with high quality explanations are derived from findings of psychology. In a nutshell, CaSE shall enable Semantic Alignment between humans and machines and thus further improve the basis for Interactive Machine Learning. An extensive experimental validation of CaSE is conducted, showing its effectiveness by generating reliable and meaningful explanations whose elements are made of contextually coherent words and therefore are suitable to update human mental models in an appropriate way. In the course of a quantitative analysis, the proposed architecture is evaluated w.r.t. a consistency property and to Local Fidelity of the resulting explanation models. According to that, CaSE generates more realistic explanation models leading to higher Local Fidelity compared to LIME.
Hierarchical architectures in reservoir computing systems

Abstract Reservoir computing (RC) offers efficient temporal data processing with a low training cost by separating recurrent neural networks into a fixed network with recurrent connections and a trainable linear network. The quality of the fixed network, called reservoir, is the most important factor that determines the performance of the RC system. In this paper, we investigate the influence of the hierarchical reservoir structure on the properties of the reservoir and the performance of the RC system. Analogous to deep neural networks, stacking sub-reservoirs in series is an efficient way to enhance the nonlinearity of data transformation to high-dimensional space and expand the diversity of temporal information captured by the reservoir. These deep reservoir systems offer better performance when compared to simply increasing the size of the reservoir or the number of sub-reservoirs. Low frequency components are mainly captured by the sub-reservoirs in later stage of the deep reservoir structure, similar to observations that more abstract information can be extracted by layers in the late stage of deep neural networks. When the total size of the reservoir is fixed, tradeoff between the number of sub-reservoirs and the size of each sub-reservoir needs to be carefully considered, due to the degraded ability of individual sub-reservoirs at small sizes. Improved performance of the deep reservoir structure alleviates the difficulty of implementing the RC system on hardware systems.
Model-Driven Deep Learning Method for Pancreatic Cancer Segmentation Based on Spiral-Transformation

Pancreatic cancer is a lethal malignant tumor with one of the worst prognoses. Accurate segmentation of pancreatic cancer is vital in clinical diagnosis and treatment. Due to the unclear boundary and small size of cancers, it is challenging to both manually annotate and automatically segment cancers. Considering 3D information utilization and small sample sizes, we propose a model-driven deep learning method for pancreatic cancer segmentation based on spiral transformation. Specifically, a spiral-transformation algorithm with uniform sampling was developed to map 3D images onto 2D planes while preserving the spatial relationship between textures, thus addressing the challenge in effectively applying 3D contextual information in a 2D model. This study is the first to introduce spiral transformation in a segmentation task to provide effective data augmentation, alleviating the issue of small sample size. Moreover, a transformation-weight-corrected module was embedded into the deep learning model to unify the entire framework. It can achieve 2D segmentation and corresponding 3D rebuilding constraint to overcome non-unique 3D rebuilding results due to the uniform and dense sampling. A smooth regularization based on rebuilding prior knowledge was also designed to optimize segmentation results. The extensive experiments showed that the proposed method achieved a promising segmentation performance on multi-parametric MRIs, where T2, T1, ADC, DWI images obtained the DSC of 65.6%, 64.0%, 64.5%, 65.3%, respectively. This method can provide a novel paradigm to efficiently apply 3D information and augment sample sizes in the development of artificial intelligence for cancer segmentation. Our source codes will be released at https://github.com/SJTUBME-QianLab/ Spiral-Segmentation.
Channel Effects on Surrogate Models of Adversarial Attacks against Wireless Signal Classifiers

We consider a wireless communication system that consists of a background emitter, a transmitter, and an adversary. The transmitter is equipped with a deep neural network (DNN) classifier for detecting the ongoing transmissions from the background emitter and transmits a signal if the spectrum is idle. Concurrently, the adversary trains its own DNN classifier as the surrogate model by observing the spectrum to detect the ongoing transmissions of the background emitter and generate adversarial attacks to fool the transmitter into misclassifying the channel as idle. This surrogate model may differ from the transmitter’s classifier significantly because the adversary and the transmitter experience different channels from the background emitter and therefore their classifiers are trained with different distributions of inputs. This system model may represent a setting where the background emitter is a primary user, the transmitter is a secondary user, and the adversary is trying to fool the secondary user to transmit even though the channel is occupied by the primary user. We consider different topologies to investigate how different surrogate models that are trained by the adversary (depending on the differences in channel effects experienced by the adversary) affect the performance of the adversarial attack. The simulation results show that the surrogate models that are trained with different distributions of channel-induced inputs severely limit the attack performance and indicate that the transferability of adversarial attacks is neither readily available nor straightforward to achieve since surrogate models for wireless applications may significantly differ from the target model depending on channel effects.
A comparative analysis on question classification task based on deep learning approaches

Question classification is one of the essential tasks for automatic question answering implementation in natural language processing (NLP). Recently, there have been several text-mining issues such as text classification, document categorization, web mining, sentiment analysis, and spam filtering that have been successfully achieved by deep learning approaches. In this study, we illustrated and investigated our work on certain deep learning approaches for question classification tasks in an extremely inflected Turkish language. In this study, we trained and tested the deep learning architectures on the questions dataset in Turkish. In addition to this, we used three main deep learning approaches (Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN)) and we also applied two different deep learning combinations of CNN-GRU and CNN-LSTM architectures. Furthermore, we applied the Word2vec technique with both skip-gram and CBOW methods for word embedding with various vector sizes on a large corpus composed of user questions. By comparing analysis, we conducted an experiment on deep learning architectures based on test and 10-cross fold validation accuracy. Experiment results were obtained to illustrate the effectiveness of various Word2vec techniques that have a considerable impact on the accuracy rate using different deep learning approaches. We attained an accuracy of 93.7% by using these techniques on the question dataset.
Coverless Information Hiding Based on Probability Graph Learning for Secure Communication in IoT Environment

To securely transmit secret data between Internet of Things (IoT) nodes, it is required to the implement information hiding technique for secure communication in the IoT environment. The traditional information hiding approaches generally select a multimedia file, such as texts, images, and video clips as the cover, and then embed secret information into the cover by slight modification. However, it is not feasible to directly apply these approaches in the IoT environment for the following reasons. First, it is hard for some IoT nodes to effectively and efficiently process and transmit the complex multimedia data. Second, the modification trace left in the cover will cause the presence of hidden secret information to be easily exposed by steganalysis tools. To address the above issues, we propose a coverless information hiding scheme based on probability graph learning for secure communication in the IoT environment. Instead of modifying an existing multimedia cover, we conceal secret information in a generated sequence of IoT data to realize secure communication between different nodes in the IoT environment. According to the node-data interaction relationships, we first learn the transition probability graph (TPG) to describe the transition probabilities between IoT data elements. Then, guided by a given secret message that needs to be hidden, we sequentially select a set of highly correlated data elements from the TPG to generate the sequence. The experimental results and theoretical analysis demonstrate that the proposed information hiding scheme can achieve high hiding capacity with desirable imperceptibility and security performances in the IoT environment.
Securing VANET Using Blockchain Technology

Abstract VANET permits communication from V2V or in this specific communication which is generated by the vehicle. Because of this to a broad range of technologies and facilities, like protection for travelers, improved traffic capacity, and infotainment, It’s has been closely researched. In this paper, we implement the algorithm for security while rewarded will be added to the client. we also analyze the VANET through the blockchain technologies and IOV with blockchain. IOV has improved traffic safety. A period now is ripening for paving the way for a new wave of autonomous cars with modern technologies and creative protection initiatives by integrating smart cars on the Internet of Vehicles (IoV).
Natural language processing for the assessment of cardiovascular disease comorbidities: The <scp>cardio‐Canary</scp> comorbidity project

Accurate ascertainment of comorbidities is paramount in clinical research. While manual adjudication is labor-intensive and expensive, the adoption of electronic health records enables computational analysis of free-text documentation using natural language processing (NLP) tools.We sought to develop highly accurate NLP modules to assess for the presence of five key cardiovascular comorbidities in a large electronic health record system.One-thousand clinical notes were randomly selected from a cardiovascular registry at Mass General Brigham. Trained physicians manually adjudicated these notes for the following five diagnostic comorbidities: hypertension, dyslipidemia, diabetes, coronary artery disease, and stroke/transient ischemic attack. Using the open-source Canary NLP system, five separate NLP modules were designed based on 800 "training-set" notes and validated on 200 "test-set" notes.Across the five NLP modules, the sentence-level and note-level sensitivity, specificity, and positive predictive value was always greater than 85% and was most often greater than 90%. Accuracy tended to be highest for conditions with greater diagnostic clarity (e.g. diabetes and hypertension) and slightly lower for conditions whose greater diagnostic challenges (e.g. myocardial infarction and embolic stroke) may lead to less definitive documentation.We designed five open-source and highly accurate NLP modules that can be used to assess for the presence of important cardiovascular comorbidities in free-text health records. These modules have been placed in the public domain and can be used for clinical research, trial recruitment and population management at any institution as well as serve as the basis for further development of cardiovascular NLP tools.
A Robust Breast ultrasound segmentation method under noisy annotations

Background and Objective: A large-scale training data and accurate annotations are fundamental for current segmentation networks. However, the characteristic artifacts of ultrasound images always make the annotation task complicated, such as attenuation, speckle, shadows and signal dropout. Further complications arise as the contrast between the region of interest and background is often low. Without double-check from professionals, it is hard to guarantee that there is no noisy annotation in segmentation datasets. However, among the deep learning methods applied to ultrasound segmentation so far, no one can solve this problem.Method: Given a dataset with poorly labeled masks, including a certain amount of noises, we propose an end-to-end noisy annotation tolerance network (NAT-Net). NAT-Net can detect noise by the proposed noise index (NI) and dynamically correct noisy annotations in the training stage. Simultaneously, noise index is used to correct the noise along with the output of the learning model. This method does not need any auxiliary clean datasets or prior knowledge of noise distributions, so it is more general, robust and easier to apply than the existing methods. Results: NAT-Net outperforms previous state-of-the-art methods on synthesized data with different noise ratio. For real-world dataset with more complex noise types, the IoU of NAT-Net is higher than that of state-of-art approaches by nearly 6%. Experimental results show that our method can also achieve good results compared with the existing methods for clean dataset. Conclusion: The NAT-Net reduces manual interaction of data annotation, reduces dependence on medical personnel. After tumor segmentation, disease diagnosis efficiency is improved, which provides an auxiliary strategies for subsequent medical diagnosis systems based on ultrasound.
Sponge based Lightweight Cryptographic Hash Functions for IoT Applications

Hash constructions are used in cryptographic algorithms from very long. Features of Hashes that gives the applications the confidence to use them in security methodologies is “forward secrecy” Forward secrecy comes from one-way hash functions. Examples of earlier hash designs include SHA-3, MD-5, SHA-I, and MAME. Each of these is having their proven record to produce the security for the communication between unconstrained devices. However, this is the era of Internet of Things (IoT) and the requirement of lightweight hash designs are the need of hour. IoT mainly consists of constrained devices. The devices in IoT are having many constrained related to battery power, storage and transmission range. Enabling any security feature in the constrained devices is troublesome. Constrained devices under an IoT environment can work only with less complex and lightweight algorithms. Lightweight algorithms take less power to operate and save a lot of energy of the battery operated devices. SPONGENT, QUARK, HASH-ONE, PHOTON, are some of the well-known lightweight hash designs currently providing security to the IoT devices. In this paper, the authors will present an analysis of the functioning of different lightweight hash designs as well as their suitability to the IoT environment.
Robust penalized extreme learning machine regression with applications in wind speed forecasting

In extreme learning machine (ELM) framework, the hidden layer setting determines its generalization ability; and in presence of outliers in the training set, weights between hidden layer and output layer based on the least squares would be overly estimated. To address these two problems in ELM implementation, we extend robust penalized statistical framework in ELM and propose a general robust penalized ELM, which consists of two components (robust loss function and regularization item), for regression to improve the efficiency of ELM training with more elegant neural network structure resulting in more accurate predictions. We investigate six different loss functions ( $$l_1$$ -norm loss, $$l_2$$ -norm loss, Huber loss, Bisquare loss, exponential squared loss and Lncosh loss) and two regularization strategies (lasso penalty and ridge penalty). Furthermore, we present two training procedures for our robust penalized ELM via iterative reweighted least squares method with hyper-parameter setting by cross-validation with lasso penalty and ridge penalty, respectively. Finally, the proposed robust penalized ELM is employed in an ultra-short-term wind speed forecasting study, and our framework is confirmed in this specific application producing more effective predictions according to the multi-step forecasting performance.
An Ontological-Based Model to Data Governance for Big Data

Nowadays, companies and official bodies are using the data as a principal asset to take strategic decisions.The advances in big data processing, storage and analysis techniques have allowed to manage the continuous increase in the volume of data.This increase in the volume of data together with its high variability and the large number of sources lead to a constant growing of the complexity of the data management environment.Data governance is the key for simplifying that complexity: it is the element that controls the decision making and responsibilities for all the processes related to data management.This paper discusses an approach to data governance based on ontological reasoning to reduce data management complexity.The proposed data governance system is built over an autonomous system based on distributed components.It implements semantic techniques and automatic ontology-based reasoning.The different components use a Shared Knowledge Plane to interact.Its fundamental piece is an ontology that represents all the data management processes included in data governance.A prototype of such a system has been implemented and tested for Telefonica's global video service.The results obtained show the feasibility of using this type of technology to reduce the complexity of managing big data environments.
Examining changes in teachers’ perceptions of external and internal barriers in their integration of educational digital resources in K-12 classrooms

This study examined changes in teachers' perceptions of external barriers, internal barriers, and their integration of digital educational resources across two years through variable-centered and person-centered approaches. Participants included 301 in-service middle and high school teachers from 18 schools in the United States. The results of variable-centered approaches showed some significant changes in external barriers and teacher behavior but not in internal barriers. However, person-centered approaches revealed that perceived changes in external barriers significantly predicted nuanced changes in the patterns of teachers' educational digital resource integration and their beliefs about technology. As teachers perceived a stronger technology vision and commitment to professional development in their school environments, their personal practices and beliefs shifted together.
Security enhancement technologies for smart contracts in the blockchain: A survey

Abstract Smart contract has shown its potential in cutting down the cost of administration through reshaping conventional business processes and in expanding the application of blockchain to areas that are beyond the cryptocurrency. However, with the rapid development and wide application of smart contracts, security issues have become a serious concern and have thus attracted widespread attention. As the result, a great deal of effort has been spent on improving and supporting secure development and on the application of smart contracts by introducing new and advanced vulnerability detection and privacy protection techniques in recent years. There is therefore the need for a comprehensive review of the new development on security enhancement technologies of smart contracts for the blockchain. This paper provides a review of the current research status and advances in smart contract security based on related literature published in recent years. Our review is divided into six categories along the line of the technology, which includes symbolic execution, abstract interpretation, fuzz testing, formal verification, deep learning, and privacy enhancement. A comparison of the various tools and methods developed to tackle security issues is provided. Challenges in the research of smart contract security as well as future directions are discussed. This paper intends to provide the inspiration and reference for follow‐up research on the security issues of smart contracts in the blockchain.