nils-herrmann/clean_scirepeval huggingface dataset:
Transfer Learning via Inter-Task Mappings for Temporal Difference Learning

Temporal difference (TD) learning (Sutton and Barto, 1998) has become a popular reinforcement learning technique in recent years. TD methods, relying on function approximators to generalize learning to novel situations, have had some experimental successes and have been shown to exhibit some desirable properties in theory, but the most basic algorithms have often been found slow in practice. This empirical result has motivated the development of many methods that speed up reinforcement learning by modifying a task for the learner or helping the learner better generalize to novel situations. This article focuses on generalizing across tasks, thereby speeding up learning, via a novel form of transfer using handcoded task relationships. We compare learning on a complex task with three function approximators, a cerebellar model arithmetic computer (CMAC), an artificial neural network (ANN), and a radial basis function (RBF), and empirically demonstrate that directly transferring the action-value function can lead to a dramatic speedup in learning with all three. Using transfer via inter-task mapping (TVITM), agents are able to learn one task and then markedly reduce the time it takes to learn a more complex task. Our algorithms are fully implemented and tested in the RoboCup soccer Keepaway domain. This article contains and extends material published in two conference papers (Taylor and Stone, 2005; Taylor et al., 2005).
Analysis of three-level buck-boost converter operation for improved renewable energy conversion and smart grid integration

The increased smart grid integration of renewable energy sources demands high power handling and wide controllability for the enabling power conversion technologies. The conventional energy conversion techniques are inadequate to efficiently handle the highly varying nature of renewable energy sources like wave, solar, tidal and wind. The present work examines the advantages of using a three-level buck-boost DC-DC converter to aid three-level neutral-point-clamped inverter based grid integration. There are two main reasons for using this converter. It can provide the conventional buck-boost capability at higher power levels for absorbing and conditioning the renewable source output. Besides, it can be used as a voltage balancing device to satisfy the input requirement for the three-level neutral-point-clamped inverter. The work includes complete operating range analysis of the converter for the combined buck-boost action and voltage balancing effects to understand its suitability for various applications. The converter switching modes of operation are also presented in detail along with essential example waveforms. The final results show good controllability bandwidth for the converter which makes it an attractive solution for smart grid integration of renewable energy sources.
Collocation least-squares polynomial chaos method

The polynomial chaos (PC) method has been used in many engineering applications to replace the traditional Monte Carlo (MC) approach for uncertainty quantification (UQ) due to its better convergence properties. Many researchers seek to further improve the efficiency of PC, especially in higher dimensional space with more uncertainties. The intrusive PC Galerkin approach requires the modification of the deterministic system, which leads to a stochastic system with a much bigger size. The non-intrusive collocation approach imposes the system to be satisfied at a set of collocation points to form and solve the linear system equations. Compared with the intrusive approach, the collocation method is easy to implement, however, choosing an optimal set of the collocation points is still an open problem. In this paper, we first propose using the low-discrepancy Hammersley/Halton dataset and Smolyak datasets as the collocation points, then propose a least-squares (LS) collocation approach to use more collocation points than the required minimum to solve for the system coefficients. We prove that the PC coefficients computed with the collocation LS approach converges to the optimal coefficients. The numerical tests on a simple 2-dimensional problem show that PC collocation LS results using the Hammersley/Halton points approach to optimal result.
Open-Domain Non-factoid Question Answering

We present an end-to-end system for open-domain non-factoid question answering. We leverage the information on the ever-growing World Wide Web, and the capabilities of modern search engines to find the relevant information. Our QA system is composed of three components: (i) query formulation module (QFM) (ii) candidate answer generation module (CAGM) and (iii) answer selection module (ASM). A thorough empirical evaluation using two datasets demonstrates that the proposed approach is highly competitive.
Relationship between smartphone addiction and physical activity in Chinese international students in Korea

Excessive usage of smartphones may induce social problems, such as depression and impairment of social and emotional functioning. Moreover, its usage can impede physical activity, but the relationship between smartphone addiction and physical activity is obscure. Therefore, we examined the relationship and the impact of excessive smartphone use on physical activity.



This study collected data through the structured questionnaire consisting of general characteristics, the number and hours of smartphone usage, and the Smartphone Addiction Proneness Scale (SAPS) from 110 Chinese international students in Korea. The body composition and physical activity, such as the total daily number of steps and consumed calories, were measured.



In this study, high-risk smartphone users showed less physical activity, such as the total number of steps taken and the average consumed calories per day. Moreover, their body composition, such as muscle mass and fat mass, was significantly different. Among these factors, the hours of smartphone use revealed the proportional relationship with smartphone addiction (β = 0.209, p = 0.026), while the average number of walking steps per day showed a significant reverse proportional tendency in participants with smartphone addiction (β = -0.883, p < 0.001).



Participants with smartphone addiction were less likely to walk for each day. Namely, smartphone addiction may negatively influence physical health by reducing the amount of physical activity, such as walking, resulting in an increase of fat mass and a decrease of muscle mass associated with adverse health consequences.
Model-Based Probabilistic Collision Detection in Autonomous Driving

The safety of the planned paths of autonomous cars with respect to the movement of other traffic participants is considered. Therefore, the stochastic occupancy of the road by other vehicles is predicted. The prediction considers uncertainties originating from the measurements and the possible behaviors of other traffic participants. In addition, the interaction of traffic participants, as well as the limitation of driving maneuvers due to the road geometry, is considered. The result of the presented approach is the probability of a crash for a specific trajectory of the autonomous car. The presented approach is efficient as most of the intensive computations are performed offline, which results in a lean online algorithm for real-time application.
Learning Deep Features for DNA Methylation Data Analysis

Many studies demonstrated that the DNA methylation, which occurs in the context of a CpG, has strong correlation with diseases, including cancer. There is a strong interest in analyzing the DNA methylation data to find how to distinguish different subtypes of the tumor. However, the conventional statistical methods are not suitable for analyzing the highly dimensional DNA methylation data with bounded support. In order to explicitly capture the properties of the data, we design a deep neural network, which composes of several stacked binary restricted Boltzmann machines, to learn the low-dimensional deep features of the DNA methylation data. Experimental results show that these features perform best in breast cancer DNA methylation data cluster analysis, compared with some state-of-the-art methods.
Unobstrusive heart rate and respiratory rate monitor embedded on a wheelchair

A biomedical system embedded on a wheelchair able to measure heart rate, respiratory rate, and the wheelchair motion state is presented. A wireless multi-channel acquisition module is connected to a BCG (ballistocardiography) unit and to an inertial 3-axial MEMS accelerometer based unit. The sensing units are embedded on the seat and backrest of the wheelchair and the acquired data is transmitted through Wi-Fi connection to a remote processing unit expressed by a laptop PC. Considering the different motion situations of the wheelchair when utilized by the user, an important part of the work was focused on BCG noise and artifacts removal as well as to heart rate and respiratory rate accurate estimation from BCG signal using wavelet based filtering and ICA (Independent Component Analysis) algorithms. Experimental results for different scenarios of wheelchair utilization are included in the paper.
Stacked fully convolutional networks with multi-channel learning: application to medical image segmentation

The automated segmentation of regions of interest (ROIs) in medical imaging is the fundamental requirement for the derivation of high-level semantics for image analysis in clinical decision support systems. Traditional segmentation approaches such as region-based depend heavily upon hand-crafted features and a priori knowledge of the user. As such, these methods are difficult to adopt within a clinical environment. Recently, methods based on fully convolutional networks (FCN) have achieved great success in the segmentation of general images. FCNs leverage a large labeled dataset to hierarchically learn the features that best correspond to the shallow appearance as well as the deep semantics of the images. However, when applied to medical images, FCNs usually produce coarse ROI detection and poor boundary definitions primarily due to the limited number of labeled training data and limited constraints of label agreement among neighboring similar pixels. In this paper, we propose a new stacked FCN architecture with multi-channel learning (SFCN-ML). We embed the FCN in a stacked architecture to learn the foreground ROI features and background non-ROI features separately and then integrate these different channels to produce the final segmentation result. In contrast to traditional FCN methods, our SFCN-ML architecture enables the visual attributes and semantics derived from both the fore- and background channels to be iteratively learned and inferred. We conducted extensive experiments on three public datasets with a variety of visual challenges. Our results show that our SFCN-ML is more effective and robust than a routine FCN and its variants, and other state-of-the-art methods.
Toward an integrated knowledge discovery and data mining process model

Enterprise decision making is continuously transforming in the wake of ever increasing amounts of data. Organizations are collecting massive amounts of data in their quest for knowledge nuggets in form of novel, interesting, understandable patterns that underlie these data. The search for knowledge is a multi-step process comprising of various phases including development of domain (business) understanding, data understanding, data preparation, modeling, evaluation and ultimately, the deployment of the discovered knowledge. These phases are represented in form of Knowledge Discovery and Data Mining (KDDM) Process Models that are meant to provide explicit support towards execution of the complex and iterative knowledge discovery process. Review of existing KDDM process models reveals that they have certain limitations (fragmented design, only a checklist-type description of tasks, lack of support towards execution of tasks, especially those of the business understanding phase etc) which are likely to affect the efficiency and effectiveness with which KDDM projects are currently carried out. This dissertation addresses the various identified limitations of existing KDDM process models through an improved model (named the Integrated Knowledge Discovery and Data Mining Process Model) which presents an integrated view of the KDDM process and provides explicit support towards execution of each one of the tasks outlined in the model. We also evaluate the effectiveness and efficiency offered by the IKDDM model against CRISP-DM, a leading KDDM process model, in aiding data mining users to execute various tasks of the KDDM process. Results of statistical tests
Cache'n DASH: Efficient Caching for DASH

HTTP-based video streaming services have been dominating the global IP traffic over the last few years. Caching of video content reduces the load on the content servers. In the case of Dynamic Adaptive Streaming over HTTP (DASH), for every video the server needs to host multiple representations of the same video file. These individual representations are further broken down into smaller segments. Hence, for each video the server needs to host thousands of segments out of which, the client downloads a subset of the segments. Also, depending on the network conditions, the adaptation scheme used at the client-end might request a different set of video segments (varying in bitrate) for the same video. The caching of DASH videos presents unique challenges. In order to optimize the cache hits and minimize the misses for DASH video streaming services we propose an Adaptation Aware Cache (AAC) framework to determine the segments that are to be prefetched and retained in the cache. In the current scheme, we use bandwidth estimates at the cache server and the knowledge of the rate adaptation scheme used by the client to estimate the next segment requests, thus improving the prefetching at the cache.
Oriented Response Networks

Deep Convolution Neural Networks (DCNNs) are capable of learning unprecedentedly effective image representations. However, their ability in handling significant local and global image rotations remains limited. In this paper, we propose Active Rotating Filters (ARFs) that actively rotate during convolution and produce feature maps with location and orientation explicitly encoded. An ARF acts as a virtual filter bank containing the filter itself and its multiple unmaterialised rotated versions. During back-propagation, an ARF is collectively updated using errors from all its rotated versions. DCNNs using ARFs, referred to as Oriented Response Networks (ORNs), can produce within-class rotation-invariant deep features while maintaining inter-class discrimination for classification tasks. The oriented response produced by ORNs can also be used for image and object orientation estimation tasks. Over multiple state-of-the-art DCNN architectures, such as VGG, ResNet, and STN, we consistently observe that replacing regular filters with the proposed ARFs leads to significant reduction in the number of network parameters and improvement in classification performance. We report the best results on several commonly used benchmarks.
Self-Compassion : An Alternative Conceptualization of a HealthyAttitudeToward Oneself

This article defines and examines the construct of self-compassion. Self-compassion entails three main components: (a) self-kindness—being kind and understanding toward oneself in instances of pain or failure rather than being harshly self-critical, (b) common humanity—perceiving one’s experiences as part of the larger human experience rather than seeing them as separating and isolating, and (c) mindfulness—holding painful thoughts and feelings in balanced awareness rather than over-identifying with them. Self-compassion is an emotionally positive selfattitude that should protect against the negative consequences of self-judgment, isolation, and rumination (such as depression). Because of its non-evaluative and interconnected nature, it should also counter the tendencies towards narcissism, selfcenteredness, and downward social comparison that have been associated with attempts to maintain self-esteem. The relation of self-compassion to other psychological constructs is examined, its links to psychological functioning are explored, and potential group differences in self-compassion are discussed.
Memory forensics: The path forward

Traditionally, digital forensics focused on artifacts located on the storage devices of computer systems, mobile phones, digital cameras, and other electronic devices. In the past decade, however, researchers have created a number of powerful memory forensics tools that expand the scope of digital forensics to include the examination of volatile memory as well. While memory forensic techniques have evolved from simple string searches to deep, structured analysis of application and kernel data structures for a number of platforms and operating systems, much research remains to be done. This paper surveys the state-of-the-art in memory forensics, provide critical analysis of current-generation techniques, describe important changes in operating systems design that impact memory forensics, and sketches important areas for further research.
Brand Name Logo Recognition of Fast Food and Healthy Food among Children

The fast food industry has been increasingly criticized for creating brand loyalty in young consumers. Food marketers are well versed in reaching children and youth given the importance of brand loyalty on future food purchasing behavior. In addition, food marketers are increasingly targeting the Hispanic population given their growing spending power. The fast food industry is among the leaders in reaching youth and ethnic minorities through their marketing efforts. The primary objective of this study was to determine if young children recognized fast food restaurant logos at a higher rate than other food brands.  Children (n = 155; 53% male; 87% Hispanic) ages 4–8 years were recruited from elementary schools and asked to match 10 logo cards to products depicted on a game board. Parents completed a survey assessing demographic and psychosocial characteristics associated with a healthy lifestyle in the home.  Older children and children who were overweight were significantly more likely to recognize fast food restaurant logos than other food logos. Moreover, parents’ psychosocial and socio-demographic characteristics were associated with the type of food logo recognized by the children.  Children’s high recognition of fast food restaurant logos may reflect greater exposure to fast food advertisements. Families’ socio-demographic characteristics play a role in children’s recognition of food logos.
Using Argument Mining to Assess the Argumentation Quality of Essays

Argument mining aims to determine the argumentative structure of texts. Although it is said to be crucial for future applications such as writing support systems, the benefit of its output has rarely been evaluated. This paper puts the analysis of the output into the focus. In particular, we investigate to what extent the mined structure can be leveraged to assess the argumentation quality of persuasive essays. We find insightful statistical patterns in the structure of essays. From these, we derive novel features that we evaluate in four argumentation-related essay scoring tasks. Our results reveal the benefit of argument mining for assessing argumentation quality. Among others, we improve the state of the art in scoring an essay’s organization and its argument strength.
The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses

In the quest for cognitive computing, we have built a massively parallel cortical simulator, C2, that incorporates a number of innovations in computation, memory, and communication. Using C2 on LLNL's Dawn Blue Gene/P supercomputer with 147, 456 CPUs and 144 TB of main memory, we report two cortical simulations -- at unprecedented scale -- that effectively saturate the entire memory capacity and refresh it at least every simulated second. The first simulation consists of 1.6 billion neurons and 8.87 trillion synapses with experimentally-measured gray matter thalamocortical connectivity. The second simulation has 900 million neurons and 9 trillion synapses with probabilistic connectivity. We demonstrate nearly perfect weak scaling and attractive strong scaling. The simulations, which incorporate phenomenological spiking neurons, individual learning synapses, axonal delays, and dynamic synaptic channels, exceed the scale of the cat cortex, marking the dawn of a new era in the scale of cortical simulations.
Arduino-based smart irrigation using water flow sensor, soil moisture sensor, temperature sensor and ESP8266 WiFi module

Emergence of Controlled Environment Agriculture (CEA) ranging from computer controlled water irrigation system to lightning and ventilation has changed the conventional scenario of farming. This paper proposes and demonstrate an economical and easy to use arduino based controlled irrigation system. The designed system deals with various environmental factors such as moisture, temperature and amount of water required by the crops using sensors like water flow sensor, temperature sensor and soil moisture sensor. Datas are collected and received by arduino which can be linked to an interactive website which show the real time values along with the standard values of different factor required by a crop. This allows user to control irrigation pumps and sprinklers from far distance through a website and to meet the standard values which would help the farmer to yield maximum and quality crops. Studies conducted on laboratory prototype suggested the designed system to be applicable which can be implemented.
Combining CPU and GPU architectures for fast similarity search

The Signature Quadratic Form Distance on feature signatures represents a flexible distance-based similarity model for effective content-based multimedia retrieval. Although metric indexing approaches are able to speed up query processing by two orders of magnitude, their applicability to large-scale multimedia databases containing billions of images is still a challenging issue. In this paper, we propose a parallel approach that balances the utilization of CPU and many-core GPUs for efficient similarity search with the Signature Quadratic Form Distance. In particular, we show how to process multiple distance computations and other parts of the search procedure in parallel, achieving maximal performance of the combined CPU/GPU system. The experimental evaluation demonstrates that our approach implemented on a common workstation with 2 GPU cards outperforms traditional parallel implementation on a high-end 48-core NUMA server in terms of efficiency almost by an order of magnitude. If we consider also the price of the high-end server that is ten times higher than that of the GPU workstation then, based on price/performance ratio, the GPU-based similarity search beats the CPU-based solution by almost two orders of magnitude. Although proposed for the SQFD, our approach of fast GPU-based similarity search is applicable for any distance function that is efficiently parallelizable in the SIMT execution model.
Efficient online recommendation via low-rank ensemble sampling

The low-rank structure is one of the most prominent features in modern recommendation problems. In this paper, we consider an online learning problem with a low-rank expected reward matrix where both row features and column features are unknown a priori, and the agent aims to learn to choose the best row-column pair (i.e. the maximum entry) in the matrix. We develop a novel online recommendation algorithm based on ensemble sampling, a recently developed computationally efficient approximation of Thompson sampling. Our computational results show that our algorithm consistently achieves order-of-magnitude improvements over the baselines in both synthetic and real-world experiments.