SoroushVahidi/scidocs huggingface dataset:
Data-Efficient Hierarchical Reinforcement Learning
(2018)

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and on-policy training, making them difficult to apply in real-world scenarios. In this paper, we study how we can develop HRL algorithms that are general, in that they do not make onerous additional assumptions beyond standard RL algorithms, and efficient, in the sense that they can be used with modest numbers of interaction samples, making them suitable for real-world problems such as robotic control. For generality, we develop a scheme where lower-level controllers are supervised with goals that are learned and proposed automatically by the higher-level controllers. To address efficiency, we propose to use off-policy experience for both higherand lower-level training. This poses a considerable challenge, since changes to the lower-level behaviors change the action space for the higher-level policy, and we introduce an off-policy correction to remedy this challenge. This allows us to take advantage of recent advances in off-policy model-free RL to learn both higherand lower-level policies using substantially fewer environment interactions than on-policy algorithms. We term the resulting HRL agent HIRO and find that it is generally applicable and highly sample-efficient. Our experiments show that HIRO can be used to learn highly complex behaviors for simulated robots, such as pushing objects and utilizing them to reach target locations,1 learning from only a few million samples, equivalent to a few days of real-time interaction. In comparisons with a number of prior HRL methods, we find that our approach substantially outperforms previous state-of-the-art techniques.2
Data-Efficient Learning of Feedback Policies from Image Pixels using Deep Dynamical Models
(2015)

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this challenge, the pixels-to-torques problem, where an RL agent learns a closed-loop control policy (“torques”) from pixel information only. We introduce a data-efficient, model-based reinforcement learning algorithm that learns such a closed-loop policy directly from pixel information. The key ingredient is a deep dynamical model for learning a low-dimensional feature embedding of images jointly with a predictive model in this low-dimensional feature space. Joint learning is crucial for longterm predictions, which lie at the core of the adaptive nonlinear model predictive control strategy that we use for closed-loop control. Compared to state-of-the-art RL methods for continuous states and actions, our approach learns quickly, scales to high-dimensional state spaces, is lightweight and an important step toward fully autonomous end-to-end learning from pixels to torques.
Optimal number of response categories in rating scales: reliability, validity, discriminating power, and respondent preferences.
(2000)

Using a self-administered questionnaire, 149 respondents rated service elements associated with a recently visited store or restaurant on scales that differed only in the number of response categories (ranging from 2 to 11) and on a 101-point scale presented in a different format. On several indices of reliability, validity, and discriminating power, the two-point, three-point, and four-point scales performed relatively poorly, and indices were significantly higher for scales with more response categories, up to about 7. Internal consistency did not differ significantly between scales, but test-retest reliability tended to decrease for scales with more than 10 response categories. Respondent preferences were highest for the 10-point scale, closely followed by the seven-point and nine-point scales. Implications for research and practice are discussed.
FPGA vs. GPU for sparse matrix vector multiply
(2009)

Sparse matrix-vector multiplication (SpMV) is a common operation in numerical linear algebra and is the computational kernel of many scientific applications. It is one of the original and perhaps most studied targets for FPGA acceleration. Despite this, GPUs, which have only recently gained both general-purpose programmability and native support for double precision floating-point arithmetic, are viewed by some as a more effective platform for SpMV and similar linear algebra computations. In this paper, we present an analysis comparing an existing GPU SpMV implementation to our own, novel FPGA implementation. In this analysis, we describe the challenges faced by any SpMV implementation, the unique approaches to these challenges taken by both FPGA and GPU implementations, and their relative performance for SpMV.
The ArchC Architecture Description Language and Tools
(2005)

This paper presents an architecture description language (ADL) called ArchC, which is an open-source SystemC-based language that is specialized for processor architecture description. Its main goal is to provide enough information, at the right level of abstraction, in order to allow users to explore and verify new architectures, by automatically generating software tools like simulators and co-verification interfaces. ArchC’s key features are a storage-based co-verification mechanism that automatically checks the consistency of a refined ArchC model against a reference (functional) description, memory hierarchy modeling capability, the possibility of integration with other SystemC IPs and the automatic generation of high-level SystemC simulators and assemblers. We have used ArchC to synthesize both functional and cycle-based simulators for the MIPS and Intel 8051 processors, as well as functional models of architectures like SPARC V8, TMS320C62x, XScale and PowerPC.
Sign Language Recognition using Sequential Pattern Trees
(2012)

This paper presents a novel, discriminative, multi-class classifier based on Sequential Pattern Trees. It is efficient to learn, compared to other Sequential Pattern methods, and scalable for use with large classifier banks. For these reasons it is well suited to Sign Language Recognition. Using deterministic robust features based on hand trajectories, sign level classifiers are built from sub-units. Results are presented both on a large lexicon single signer data set and a multi-signer Kinect™ data set. In both cases it is shown to out perform the non-discriminative Markov model approach and be equivalent to previous, more costly, Sequential Pattern (SP) techniques.
Hardware-In-the-Loop Simulation of Electric Vehicle Powertrain System
(2009)

This paper presents a design procedure of HardwareIn-the-Loop (HIL) for Electric Vehicle powertrain system modeling and simulation. First, simulation is performed in MATLAB/Simulink platform. Then, an Electric Vehicle Powertrain Hardware-In-the-Loop system including BMS (Battery Manage System), MCU (Motor Control Unit) and VMS (vehicle management system) is built based on the dSPACE with MATLAB/Simulink, along with the RTW toolbox (real time workshop). Through this system, the Electric Vehicle Control strategy is simulated and validated, and the results of offline simulation & real time simulation with laboratory prototype are presented. Keywords-Hardware In the Loop; Electric Vehicle; Simulation; dSPACE; DSP
Introduction: Hybrid intelligent adaptive systems
(1998)

This issue of International Journal of Intelligent Systems includes extended versions of selected papers from the 4th International Conference on Soft Computing, held in Iizuka, Japan, September 30]October 5, 1996. The topic of the special issue is ‘‘Hybrid Intelligent Adaptive Systems.’’ Research on hybrid systems is one of the key issues of developing intelligent systems and it can apply a wide range of tools, including artificial neural networks, fuzzy logic, knowledge-based systems, genetic algorithms, evolutionary computation, and chaos models. The papers in this issue have been carefully reviewed and modified to give the readers a comprehensive overview of theoretical aspects, design, and implementation issues of hybrid intelligent adaptive systems. In the first paper by Kasabov and Kozma, a general framework of developing hybrid, intelligent, and adaptive systems is given. This work develops multimodular, fuzzy neural network systems and applies it to phoneme-based speech recognition. The second paper by Miyata, Furuhashi, and Uchikawa proposes fuzzy abductive inference with degrees of manifestations. This method infers irredundant combinations of candidates with degrees of belief for the manifestations. It is also demonstrated that the results of the inference method are applicable to medical diagnosis and system fault detection. Cho adopts ideas of artificial life in his work to develop evolutionary neural networks. The introduced modular neural network can evole its structure autonomously using a structural genetic code. The effectiveness of the method is demonstrated on the example of handwritten digit recognition. Feuring and Lippe study theoretical aspects of fuzzy neural networks. They propose a training algorithm for fuzzy neural networks that satisfies a certain goodness criterion. The second part of the special issue contains articles related to time series analysis and systems control. Yamazaki, Kang, and Ochiai introduce a hierarchical neural network system for adaptive, intelligent control, based on the analogy with the human thinking process. The optimum parameter space of the neural network system is found by a self-controllable algorithm, which can lead to either equilibrium or to nonequilibrium, chaotic behavior. The results of this study are applied, e.g., to laser beam analysis, semiconductor design, and design of magnetic devices. The work by Kozma, Kasabov, Kim, and Cohen presents a chaotic neuro-fuzzy method for time series analysis and process control. The
A 6LoWPAN Accelerator for Internet of Things Endpoint Devices
(2018)

The Internet of Things (IoT) is revolutionizing the Internet of the future and the way smart devices, people, and processes interact with each other. Challenges in endpoint devices (EDs) communication are due not only to the security and privacy-related requirements but also due to the ever-growing amount of data transferred over the network that needs to be handled, which can considerably reduce the system availability to perform other tasks. This paper presents an IPv6 over low power wireless personal area networks (6LoWPAN) accelerator for the IP-based IoT networks, which is able to process and filter IPv6 packets received by an IEEE 802.15.4 radio transceiver without interrupting the microcontroller. It offers nearly 13.24% of performance overhead reduction for the packet processing and the address filtering tasks, while guaranteeing full system availability when unwanted packets are received and discarded. The contribution is meant to be deployed on heterogeneous EDs at the network edge, which include on the same architecture, field-programmable gate array (FPGA) technology beside a microcontroller and an IEEE 802.15.4-compliant radio transceiver. Performed evaluations include the low FPGA hardware resources utilization and the energy consumption analysis when the processing and accepting/rejection of a received packet is performed by the 6LoWPAN accelerator.
Real-time Incremental Speech-to-Speech Translation of Dialogs
(2012)

In a conventional telephone conversation between two speakers of the same language, the interaction is real-time and the speakers process the information stream incrementally. In this work, we address the problem of incremental speech-to-speech translation (S2S) that enables cross-lingual communication between two remote participants over a telephone. We investigate the problem in a novel real-time Session Initiation Protocol (SIP) based S2S framework. The speech translation is performed incrementally based on generation of partial hypotheses from speech recognition. We describe the statistical models comprising the S2S system and the SIP architecture for enabling real-time two-way cross-lingual dialog. We present dialog experiments performed in this framework and study the tradeoff in accuracy versus latency in incremental speech translation. Experimental results demonstrate that high quality translations can be generated with the incremental approach with approximately half the latency associated with nonincremental approach.
An Edge Driven Wavelet Frame Model for Image Restoration
(2017)

Wavelet frame systems are known to be effective in capturing singularities from noisy and degraded images. In this paper, we introduce a new edge driven wavelet frame model for image restoration by approximating images as piecewise smooth functions. With an implicit representation of image singularities sets, the proposed model inflicts different strength of regularization on smooth and singular image regions and edges. The proposed edge driven model is robust to both image approximation and singularity estimation. The implicit formulation also enables an asymptotic analysis of the proposed models and a rigorous connection between the discrete model and a general continuous variational model. Finally, numerical results on image inpainting and deblurring show that the proposed model is compared favorably against several popular image restoration models.
Long-term stability of anterior open-bite treatment by intrusion of maxillary posterior teeth.
(2010)

INTRODUCTION
Anterior open bite results from the combined influences of skeletal, dental, functional, and habitual factors. The long-term stability of anterior open bite corrected with absolute anchorage has not been thoroughly investigated. The purpose of this study was to examine the long-term stability of anterior open-bite correction with intrusion of the maxillary posterior teeth.


METHODS
Nine adults with anterior open bite were treated by intrusion of the maxillary posterior teeth. Lateral cephalographs were taken immediately before and after treatment, 1 year posttreatment, and 3 years posttreatment to evaluate the postintrusion stability of the maxillary posterior teeth.


RESULTS
On average, the maxillary first molars were intruded by 2.39 mm (P<0.01) during treatment and erupted by 0.45 mm (P<0.05) at the 3-year follow-up, for a relapse rate of 22.88%. Eighty percent of the total relapse of the intruded maxillary first molars occurred during the first year of retention. Incisal overbite increased by a mean of 5.56 mm (P<0.001) during treatment and decreased by a mean of 1.20 mm (P<0.05) by the end of the 3-year follow-up period, for a relapse rate of 17.00%. Incisal overbite significantly relapsed during the first year of retention (P<0.05) but did not exhibit significant recurrence between the 1-year and 3-year follow-ups.


CONCLUSIONS
Most relapse occurred during the first year of retention. Thus, it is reasonable to conclude that the application of an appropriate retention method during this period clearly enhances the long-term stability of the treatment.
The orbitofrontal cortex and reward.
(2000)

The primate orbitofrontal cortex contains the secondary taste cortex, in which the reward value of taste is represented. It also contains the secondary and tertiary olfactory cortical areas, in which information about the identity and also about the reward value of odors is represented. The orbitofrontal cortex also receives information about the sight of objects and faces from the temporal lobe cortical visual areas, and neurons in it learn and reverse the visual stimulus to which they respond when the association of the visual stimulus with a primary reinforcing stimulus (such as a taste reward) is reversed. However, the orbitofrontal cortex is involved in representing negative reinforcers (punishers) too, such as aversive taste, and in rapid stimulus-reinforcement association learning for both positive and negative primary reinforcers. In complementary neuroimaging studies in humans it is being found that areas of the orbitofrontal cortex (and connected subgenual cingulate cortex) are activated by pleasant touch, by painful touch, by rewarding and aversive taste, and by odor. Damage to the orbitofrontal cortex in humans can impair the learning and reversal of stimulus- reinforcement associations, and thus the correction of behavioral responses when these are no longer appropriate because previous reinforcement contingencies change. This evidence thus shows that the orbitofrontal cortex is involved in decoding and representing some primary reinforcers such as taste and touch; in learning and reversing associations of visual and other stimuli to these primary reinforcers; and in controlling and correcting reward-related and punishment-related behavior, and thus in emotion.
Adverse Effects Associated with Protein Intake above the Recommended Dietary Allowance for Adults
(2013)

Background. While high-protein consumption-above the current recommended dietary allowance for adults (RDA: 0.8 g protein/kg body weight/day)-is increasing in popularity, there is a lack of data on its potential adverse effects. Objective. To determine the potential disease risks due to high protein/high meat intake obtained from diet and/or nutritional supplements in humans. Design. Review. Subjects. Healthy adult male and female subjects. Method. In order to identify relevant studies, the electronic databases, Medline and Google Scholar, were searched using the terms:"high protein diet," "protein overconsumption," "protein overuse," and "high meat diet." Papers not in English were excluded. Further studies were identified by citations in retrieved papers. Results. 32 studies (21 experimental human studies and 11 reviews) were identified. The adverse effects associated with long-term high protein/high meat intake in humans were (a) disorders of bone and calcium homeostasis, (b) disorders of renal function, (c) increased cancer risk, (d) disorders of liver function, and (e) precipitated progression of coronary artery disease. Conclusions. The findings of the present study suggest that there is currently no reasonable scientific basis in the literature to recommend protein consumption above the current RDA (high protein diet) for healthy adults due to its potential disease risks. Further research needs to be carried out in this area, including large randomized controlled trials.
Automated Lip Reading Technique for Password Authentication
(2012)

As technology is starting to conquer every strata of the society, the war for protecting confidential data from being intercepted is growing intense by the hour. Biometricsecurity stands out as the most secure form of authentication in high security zones such as defense, space missions and research head-quarters. Today, forms of password-protection range from facerecognition to retina -scan. Here, we develop a system for recognizing and converting lip movement of an individual into a recognized pattern which is set as a password for the system using image-processing. This system is also a break-through for providing people with motor-disabilities a robust and easy way of protecting their data. By capturing and tracing the successive movement of lips during speech, the corresponding word can be detected. The captured images are represented as points on a two-dimensional flat manifold that enables us to efficiently define the pronunciation of each word and thereby analyze or synthesize the motion of the lips. The motion of lips helps us track the word syllable-by-syllable. With multiple levels of image processing, it becomes possible to set the matching parameters to a very close value, hence not allowing any bruteforce or other infamous hacking techniques to break into the user’s system. This lip reading technique also serves applications in areas where communication via direct speech is not possible.
Efficient Deep Learning on Multi-Source Private Data
(2018)

Machine learning models benefit from large and diverse datasets. Using such datasets, however, often requires trusting a centralized data aggregator. For sensitive applications like healthcare and finance this is undesirable as it could compromise patient privacy or divulge trade secrets. Recent advances in secure and privacy-preserving computation, including trusted hardware enclaves and differential privacy, offer a way for mutually distrusting parties to efficiently train a machine learning model without revealing the training data. In this work, we introduce Myelin, a deep learning framework which combines these privacy-preservation primitives, and use it to establish a baseline level of performance for fully private machine learning.
The crisis in antibiotic resistance.
(1992)

The synthesis of large numbers of antibiotics over the past three decades has caused complacency about the threat of bacterial resistance. Bacteria have become resistant to antimicrobial agents as a result of chromosomal changes or the exchange of the exchange of genetic material via plasmids and transposons. Streptococcus pneumoniae, Streptococcus pyogenes, and staphylococci, organisms that cause respiratory and cutaneous infections, and members of the Enterobacteriaceae and Pseudomonas families, organisms that cause diarrhea, urinary infection, and sepsis, are now resistant to virtually all of the older antibiotics. The extensive use of antibiotics in the community and hospitals has fueled this crisis. Mechanisms such as antibiotic control programs, better hygiene, and synthesis of agents with improved antimicrobial activity need to be adopted in order to limit bacterial resistance.
A case for dynamic frequency tuning in on-chip networks
(2009)

Performance and power are the first order design metrics for Network-on-Chips (NoCs) that have become the de-facto standard in providing scalable communication backbones for multicores/CMPs. However, NoCs can be plagued by higher power consumption and degraded throughput if the network and router are not designed properly. Towards this end, this paper proposes a novel router architecture, where we tune the frequency of a router in response to network load to manage both performance and power. We propose three dynamic frequency tuning techniques, FreqBoost, FreqThrtl and FreqTune, targeted at congestion and power management in NoCs. As enablers for these techniques, we exploit Dynamic Voltage and Frequency Scaling (DVFS) and the imbalance in a generic router pipeline through time stealing. Experiments using synthetic workloads on a 8x8 wormhole-switched mesh interconnect show that FreqBoost is a better choice for reducing average latency (maximum 40%) while, FreqThrtl provides the maximum benefits in terms of power saving and energy delay product (EDP). The FreqTune scheme is a better candidate for optimizing both performance and power, achieving on an average 36% reduction in latency, 13% savings in power (up to 24% at high load), and 40% savings (up to 70% at high load) in EDP. With application benchmarks, we observe IPC improvement up to 23% using our design. The performance and power benefits also scale for larger NoCs.