PenguinMan/ARXIV huggingface dataset:
A comprehensive study on bilingual and multilingual speech emotion recognition using a two-pass classification scheme
Authors: Panikos Heracleous, Akio Yoneyama
Journal: PLOS ONE
Accepted: 2019-07-15T00:00:00Z


Emotion recognition plays an important role in human-computer interaction. Previously and currently, many studies focused on speech emotion recognition using several classifiers and feature extraction methods. The majority of such studies, however, address the problem of speech emotion recognition considering emotions solely from the perspective of a single language. In contrast, the current study extends monolingual speech emotion recognition to also cover the case of emotions expressed in several languages that are simultaneously recognized by a complete system. To address this issue, a method, which provides an effective and powerful solution to bilingual speech emotion recognition, is proposed and evaluated. The proposed method is based on a two-pass classification scheme consisting of spoken language identification and speech emotion recognition. In the first pass, the language spoken is identified; in the second pass, emotion recognition is conducted using the emotion models of the language identified. Based on deep learning and the i-vector paradigm, bilingual emotion recognition experiments have been conducted using the state-of-the-art English IEMOCAP (four emotions) and German FAU Aibo (five emotions) corpora. Two classifiers along with i-vector features were used and compared, namely, fully connected deep neural networks (DNN) and convolutional neural networks (CNN). In the case of DNN, 64.0% and 61.14% unweighted average recalls (UARs) were obtained using the IEMOCAP and FAU Aibo corpora, respectively. When using CNN, 62.0% and 59.8% UARs were achieved in the case of the IEMOCAP and FAU Aibo corpora, respectively. These results are very promising, and superior to those obtained in similar studies on multilingual or even monolingual speech emotion recognition. Furthermore, an additional baseline approach for bilingual speech emotion recognition was implemented and evaluated. In the baseline approach, six common emotions were considered, and bilingual emotion models were created, trained on data from the two languages. In this case, 51.2% and 51.5% UARs for six emotions were obtained using DNN and CNN, respectively. The results using the baseline method were reasonable and promising, showing the effectiveness of using i-vectors and deep learning in bilingual speech emotion recognition. On the other hand, the proposed two-pass method based on language identification showed significantly superior performance. Furthermore, the current study was extended to also deal with multilingual speech emotion recognition using corpora collected under similar conditions. Specifically, the English IEMOCAP, the German Emo-DB, and a Japanese corpus were used to recognize four emotions based on the proposed two-pass method. The results obtained were very promising, and the differences in UAR were not statistically significant compared to the monolingual classifiers.
Streaming chunk incremental learning for class-wise data stream classification with fast learning speed and low structural complexity
Authors: Prem Junsawang, Suphakant Phimoltares, Chidchanok Lursinsap
Journal: PLOS ONE
Accepted: 2019-07-20T00:00:00Z


Due to the fast speed of data generation and collection from advanced equipment, the amount of data obviously overflows the limit of available memory space and causes difficulties achieving high learning accuracy. Several methods based on discard-after-learn concept have been proposed. Some methods were designed to cope with a single incoming datum but some were designed for a chunk of incoming data. Although the results of these approaches are rather impressive, most of them are based on temporally adding more neurons to learn new incoming data without any neuron merging process which can obviously increase the computational time and space complexities. Only online versatile elliptic basis function (VEBF) introduced neuron merging to reduce the space-time complexity of learning only a single incoming datum. This paper proposed a method for further enhancing the capability of discard-after-learn concept for streaming data-chunk environment in terms of low computational time and neural space complexities. A set of recursive functions for computing the relevant parameters of a new neuron, based on statistical confidence interval, was introduced. The newly proposed method, named streaming chunk incremental learning (SCIL), increases the plasticity and the adaptabilty of the network structure according to the distribution of incoming data and their classes. When being compared to the others in incremental-like manner, based on 11 benchmarked data sets of 150 to 581,012 samples with attributes ranging from 4 to 1,558 formed as streaming data, the proposed SCIL gave better accuracy and time in most data sets.
A serious game to explore human foraging in a 3D environment
Authors: Valter Prpic, Isabelle Kniestedt, Elizabeth Camilleri, Marcello Gómez Maureira, Árni Kristjánsson, Ian M Thornton
Journal: PLOS ONE
Accepted: 2019-07-02T00:00:00Z


Traditional search tasks have taught us much about vision and attention. Recently, several groups have begun to use multiple-target search to explore more complex and temporally extended “foraging” behaviour. Many of these new foraging tasks, however, maintain the simplified 2D displays and response demands associated with traditional, single-target visual search. In this respect, they may fail to capture important aspects of real-world search or foraging behaviour. In the current paper, we present a serious game for mobile platforms, developed in Unity3D, in which human participants play the role of an animal foraging for food in a simulated 3D environment. Game settings can be adjusted, so that, for example, custom target and distractor items can be uploaded, and task parameters, such as the number of target categories or target/distractor ratio are all easy to modify. We are also making the Unity3D project available, so that further modifications can also be made. We demonstrate how the app can be used to address specific research questions by conducting two human foraging experiments. Our results indicate that in this 3D environment, a standard feature/conjunction manipulation does not lead to a reduction in foraging runs, as it is known to do in simple, 2D foraging tasks.
Proprotein convertase subtilisin/kexin type 9 (PCSK9) in Alzheimer’s disease: A genetic and proteomic multi-cohort study
Authors: Cynthia Picard, Alexandre Poirier, Stéphanie Bélanger, Anne Labonté, Daniel Auld, Judes Poirier, on behalf of the PREVENT-AD Research Group 
Journal: PLOS ONE
Accepted: 2019-07-11T00:00:00Z

Background: Proprotein convertase subtilisin/kexin type 9 (PCSK9) is a hepatic enzyme that regulates circulating low-density lipoprotein (LDL) cholesterol levels by binding to LDL receptors (LDLR) and promoting their degradation. Although PCSK9 inhibitors were shown to reduce the risk of cardiovascular disease, a warning was issued concerning their possible impact on cognitive functions. In Alzheimer’s disease (AD), it is believed that cognitive impairment is associated with cholesterol metabolism alterations, which could involve PCSK9. The main objective of this study is to determine if PCSK9 plays a significant role in the pre-symptomatic phase of the disease when the pathophysiological markers of AD unfolds and, later, when cognitive symptoms emerge. Methods and findings: To test if PCSK9 is associated with AD pathology, we measured its expression levels in 65 autopsy confirmed AD brains and 45 age and gender matched controls. Messenger ribonucleic acid (mRNA) were quantified using real-time polymerase chain reaction (RT-PCR) and protein levels were quantified using enzyme-linked immunosorbent assay (ELISA). PCSK9 was elevated in frontal cortices of AD subjects compared to controls, both at the mRNA and protein levels. LDLR protein levels were unchanged in AD frontal cortices, despite and upregulation at the mRNA level. To verify if PCSK9 dysregulation was observable before the onset of AD, we measured its expression in the cerebrospinal fluid (CSF) of 104 “at-risk” subjects and contrasted it with known apolipoproteins levels and specific AD biomarkers using ELISAs. Positive correlations were found between CSF PCSK9 and apolipoprotein E (APOE), apolipoprotein J (APOJ or CLU), apolipoprotein B (APOB), phospho Tau (pTau) and total Tau. To investigate if PCSK9 levels were driven by genetic variants, we conducted an expression quantitative trait loci (eQTL) study using bioinformatic tools and found two polymorphisms in strong association. Further investigation of these variants in two independent cohorts showed a female specific association with AD risk and with CSF Tau levels in cognitively impaired individuals. Conclusions: PCSK9 levels differ between control and AD brains and its protein levels correlate with those of other lipoproteins and AD biomarkers even before the onset of the disease. PCSK9 regulation seems to be under tight genetic control in females only, with specific variants that could predispose to increased AD risk.
Contractile properties of superficial skeletal muscle affect postural control in healthy young adults: A test of the rambling and trembling hypothesis
Authors: Sunghoon Shin, Matija Milosevic, Chul-min Chung, Yungon Lee
Journal: PLOS ONE
Accepted: 2019-09-30T00:00:00Z


The rambling and trembling analysis separates the center of pressure (COP) fluctuations into two components: rambling (supraspinal contribution) and trembling (muscle stiffness / reflexive properties contribution). We examined whether the trembling component is correlated to the contractile properties (muscle stiffness and contraction time) of lower limb superficial skeletal muscles to experimentally test the rambling and trembling hypothesis. We hypothesized that muscle stiffness and contraction time, would be: (a) more correlated with; and (b) have a greater impact on the trembling component compared to the rambling component. Thirty-two healthy young adults were recruited for the study and tensiomyography was used to assess mechanical muscle responses to a single electrical stimulus to calculate muscle stiffness and contraction time based on radial muscle belly displacement measurements of lower limb muscles unilaterally. Moreover, upright postural control was assessed using a force plate to record ground reaction forces and moments and calculate the COP fluctuations during two 30 seconds trials. From the COP fluctuations, rambling and trembling time series were extracted, and all fluctuation time series were described using a number of different time-domain and frequency-domain parameters in both the anterior-posterior and medial-lateral directions. Our results demonstrated that both muscle stiffness and contraction time were moderately correlated with time-domain and frequency-domain parameters of the trembling component, as compared with those of the rambling component which was not as well correlated. Moreover, they also predicted the trembling component better. Overall, these results imply that postural control during quiet stance is, in part, related to intrinsic muscle stiffness in the lower extremities. Moreover, we showed that the rambling and trembling hypothesis is effective in separating postural sway fluctuations during upright posture to extract the contributions of muscle stiffness / reflexive properties (trembling), and likely the supraspinal contribution (rambling).
When calculators lie: A demonstration of uncritical calculator usage among college students and factors that improve performance
Authors: Mark LaCour, Norma G Cantú, Tyler Davis
Journal: PLOS ONE
Accepted: 2019-09-26T00:00:00Z


Calculators are often unnecessary to solve routine problems, though they are convenient for offloading cognitively effortful processes. However, errors can arise if incorrect procedures are used or when users fail to monitor the output for keystroke mistakes. To investigate the conditions under which people’s attention are captured by errant calculator outputs (i.e., from incorrectly chosen procedures or keystroke errors), we programmed an onscreen calculator to “lie” by changing the answers displayed on certain problems. We measured suspicion by tracking whether users explicitly reported suspicion, overrode calculator “lies”, or re-checked their calculations after a “lie” was presented. In Study 1, we manipulated the concreteness of problem presentation and calculator delay between subjects to test how these affect suspicion towards “lies” (15% added to answers). We found that numeracy had no effect on whether people opted-in or out of using the calculator but did predict whether they would become suspicious. Very few people showed suspicion overall, however. For study 2, we increased the “lies” to 120% on certain answers and included questions with “conceptual lies” shown (e.g., a negative sign that should have been positive). We again found that numeracy had no effect on calculator usage, but, along with concrete formatting, did predict suspicion behavior. This was found regardless of “lie” type. For study 3, we reproduced these effects after offering students an incentive for good performance, which did raise their accuracy across the math problems overall but did not increase suspicion behavior. We conclude that framing problems within a concrete domain and being higher in numeracy increases the likelihood of spotting errant calculator outputs, regardless of incentive.
Establishing an infrastructure for collaboration in primate cognition research
Authors: Many Primates , Drew M Altschul, Michael J Beran, Manuel Bohn, Josep Call, Sarah DeTroy, Shona J Duguid, Crystal L Egelkamp, Claudia Fichtel, Julia Fischer, Molly Flessert, Daniel Hanus, Daniel B M Haun, Lou M Haux, R Adriana Hernandez-Aguilar, Esther Herrmann, Lydia M Hopper, Marine Joly, Fumihiro Kano, Stefanie Keupp, Alicia P Melis, Alba Motes Rodrigo, Stephen R Ross, Alejandro Sánchez-Amaro, Yutaro Sato, Vanessa Schmitt, Manon K Schweinfurth, Amanda M Seed, Derry Taylor, Christoph J Völter, Elizabeth Warren, Julia Watzek
Journal: PLOS ONE
Accepted: 2019-09-25T00:00:00Z


Inferring the evolutionary history of cognitive abilities requires large and diverse samples. However, such samples are often beyond the reach of individual researchers or institutions, and studies are often limited to small numbers of species. Consequently, methodological and site-specific-differences across studies can limit comparisons between species. Here we introduce the ManyPrimates project, which addresses these challenges by providing a large-scale collaborative framework for comparative studies in primate cognition. To demonstrate the viability of the project we conducted a case study of short-term memory. In this initial study, we were able to include 176 individuals from 12 primate species housed at 11 sites across Africa, Asia, North America and Europe. All subjects were tested in a delayed-response task using consistent methodology across sites. Individuals could access food rewards by remembering the position of the hidden reward after a 0, 15, or 30-second delay. Overall, individuals performed better with shorter delays, as predicted by previous studies. Phylogenetic analysis revealed a strong phylogenetic signal for short-term memory. Although, with only 12 species, the validity of this analysis is limited, our initial results demonstrate the feasibility of a large, collaborative open-science project. We present the ManyPrimates project as an exciting opportunity to address open questions in primate cognition and behaviour with large, diverse datasets.
Cognitive impairment and its risk factors among Myanmar elderly using the Revised Hasegawa’s Dementia Scale: A cross-sectional study in Nay Pyi Taw, Myanmar
Authors: Yu Mon Saw, Thu Nandar Saw, Thet Mon Than, Moe Khaing, Pa Pa Soe, San Oo, Su Myat Cho, Ei Mon Win, Aye Myat Mon, Etsuko Fuchita, Tetsuyoshi Kariya, Shigemi Iriyama, Nobuyuki Hamajima
Journal: PLOS ONE
Accepted: 2020-07-09T00:00:00Z

Background: Globally, elderly population with impaired cognitive function, such as dementia, has been accelerating, and Myanmar is no exception. However, cognitive function among elderly in Myanmar has rarely been assessed. This study aimed to identify the rate of cognitive impairment and its risk factors among the elderly in Myanmar. Methods: This cross-sectional study was conducted at rural health centers in Nay Pyi Taw Union Territory, Myanmar, from December 2018 to January 2019. In total, 757 elderly individuals aged 60 years or over (males: 246 [32.5%], females: 511 [67.5%]) were interviewed using a face-to-face method with a pre-tested questionnaire. Descriptive statistics and multivariable logistic regression analyses were performed. Results: The rate of impaired cognitive function among participants was 29.9% (males: 23.6%; females: 32.9%). The following participants were more likely to present cognitive impairment: those aged 70–79 years (adjusted odds ratio [AOR] = 1.8; 95% confidence interval [CI]: 1.19–2.70) and 80 years or older (AOR = 3.9; 95% CI: 2.25–6.76); those who were illiterate (AOR = 9.1; 95% CI: 3.82–21.51); and those dependent on family members (AOR = 1.6; 95% CI: 1.04–2.44). The elderly livening with their families and those who reported having good health (AOR = 0.7; 95% CI: 0.44–0.99) were less likely to have cognitive impairment. Conclusion: Using the HDS-R Myanmar version, this study reported that there out of five elderly participants had cognitive impairment, and its risk factors, altering policy makers that Myanmar needs to prepare for adequate healthcare services and social support for elderly with cognitive impairment. Future research should be performed not only to detect general cognitive impairment but also to differentiate specific cognitive domains impairments among Myanmar elderly. Longitudinal studies are needed to observe the causal and protective factors associated with cognitive impairments in Myanmar.
Intrinsic motivation in virtual assistant interaction for fostering spontaneous interactions
Authors: Chang Li, Hideyoshi Yanagisawa
Journal: PLOS ONE
Accepted: 2021-04-05T00:00:00Z


With the growing utility of today’s conversational virtual assistants, the importance of user motivation in human–artificial intelligence interactions is becoming more obvious. However, previous studies in this and related fields, such as human–computer interaction, scarcely discussed intrinsic motivation (the motivation to interact with the assistants for fun). Previous studies either treated motivation as an inseparable concept or focused on non-intrinsic motivation (the motivation to interact with the assistant for utilitarian purposes). The current study aims to cover intrinsic motivation by taking an affective engineering approach. A novel motivation model is proposed, in which intrinsic motivation is affected by two factors that derive from user interactions with virtual assistants: expectation of capability and uncertainty. Experiments in which these two factors are manipulated by making participants believe they are interacting with the smart speaker “Amazon Echo” are conducted. Intrinsic motivation is measured both by using questionnaires and by covertly monitoring a five-minute free-choice period in the experimenter’s absence, during which the participants could decide for themselves whether to interact with the virtual assistants. Results of the first experiment showed that high expectation engenders more intrinsically motivated interaction compared with low expectation. However, the results did not support our hypothesis that expectation and uncertainty have an interaction effect on intrinsic motivation. We then revised our hypothetical model of action selection accordingly and conducted a verification experiment of the effects of uncertainty. Results of the verification experiment showed that reducing uncertainty encourages more interactions and causes the motivation behind these interactions to shift from non-intrinsic to intrinsic.
The effect of disagreement on children’s source memory performance
Authors: Johannes B Mahr, Olivier Mascaro, Hugo Mercier, Gergely Csibra
Journal: PLOS ONE
Accepted: 2021-03-27T00:00:00Z


Source representations play a role both in the formation of individual beliefs as well as in the social transmission of such beliefs. Both of these functions suggest that source information should be particularly useful in the context of interpersonal disagreement. Three experiments with an identical design (one original study and two replications) with 3- to 4-year-old-children (N = 100) assessed whether children’s source memory performance would improve in the face of disagreement and whether such an effect interacts with different types of sources (first- vs. second-hand). In a 2 x 2 repeated-measures design, children found out about the contents of a container either by looking inside or being told (IV1). Then they were questioned about the contents of the container by an interlocutor puppet who either agreed or disagreed with their answer (IV2). We measured children’s source memory performance in response to a free recall question (DV1) followed by a forced-choice question (DV2). Four-year-olds (but not three-year-olds) performed better in response to the free recall source memory question (but not the forced-choice question) when their interlocutor had disagreed with them compared to when it had agreed with them. Children were also better at recalling ‘having been told’ than ‘having seen’. These results demonstrate that by four years of age, source memory capacities are sensitive to the communicative context of assertions and serve social functions.
Physiological and subjective comfort evaluation under different airflow directions in a cooling environment
Authors: Kaori Tamura, Sayaka Matsumoto, Yu Hsuan Tseng, Takayuki Kobayashi, Jun’ichi Miwa, Ken’ichi Miyazawa, Toyotaka Hirao, Soichiro Matsumoto, Seiji Hiramatsu, Hiroyuki Otake, Tsuyoshi Okamoto
Journal: PLOS ONE
Accepted: 2021-03-12T00:00:00Z


Indoor comfort is influenced by airflow direction, but subjective evaluations can differ. This study evaluates the airflow comfort with subjective assessments and physiological measurements, including skin temperature, electroencephalograms, and electrocardiograms. Nineteen participants entered a test room at 20°C after staying in a room at 32°C for acclimation. They were exposed to indirect and direct airflow conditions to their faces and performed four tasks under each condition: resting, counting to 10 s following time alerts, counting to 10 s in mind, and mental calculation. Subjective assessments showed relatively higher thermal sensation and pleasantness under indirect airflow. The psychological time calculated from counting behaviors was longer under indirect airflow, indicating suppression of negative emotions. The face temperatures significantly declined during experiments under direct airflow. The beta and gamma bands of electroencephalograms were inhibited under the indirect condition, and these amplitudes were negatively correlated with pleasant feelings. Electrocardiogram parameters indicated that sympathetic nervous activity was predominant during counting, following alerts and mental calculation in indirect airflow. This study supports the comfort of indirect airflow based on reliable evidence.