PenguinMan/ARXIV huggingface dataset:
Towards sentiment aided dialogue policy learning for multi-intent conversations using hierarchical reinforcement learning
Authors: Tulika Saha, Sriparna Saha, Pushpak Bhattacharyya
Journal: PLOS ONE
Accepted: 2020-06-13T00:00:00Z

Purpose: Developing a Dialogue/Virtual Agent (VA) that can handle complex tasks (need) of the user pertaining to multiple intents of a domain is challenging as it requires the agent to simultaneously deal with multiple subtasks. However, majority of these end-to-end dialogue systems incorporate only user semantics as inputs in the learning process and ignore other useful user behavior and information. Sentiment of the user at the time of conversation plays an important role in securing maximum user gratification. So, incorporating sentiment of the user during the policy learning becomes even more crucial, more so when serving composite tasks of the user. Methodology: As a first step towards enabling the development of sentiment aided VA for multi-intent conversations, this paper proposes a new dataset, annotated with its corresponding intents, slot and sentiment (considering the entire dialogue history) labels, named SentiVA, collected from open-sourced dialogue datasets. In order to integrate these multiple aspects, a Hierarchical Reinforcement Learning (HRL) specifically options based VA is proposed to learn strategies for managing multi-intent conversations. Along with task success based immediate rewards, sentiment based immediate rewards are also incorporated in the hierarchical value functions to make the VA user adaptive. Findings: Empirically, the paper shows that task based and sentiment based immediate rewards cumulatively are required to ensure successful task completion and attain maximum user satisfaction in a multi-intent scenario instead of any of these rewards alone. Practical implications: The eventual evaluators and consumers of dialogue systems are users. Thus, to ensure a fulfilling conversational experience involving maximum user satisfaction requires VA to consider user sentiment at every time-step in its decision making policy. Originality: This work is the first attempt in incorporating sentiment based rewards in the HRL framework.
Interrogative suggestibility in the elderly
Authors: Silvia Biondi, Cristina Mazza, Graziella Orrù, Merylin Monaro, Stefano Ferracuti, Eleonora Ricci, Alberto Di Domenico, Paolo Roma
Journal: PLOS ONE
Accepted: 2020-10-13T00:00:00Z


Interrogative suggestibility (IS) describes the extent to which an individual behavioral response is affected by messages communicated during formal questioning within a closed social interaction. The present study aimed at improving knowledge about IS in the elderly (aged 65 years and older), in particular about its association with both emotive/affective and cognitive variables. The sample (N = 172) was divided into three groups on the basis of age: late adult (aged 55–64, N = 59), young elderly (aged 65–74, N = 63), and elderly (aged 75 and older, N = 50). Cognitive (i.e., Kaufman Brief Intelligence Test-2, Rey Auditory Verbal Learning Test), emotive/affective (i.e., Rosenberg Self-Esteem Scale, Marlowe–Crowne Social Desirability Scale, Penn State Worry Questionnaire) and suggestibility measures (i.e., Gudjonsson Suggestibility Scale-2) were administered. In order to identify differences and associations between groups in IS, cognitive and emotive/affective variables, ANOVAs tests and Pearson’s correlations were run. Furthermore, moderation analyses and hierarchical regression were set to determine whether age, cognitive and emotive/affective variables predicted IS components (i.e., Yield and Shift). Finally, machine learning models were developed to highlight the best strategy for classifying elderly subjects with high suggestibility. The results corroborated the significant link between IS and age, showing that elderly participants had the worst performance on all suggestibility indexes. Age was also the most important predictor of both Yield and Shift. Results also confirmed the important role of non-verbal intelligence and memory impairment in explaining IS dimensions, showing that these associations were stronger in young elderly and elderly groups. Implications about interrogative procedures with older adults were discussed.
Can we learn from errors? Retrieval facilitates the correction of false memories for pragmatic inferences
Authors: María J Maraver, Ana Lapa, Leonel Garcia-Marques, Paula Carneiro, Ana Raposo
Journal: PLOS ONE
Accepted: 2022-07-19T00:00:00Z


Errorful learning suggests that, when perfect learning has not yet been attained, errors can enhance future learning if followed by corrective feedback. Research on memory updating has shown that after retrieval, memory becomes more malleable and prone to change. Thus, retrieval of a wrong answer might provide a good context for the incorporation of feedback. Here, we tested this hypothesis using sentences including pragmatic sentence implications, commonly used for the study of false memories. Across two experiments with young adults, we hypothesized that corrective feedback would be more efficient at reducing false memories if provided immediately after retrieval, when memory is more malleable than after being exposed to the material. Participants’ memory was assessed as a function of the type of learning task (Experiment 1: retrieval vs. restudy; and Experiment 2: active vs. passive recognition); and whether participants received corrective feedback or not. In both experiments, we observed that retrieval not only improved correct recall (replicating the testing effect) but also promoted the correction of false memories. Notably, corrective feedback was more effective when given after errors that were committed during retrieval rather than after restudy (Experiment 1) or after passive recognition (Experiment 2). Our results suggest that the benefits of retrieval go beyond the testing effect since it also facilitates false memories correction. Retrieval seems to enhance memory malleability, thus improving the incorporation of feedback, compared to the mere presentation of the information. Our results support the use of learning strategies that engage in active and explicit retrieval because, even if the retrieved information is wrong—when immediate feedback is provided—memory updating is promoted and errors are more likely to be corrected.
Eye movement patterns in complex tasks: Characteristics of ambient and focal processing
Authors: Yuxuan Guo, Jens R Helmert, Sven-Thomas Graupner, Sebastian Pannasch
Journal: PLOS ONE
Accepted: 2022-10-18T00:00:00Z


Analyzing the time course of eye movements during scene viewing often indicates that people progress through two distinct modes of visual processing: an ambient mode, which is associated with overall spatial orientation in a scene, followed by a focal mode, which requires central vision of an object. However, the shifts between ambient and focal processing modes have mainly been identified relative to changes in the environment, such as relative to the onset of various visual stimuli but also following scene cuts or subjective event boundaries in dynamic stimuli. The results so far do not allow conclusions about the nature of the two processing mechanisms beyond the influence of externally triggered events. It remains unclear whether people shift back and forth from ambient to focal processing also based on internal triggers, such as switching between different tasks while no external event is given. The present study therefore investigated ambient to focal processing shifts in an active task solving paradigm. The Rubik’s Cube task introduced here is a multi-step task, which can be broken down into smaller sub-tasks that are performed serially. The time course of eye movements was analyzed at multiple levels of this Rubik’s Cube task, including when there were no external changes to the stimuli but when internal representations of the task were hypothesized to change (i.e., switching between different sub-tasks). Results suggest that initial ambient exploration is followed by a switch to more focal viewing across various levels of task processing with and without external changes to the stimuli. More importantly, the present findings suggest that ambient and focal eye movement characteristics might serve as a probe for the attentional state in task processing, which does not seem to be influenced by changes in task performance.
Acute effects of virtual reality treadmill training on gait and cognition in older adults: A randomized controlled trial
Authors: Lisa A Zukowski, Faisal D Shaikh, Alexa V Haggard, Renee N Hamel
Journal: PLOS ONE
Accepted: 2022-10-17T00:00:00Z

Introduction: Everyday walking often involves walking with divided attention (i.e., dual-tasking). Exercise interventions for older adults should mimic these simultaneous physical and cognitive demands. This proof-of-concept study had a two-fold purpose: 1) identify acute cognitive and gait benefits of a single session of virtual reality treadmill training (VRTT), relative to conventional treadmill training (CTT), and 2) identify differences between those who reduced dual-task costs (i.e., responders) on gait or cognition and those who did not, after the session. Methods: Sixty older adults were randomized to complete a single 30-minute session of VRTT (n = 30, 71.2±6.5 years, 22 females) or CTT (n = 30, 72.0±7.7 years, 21 females). Pre- and post-exercise session, participants performed single-task walking, single-task cognitive, and dual-task walking trials while gait and cognition were recorded. Gait variables were gait speed and gait speed variability. Cognition variables were response reaction time, response accuracy, and cognitive throughput. Dual-task effects (DTE) on gait and cognition variables were also calculated. Results: Post-exercise, there were no group differences (all p>0.05). During single- and dual-task trials, both groups walked faster (single-task: F(1, 58) = 9.560, p = 0.003; dual-task: F(1, 58) = 19.228, p<0.001), responded more quickly (single-task: F(1, 58) = 5.054, p = 0.028; dual-task: F(1, 58) = 8.543, p = 0.005), and reduced cognitive throughput (single-task: F(1, 58) = 6.425, p = 0.014; dual-task: F(1, 58) = 28.152, p<0.001). Both groups also exhibited reduced DTE on gait speed (F(1, 58) = 8.066, p = 0.006), response accuracy (F(1, 58) = 4.123, p = 0.047), and cognitive throughput (F(1, 58) = 6.807, p = 0.012). Gait responders and non-responders did not differ (all p>0.05), but cognitive responders completed fewer years of education (t(58) = 2.114, p = 0.039) and better information processing speed (t(58) = -2.265, p = 0.027) than cognitive non-responders. Conclusions: The results indicate that both VRTT and CTT may acutely improve gait and cognition. Therefore, older adults will likely benefit from participating in either type of exercise. The study also provides evidence that baseline cognition can impact training effects on DTE on cognition.
A paradigm shift in learning strategy research: Illustration and example of a within-person examination
Authors: Tsuyoshi Yamaguchi
Journal: PLOS ONE
Accepted: 2022-08-30T00:00:00Z


Although research on learning strategies has contributed to improving learners’ performance, most studies only described the characteristics of learners. These approaches have focused on inter-individual differences and their correlations, making it difficult to examine the process of selecting learning strategies in individuals. To examine the correlations within individual learners, such as the variables that influence the use of a strategy by a specific learner, two surveys were conducted in this study. Perceived cost and perceived benefit of using each strategy as the influential variables on choosing a strategy were adopted with reference to decision-making research. Perceived cost consisted of the time perspective for learning outcomes by the learning strategy and the method of learning strategy implementation. In Study 1, cognitive strategies that have a direct impact on the acquisition of learning content were measured, and metacognitive strategies that monitor and regulate one’s own learning behavior were examined in Study 2. The variables were treated for each individual to calculate intra-class and within-person correlations, although data were collected using a typical questionnaire survey in learning strategy studies. Hierarchical Bayesian modeling was conducted with use of the learning strategy as the objective variable and the perceived costs and benefits as explanatory variables. The analysis revealed that, in terms of cognitive strategies (Study 1), learners avoided using learning strategies perceived to have a high cost in the short term; however, they used cognitive strategies regardless of the circumstances. Furthermore, regarding metacognitive strategies (Study 2), students avoided using learning strategies that they perceived as costly to use in the short term and used them only when they suited the circumstances. On the other hand, in metacognitive strategies (Study 2), students avoided using learning strategies that they perceived as costly to use for the next test and use as appropriate for the situation. Focusing on within-individual variance and correlation made the interpretation of factors that influence the choice of learning strategies more intuitive and provided more suggestions for educational practice.
Denoising diffusion weighted imaging data using convolutional neural networks
Authors: Hu Cheng, Sophia Vinci-Booher, Jian Wang, Bradley Caron, Qiuting Wen, Sharlene Newman, Franco Pestilli
Journal: PLOS ONE
Accepted: 2022-08-26T00:00:00Z


Diffusion weighted imaging (DWI) with multiple, high b-values is critical for extracting tissue microstructure measurements; however, high b-value DWI images contain high noise levels that can overwhelm the signal of interest and bias microstructural measurements. Here, we propose a simple denoising method that can be applied to any dataset, provided a low-noise, single-subject dataset is acquired using the same DWI sequence. The denoising method uses a one-dimensional convolutional neural network (1D-CNN) and deep learning to learn from a low-noise dataset, voxel-by-voxel. The trained model can then be applied to high-noise datasets from other subjects. We validated the 1D-CNN denoising method by first demonstrating that 1D-CNN denoising resulted in DWI images that were more similar to the noise-free ground truth than comparable denoising methods, e.g., MP-PCA, using simulated DWI data. Using the same DWI acquisition but reconstructed with two common reconstruction methods, i.e. SENSE1 and sum-of-square, to generate a pair of low-noise and high-noise datasets, we then demonstrated that 1D-CNN denoising of high-noise DWI data collected from human subjects showed promising results in three domains: DWI images, diffusion metrics, and tractography. In particular, the denoised images were very similar to a low-noise reference image of that subject, more than the similarity between repeated low-noise images (i.e. computational reproducibility). Finally, we demonstrated the use of the 1D-CNN method in two practical examples to reduce noise from parallel imaging and simultaneous multi-slice acquisition. We conclude that the 1D-CNN denoising method is a simple, effective denoising method for DWI images that overcomes some of the limitations of current state-of-the-art denoising methods, such as the need for a large number of training subjects and the need to account for the rectified noise floor.
Migration is associated with baseline severity and progress over time in autism spectrum disorder: Evidence from a French prospective longitudinal study
Authors: Carlotta Bettencourt, Nicole Garret-Gloanec, Hugues Pellerin, Morgane Péré, Maria Squillante, Fabienne Roos-Weil, Léa Ferrand, Anne-Sophie Pernel, Gisèle Apter, David Cohen
Journal: PLOS ONE
Accepted: 2022-07-22T00:00:00Z

Background: The prevalence of autism-spectrum disorder (ASD) has been shown to be higher in migrant families, but it is also a challenge for health care professionals to offer adequate services to families that face multiple challenges. In the context of the EPIGRAM study (a French prospective, multisite, longitudinal observational study implementing integrative care practices (ICPs) for children with ASD), we aimed to assess the impact of migration on children with ASD. Method and findings: 89 children with ASD aged 3 to 6 years old (92% males) were recruited and followed up for 12 months. The children were clinically assessed using several instruments. At baseline, children had severe autism on average on the Children Autism Rating Scale (CARS, mean = 44; SD = 6.51) and moderate autism on the PsychoEducational profile-3-R (PEP-3-R) maladaptive behavior category (mean = 30; SD = 29.89). Thirty percent of the families had a low socio-economic status, and 56% were first-generation immigrants. For all clinical variables, children of immigrant parents had more severe autism and developmental delays at baseline. A linear mixed model established an improvement in all clinical characteristics over the 12 months of the study. This trend may be attributed to ICPs or any naturally occurring event during that period. Families shared this positive view over time. However, the improvements were slower for two clinical dimensions of the PEP-3-R in children from migrant families. For the inappropriate behavior category, the time effect diminished by an average of 0.83 percentile/month for children whose parents were migrants vs. children whose parents were non-migrants. Similarly, for verbal behavior characteristics, the time effect diminished by an average of 1.32 percentile/month for children whose parents were migrants vs. children whose parents were non-migrants. Conclusion: Despite an overall positive improvement, we found that migration is associated baseline severity and progress over time in children with ASD. There is an urgent need to target the migrant population with specific research and understand the avenues that carry such higher severity. Clinical trial registration: Study registration on clinicaltrials.gov under the number NCT02154828.
Grammar in ‘agrammatical’ aphasia: What’s intact?
Authors: Han Zhang, Wolfram Hinzen
Journal: PLOS ONE
Accepted: 2022-11-22T00:00:00Z

Background: Aphasia following cerebro-vascular accidents has been a primary source of insight for models of language in the brain. However, deviant language patterns in aphasia may reflect processing limitations and cognitive impairment more than language impairment per se. Aims: We sought to obtain new evidence from spontaneous speech in Broca’s aphasia (BA) for the intactness of grammatical knowledge, operationalized as the preservation of the basic hierarchical structure of syntactic projections. Methods & procedures: Speech obtained with the AphasiaBank protocol from 20 people with BA, which were independently rated as also being agrammatic, was analyzed and compared to 20 matched non-brain-damaged controls. We quantified (i) marking of Aspect, Tense, and Modality (A-T-M), which are located at specific (high) layers of the syntactic hierarchy and ordered in relation to one another ([M…[T…[A…]]]); (ii) hierarchies of clausal units ([C…[C]]); (iii) discourse markers embedding clauses, located at the highest layer of the hierarchy; and (iv) attachment of adjuncts at different heights of a given hierarchical syntactic structure. Supplementary evidence was obtained from a typology of errors and from pauses subcategorized according to their hierarchical syntactic position. Outcomes & results: Groups did not quantitatively differ on rates of either Aspect or Modality but underproduced T and embedded clauses. Evidence for compensatory effects was seen in both of the latter two cases. While all adjunct types were underproduced in BA, and pauses overproduced, both showed the same relative proportions within both groups. Errors were largely restricted to omissions, of a kind that would also be expected in condensed neurotypical speech. Conclusions: Overall, these patterns support the hypothesis of intactness of grammatical knowledge in BA clinically rated as agrammatic, questioning it as a disease model of language impairment.
Skilled motor control of an inverted pendulum implies low entropy of states but high entropy of actions
Authors: Nicola Catenacci Volpi, Martin Greaves, Dari Trendafilov, Christoph Salge, Giovanni Pezzulo, Daniel Polani
Journal: PLOS Computational Biology
Accepted: 2022-12-12T00:00:00Z


The mastery of skills, such as balancing an inverted pendulum, implies a very accurate control of movements to achieve the task goals. Traditional accounts of skilled action control that focus on either routinization or perceptual control make opposite predictions about the ways we achieve mastery. The notion of routinization emphasizes the decrease of the variance of our actions, whereas the notion of perceptual control emphasizes the decrease of the variance of the states we visit, but not of the actions we execute. Here, we studied how participants managed control tasks of varying levels of difficulty, which consisted of controlling inverted pendulums of different lengths. We used information-theoretic measures to compare the predictions of alternative accounts that focus on routinization and perceptual control, respectively. Our results indicate that the successful performance of the control task strongly correlates with the decrease of state variability and the increase of action variability. As postulated by perceptual control theory, the mastery of skilled pendulum control consists in achieving stable control of goals by flexible means.
Author summary: What characterises skilled behaviour? When one observes capable tennis players or other masters of their craft, their performance appears effortless, their behaviours purposeful and stable. This has been suggested in some traditional accounts to imply that mastery of a task is linked to highly routinised behaviours; such behaviours would concentrate on well-rehearsed routes. Others have proposed instead that mastery consists in keeping the states well confined during a behaviour; where necessary, actions would vary strongly to achieve that. Which of these is the case? Here, we undertake a study where participants have the task to balance an inverted pole. The length of the pole can be varied, which permitted us to control the difficulty of the task. Using methods from information theory, we set out to answer above question in the case of pole balancing control. We found that successful balancing correlates strongly with focused, well controlled states, but at the cost of having highly varying actions. In other words, a potentially wide choice of actions serves to maintain the system tightly in preferred states. According to these results, mastery (in this task) is not about choosing the same actions repeatably, but about reliably achieving the same outcomes.