PenguinMan/ARXIV huggingface dataset:
Adaptive learning through temporal dynamics of state representation
Authors: Razmi, N.; Nassar, M. R.
Category: neuroscience
Date: 2021-12-30

People adjust their learning rate rationally according to local environmental statistics and calibrate such adjustments based on the broader statistical context. To date, no theory has captured the observed range of adaptive learning behaviors or the complexity of its neural correlates. Here, we attempt to do so using a neural network model that learns to map an internal context representation onto a behavioral response via supervised learning. The network shifts its internal context upon receiving supervised signals that are mismatched to its output, thereby changing the "state" to which feedback is associated. A key feature of the model is that such state transitions can either increase learning or decrease learning depending on the duration over which the new state is maintained. Sustained state transitions that occur after changepoints facilitate faster learning and mimic network reset phenomena observed in the brain during rapid learning. In contrast, state transitions after one-off outlier events are short-lived, thereby limiting the impact of outlying observations on future behavior. State transitions in our model provide the first mechanistic interpretation for bidirectional learning signals, such the p300, that relate to learning differentially according to the source of surprising events and may also shed light on discrepant observations regarding the relationship between transient pupil dilations and learning. Taken together, our results demonstrate that dynamic latent state representations can afford normative inference and provide a coherent framework for understanding neural signatures of adaptive learning across different statistical environments.

Significance StatementHow humans adjust their sensitivity to new information in a changing world has remained largely an open question. Bridging insights from normative accounts of adaptive learning and theories of latent state representation, here we propose a feed-forward neural network model that adjusts its learning rate online by controlling the speed of transitioning its internal state representations. Our model proposes a mechanistic framework for explaining learning under different statistical contexts, explains previously observed behavior and brain signals, and makes testable predictions for future experimental studies.
Extensive Phenomenological Overlap between Induced and Naturally-Occurring Synaesthetic Experiences
Authors: Schwartzman, D. J.; Oblak, A.; Rothen, N.; Bor, D.; Seth, A. K.
Category: neuroscience
Date: 2020-08-04

Grapheme-colour synaesthesia (GCS) is defined by additional perceptual experiences, which are automatically and consistently triggered by specific inducing stimuli. The associative nature of GCS has motivated attempts to induce synaesthesia by means of associative learning. Two recent studies have shown that extensive associative training can generate not only behavioural (consistency and automaticity) and neurophysiological markers of GCS, but also synaesthesia-like phenomenology [1,2]. However, these studies provided only superficial descriptions regarding the training-related changes in subjective experience: they did not directly assess how closely induced synaesthetic experiences mirror those found in natural GCS. Here we report an extended qualitative analysis of the transcripts of the semi-structured interviews obtained following the completion of the associative training protocol used by [2]. In addition, we performed a comparable analysis of responses to an interview with a new population of natural occurring grapheme-colour synaesthetes (NOS), allowing us to directly compare the phenomenological dimensions of induced and naturally occurring synaesthetic experience. Our results provide an extensive addition to the description of the phenomenology of NOS experience, revealing a high degree of heterogeneity both within and across all experiential categories. Capitalising on this unique level of detail, we identified a number of shared experiential categories between NOS and induced synaesthesia-like (ISL) groups, including: stability of experience, location of colour experience, shape of co-occurring colour experience, relative strength of colour experience and automaticity of colour experience. Only the automaticity of colour experience differed significantly between the two groups: NOS experience was reported as being mostly automatic, whereas induced ISL were mostly described as being  wilful. We observed three additional experiential categories relating to the automaticity of synaesthetic experience within the NOS group: contextually varied experience, semi-automatic experience and reflective association, which suggests that, as with other experiential categories, the automaticity of synaesthetic experience is also highly heterogeneous. Our results provide new evidence that that intensive training of letter-colour associations can alter conscious perceptual experiences in non-synaesthetes, and that such alterations produce synaesthesia-like phenomenology which substantially resembles similarities to natural grapheme-colour synaesthesia.
Theta-burst TMS of lateral occipital cortex reduces BOLD responses across category-selective areas in ventral temporal cortex
Authors: Groen, I. I. A.; Silson, E. H.; Pitcher, D.; Baker, C. I.
Category: neuroscience
Date: 2020-12-03

Human visual cortex contains three scene-selective regions in the lateral, medial and ventral cortex, termed the occipital place area (OPA), medial place area (MPA) and parahippocampal place area (PPA). Using functional magnetic resonance imaging (fMRI), all three regions respond more strongly when viewing visual scenes compared with isolated objects or faces. To determine how these regions are functionally and causally connected, we applied transcranial magnetic stimulation to OPA and measured fMRI responses before and after stimulation, using a theta-burst paradigm (TBS). To test for stimulus category-selectivity, we presented a range of visual categories (scenes, buildings, objects, faces). To test for specificity of any effects to TBS of OPA we employed two control conditions: Sham, with no TBS stimulation, and an active TBS-control with TBS to a proximal face-selective cortical region (occipital face area, or OFA). We predicted that TBS to OPA (but not OFA) would lead to decreased responses to scenes and buildings (but not other categories) in other scene-selective cortical regions. Across both ROI and whole-volume analyses, we observed decreased responses to scenes in PPA as a result of TBS. However, these effects were neither category specific, with decreased responses to all stimulus categories, nor limited to scene-selective regions, with decreases also observed in face-selective fusiform face area (FFA). Furthermore, similar effects were observed with TBS to OFA, thus effects were not specific to the stimulation site in the lateral occipital cortex. Whilst these data are suggestive of a causal, but non-specific relationship between lateral occipital and ventral temporal cortex, we discuss several factors that could have underpinned this result, such as the differences between TBS and online TMS, the role of anatomical distance between stimulated regions and how TMS effects are operationalised. Furthermore, our findings highlight the importance of active control conditions in brain stimulation experiments to accurately assess functional and causal connectivity between specific brain regions.
Brain Anatomical Covariation Patterns Linked to Binge Drinking and Age at First Full Drink Prior to 21 Years
Authors: Zhao, Y.; Constable, R. T.; Hien, D.; Chung, T.; Potenza, M.
Category: neuroscience
Date: 2020-08-04

Binge drinking and age at first full drink of alcohol prior to 21 years (AFD<21) have been linked to neuroanatomical differences in cortical and subcortical grey matter (GM) volume, cortical thickness, and surface area. Despite the potential to reveal novel network-level relationships, structural covariation patterns among these morphological measures have yet to be examined relative to binge drinking and AFD<21. Here, we used the Joint and Individual Variance Explained (JIVE) method to characterize structural covariation patterns common across and specific to morphological measures in 293 participants (149 individuals with binge drinking and 144 healthy controls) from the Human Connectome Project (HCP). An independent dataset (Nathan Kline Institute Rockland Sample; NKI-RS) was used to examine reproducibility/ generalizability. We identified a highly reproducible joint component dominated by structural covariation between GM volume in the brainstem and thalamus proper, and GM volume and surface area in prefrontal cortical regions. Using linear mixed regression models, we found that this joint component was related to AFD<21 in both the HCP and NKI-RS datasets, whereas the individual thickness component associated with binge drinking and AFD<21 in the HCP dataset was not statistically significant in the NKI-RS sample. Taken together, our results show that a highly reproducible structural pattern involving covariation in brain regions relevant to thalamic-PFC-brainstem neural circuitry is linked to age at first full drink.
Greater TMS-evoked frontoparietal effective connectivity is correlated with better cognitive performance
Authors: Morris, T. P.; Redondo-Camos, M.; Cattaneo, G.; Macia, D.; Solana_Sanchez, J.; Espana-Irla, G.; Delgado-Galen, S.; Alviarez-Schulze, V.; Pachon Garcia, C.; Santarnecchi, E.; Tadayon, E.; Ozdemir, R.; Tormos-Munoz, J. M.; Bartres-Faz, D.; Pascual-Leone, A.; Shafi, M.
Category: neuroscience
Date: 2020-08-04

Fronto-parietal activity has been related to fluid intelligence and flexible cognitive control. However, causal insights on this relation are lacking. We used real-time integration of MRI-guided TMS and EEG to characterize the spatial and temporal properties of signal propagation between these two regions and relate them to cognitive performance.

31 healthy adults (55 {+/-}6 years, 20 female) underwent TMS-EEG and a full cognitive assessment. Local and propagated current from 5 source space-reconstructed scouts ipsilateral to two stimulation sites (pre frontal cortex (PFC) and inferior parietal lobule (IPL)) was quantified in two-time windows (15-40ms and 40-80ms) and related to domain-general (global cognition) and domain-specific (memory, working memory, reasoning, flexibility, lexical access and visuo-spatial) cognitive functions.

TMS-evoked activity from stimulation of the PFC and the IPL resulted in local and distributed activity across frontoparietal regions. TMS-evoked activity in local regions was not correlated with cognitive functions. In response to TMS of the PFC, propagated current to the distal superior parietal scout in the first 15-40ms was significantly associated with global cognition ({beta} = 2.63, SE = .898, p = .008, R2 = .31). Similarly, following TMS of the IPL, propagation to the middle prefrontal gyrus scout (15-40ms) was significantly associated with global cognition ({beta} = 2.67, SE = 1.289, p = .025, R2 = .27). In an exploratory step, domain-specific correlations were seen in the PFC condition.

Locally evoked activity measured via source space reconstruction from TMS of two association hubs is not associated with cognitive functions. However, the propagation of the TMS pulse through frontoparietal connections is associated with overall cognitive ability. These associations are driven by a number of cognitive domains in the PFC stimulation condition.
Predictive visual motion extrapolation emerges spontaneously and without supervision at each layer of a hierarchical neural network with spike-timing-dependent plasticity
Authors: Burkitt, A. N.; Hogendoorn, H.
Category: neuroscience
Date: 2021-02-05

The fact that the transmission and processing of visual information in the brain takes time presents a problem for the accurate real-time localisation of a moving object. One way this problem might be solved is extrapolation: using an objects past trajectory to predict its location in the present moment. Here, we investigate how a simulated in silico layered neural network might implement such extrapolation mechanisms, and how the necessary neural circuits might develop. We allowed an unsupervised hierarchical network of velocity-tuned neurons to learn its connectivity through spike-timing dependent plasticity. We show that the temporal contingencies between the different neural populations that are activated by an object as it moves causes the receptive fields of higher-level neurons to shift in the direction opposite to their preferred direction of motion. The result is that neural populations spontaneously start to represent moving objects as being further along their trajectory than where they were physically detected. Due to the inherent delays of neural transmission, this effectively compensates for (part of) those delays by bringing the represented position of a moving object closer to its instantaneous position in the world. Finally, we show that this model accurately predicts the pattern of perceptual mislocalisation that arises when human observers are required to localise a moving object relative to a flashed static object (the flash-lag effect).

Significance StatementOur ability to track and respond to rapidly changing visual stimuli, such as a fast moving tennis ball, indicates that the brain is capable of extrapolating the trajectory of a moving object in order to predict its current position, despite the delays that result from neural transmission. Here we show how the neural circuits underlying this ability can be learned through spike-timing dependent synaptic plasticity, and that these circuits emerge spontaneously and without supervision. This demonstrates how the neural transmission delays can, in part, be compensated to implement the extrapolation mechanisms required to predict where a moving object is at the present moment.
Control of aperture closure during reach-to-grasp movements in immersive haptic-free virtual reality
Authors: Mangalam, M.; Yarossi, M.; Furmanek, M. P.; Tunik, E.
Category: neuroscience
Date: 2021-03-07

Virtual reality (VR) has garnered much interest as a training environment for motor skill acquisition, including for neurological rehabilitation of upper extremities. While the focus has been on gross upper limb motion, VR applications that involve reaching for, and interacting with, virtual objects are growing. The absence of true haptics in VR when it comes to hand-object interactions raises a fundamentally important question: can haptic-free immersive virtual environments (hf-VEs) support naturalistic coordination of reach-to-grasp movements? This issue has been grossly understudied, and yet is of significant importance in the development and application of VR across a number of sectors. In a previous study (Furmanek et al. 2019), we reported that reach-to-grasp movements are similarly coordinated in both the physical environment (PE) and hf-VE. The most noteworthy difference was that the closure phase--which begins at maximum aperture and lasts through the end of the movement--was longer in hf-VE than in PE, suggesting that different control laws might govern the initiation of closure between the two environments. To do so, we reanalyzed data from Furmanek et al. (2019), in which the participants reached to grasp three differently sized physical objects, and matching 3D virtual object renderings, placed at three different locations. Our analysis revealed two key findings pertaining to the initiation of closure in PE and hf-VE. First, the respective control laws governing the initiation of aperture closure in PE and hf-VE both included state estimates of transport velocity and acceleration, supporting a general unified control policy for implementing reach-to-grasp across physical and virtual environments. Second, aperture was less informative to the control law in hf-VE. We suggest that the latter was likely because transport velocity at closure onset and aperture at closure onset were less independent in hf-VE than in PE, ultimately resulting in aperture at closure onset having a weaker influence on the initiation of closure. In this way, the excess time and muscular effort needed to actively bring the fingers to a stop at the interface of a virtual object was factored into the control law governing the initiation of closure in hf-VE. Critically, this control law remained applicable, albeit with different weights in hf-VE, despite the absence of terminal haptic feedback and potential perceptual differences.
Dynamic encoding of saccade sequences in primate frontal eye field
Authors: Jia, J.; Puyang, Z.; Wang, Q.; Jin, X.; Chen, A.
Category: neuroscience
Date: 2020-10-01

AO_SCPLOWBSTRACTC_SCPLOWFrontal eye field (FEF) is a key part of oculomotor system, with dominant responses to the direction of single saccades. However, whether and how FEF contributes to sequential saccades remain largely unknown. Here by training rhesus monkeys to perform sequential saccades and recording the neuronal activities in FEF, we found that the sequence-related activities are clearly represented in FEF, and many neurons selectivity to saccade direction undergoes dynamic changes during sequential task. In addition, the sequence-related activities are context-dependent, with different firing activities during memory- versus visually-guided sequence. Supra-threshold microstimulation in FEF evokes saccade without altering the overall sequence structure. Pharmacological inactivation of FEF severely impaired the monkeys performance of sequential saccades, with different effects on the same actions at different positions within the sequence. These results reveal the context-dependent dynamic encoding of saccade direction in FEF, and underscore a critical role of FEF in planning and execution of sequential saccades.

IO_SCPLOWNC_SCPLOW BO_SCPLOWRIEFC_SCPLOWJia, Puyang et al. employed in vivo recording to reveal the dynamic encoding of sequential saccades in primate frontal eye field (FEF), then used electric microstimulation and reversible inactivation to demonstrate the causal role of FEF in controlling saccade sequences.

HO_SCPLOWIGHLIGHTSC_SCPLOWO_LIFEF neurons respond differently during sequential vs. single saccades
C_LIO_LISequence-related FEF activity is context-dependent
C_LIO_LIFEF microstimulation induced saccade without altering sequence structure
C_LIO_LIFEF inactivation severely impaired the performance of sequential saccades
C_LI
Visual Perception in the Periphery: The Role of Covert Attention Vectors in the Extraction of Semantic Information
Authors: Suri, I.; Wilson, P. M.; Doustmohammadi, S.; De Schutter, A.; Chunwatanapong, T. S.; Tan, J.; Varadharajulu, S. D.; O'Connell, N. H.; Lai, A.; Dureja, S.; Govin, R. J. P.; Arisaka, K.; Mills, E. A. F.
Category: neuroscience
Date: 2020-08-04

Under covert attention, our visual perception deteriorates dramatically as eccentricity increases. This reduction of peripheral visual acuity (PVA) is partially due to the coarse sampling of the retinal ganglion cells towards the periphery, but this property cannot be solely responsible. Other factors, such as character crowding, have been studied, yet the origin of the poor PVA is not entirely understood. This gap motivated us to investigate the PVA by varying the crowding conditions systematically. Under completely crowded conditions (i.e. resembling a full page of text), PVA was observed to be eight times worse than the PVA under uncrowded conditions. By partially crowding the periphery, we obtained PVA values between the fully crowded and uncrowded conditions. On the other hand, crowding the fovea center while leaving the periphery uncrowded improved PVA relative to the uncrowded case. These results support a model for a top-down "covert attention vector" that assists the resulting PVA in a manner analogous to saccadic eye movement for overt attention. We speculate that the attention vector instructs the dorsal pathway to transform the peripheral character to the foveal center. Then, the scale-invariant log-polar retinotopy of the ventral pathway can scale the centered visual input to match the prior memory of the specific character shape.
Effect of Handedness on Learned Controllers and Sensorimotor Noise During Trajectory-Tracking
Authors: Yamagami, M.; Peterson, L. N.; Howell, D. B.; Roth, E.; Burden, S. A.
Category: neuroscience
Date: 2021-06-11

In human-in-the-loop control systems, operators can learn to manually control dynamic machines with either hand using a combination of reactive (feedback) and predictive (feed-forward) control. This paper studies the effect of handedness on learned controllers and performance during a trajectory-tracking task. In an experiment with 18 participants, subjects perform an assay of unimanual trajectory-tracking and disturbance-rejection tasks through second-order machine dynamics, first with one hand then the other. To assess how hand preference (or dominance) affects learned controllers, we extend, validate, and apply a non-parametric modeling method to estimate the concurrent feedback and feedforward controllers. We find that performance improves because feedback adapts, regardless of the hand used. We do not detect statistically significant differences in performance or learned controllers between hands. Adaptation to reject disturbances arising exogenously (i.e. applied by the experimenter) and endogenously (i.e. generated by sensorimotor noise) explains observed performance improvements.
Dynamics of task-related electrophysiological networks: a benchmarking study
Authors: Tabbal, J.; Kabbara, A.; Khalil, M.; Benquet, P.; Hassan, M.
Category: neuroscience
Date: 2020-08-04

Motor, sensory and cognitive functions rely on dynamic reshaping of functional brain networks. Tracking these rapid changes is crucial to understand information processing in the brain, but challenging due to the random selection of methods and the limited evaluation studies. Using Magnetoencephalography (MEG) combined with Source Separation (SS) methods, we present an integrated framework to track fast dynamics of electrophysiological brain networks. We evaluate nine SS methods applied to three independent MEG databases (N=95) during motor and memory tasks. We report differences between these methods at the group and subject level. We show that the independent component analysis (ICA)-based methods and especially those exploring high order statistics are the most efficient, in terms of spatiotemporal accuracy and subject-level analysis. We seek to help researchers in choosing objectively the appropriate methodology when tracking fast reconfiguration of functional brain networks, due to its enormous benefits in cognitive and clinical neuroscience.