The Neural Mechanisms Underlying Invariant Object Search In V4 And Inferotemporal Cortex

Finding a specific visual target, such as your car keys, requires the brain to combine visual information about objects in the currently viewed scene with working memory information about your target to determine whether your target is in view. This combination of context-specific signals with visual information is thought to happen via feedback of target information from higher brain areas to the ventral visual pathway. However, exactly where and how these signals are combined remains unknown. To investigate, we recorded neural responses in V4 and inferotemporal cortex (IT) while monkeys performed an invariant object search task, where targets could appear across variation in their size, position and background context. We applied two complementary approaches to this data to investigate the neural mechanisms underlying target search. The first approach (Chapter 2) is from a computational perspective: where and how are visual and target signals combined when searching for a target? Specifically, we found that while task-relevant modulations in V4 were large, they were larger in IT, suggesting that top-down context-specific modulations are integrated into the ventral visual pathway at multiple stages. In Chapter 3, we focused on the neural responses recorded from IT from the perspective of neural coding: we sought to understand how signal and noise combine to determine task performance. We found that while signals that report the solution for object search were much smaller than signals that act as noise for the task (nuisance modulations) in IT cortex, nuisance modulations had a small effect on task performance. This counterintuitive finding was due to large trial variability constrained by short, behaviorally relevant spike counting windows. Together, this body of work provides insight into where and how the brain combines context-specific signals with visual information during invariant object search. Degree Type Dissertation Degree Name Doctor of Philosophy (PhD) Graduate Group Neuroscience First Advisor Nicole C. Rust Subject Categories Neuroscience and Neurobiology This dissertation is available at ScholarlyCommons: https://repository.upenn. edu/edissertations/2938 THE NEURAL MECHANISMS UNDERLYING INVARIANT OBJECT SEARCH IN V4 AND INFEROTEMPORAL CORTEX Noam Roth A DISSERTATION in Neuroscience Presented to the Faculties of the University of Pennsylvania in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy 2018 Supervisor of Dissertation Graduate Group Chairperson ____________________ _______________________ Nicole Rust, PhD Joshua Gold, PhD Associate Professor of Psychology Professor of Neuroscience Dissertation Committee: Yale Cohen, PhD, Professor of Otorhinolaryngology (Committee Chair) Joshua Gold, PhD, Professor of Neuroscience Kostas Daniilidis, PhD, Professor of Computer and Information Science Marlene Cohen, PhD, Associate Professor of Neuroscience THE NEURAL MECHANISMS UNDERLYING INVARIANT OBJECT SEARCH IN V4 AND INFEROTEMPORAL CORTEX COPYRIGHT 2018 Noam Roth This work is licensed under the Creative Commons AttributionNonCommercial-ShareAlike 3.0 License To view a copy of this license, visit https://creativecommons.org/licenses/by-­‐nc-­‐sa/3.0/us/