Newly trained lexical categories produce lateralized categorical perception of color

Linguistic categories have been shown to influence perceptual discrimination, to do so preferentially in the right visual field, to fail to do so when competing demands are made on verbal memory, and to vary with the color-term boundaries of different languages. However, because there are strong commonalities across languages in the placement of color-term boundaries, the question remains open whether observed categorical perception for color can be entirely a result of learned categories or may rely to some degree on innate ones. We show here that lateralized color categorical perception can be entirely the result of learned categories. In a visual search task, reaction times to targets were faster in the right than the left visual field when the target and distractor colors, initially sharing the same linguistic term (e.g., “blue”), became between-category colors after training (i.e., when two different shades of blue had each acquired a new name). A control group, whose conditions exactly matched those of the experimental group except that no new categories were introduced, did not show this effect, establishing that the effect was not dependent on increased familiarity with either the color stimuli or the task. The present results show beyond question that lateralized categorical perception of color can reflect strictly learned color categories, even artificially learned categories that violate both universal tendencies in color naming and the categorization pattern of the language of the subject.

Related papers:

title: What is the Sapir-Whorf hypothesis?
abstract: Experimental evidence from the domain of color perception is presented for a version of the Sapir-Whorf hypothesis that is considerably weaker than the version usually proposed.

title: Turkish color terms: tests of Berlin and Kay’s theory of color universals and linguistic relativity
abstract: We report a study of Turkish color terms with four main aims: to establish the inventory of BASIC color terms; to compare this inventory with Berlin and Kay's 11 color universals; to see if Turkish is an exception to the theory by having two basic terms for blue; and if it is, to explore whether there are cognitive effects of the two blue terms. Eighty children aged from eight to 14 years and 153 adults performed a color-term list task (write down as many color terms as you can) and a subset of these two samples went on to perform a color-naming task. In the naming task, they were asked to name 65 representative color tiles. Measures of salience and consensus derived from the two tasks converge to suggest that Turkish has 12 basic color terms. The denotations of these terms and the glosses provided by dictionaries and Turkish-speaking consultants are consistent with 11 of the terms being Turkish tokens of Berlin and Kay's 11 universal categories. The twelfth term - lacivert dark blue'- lies between the foci of the universal blue and purple and its range overlaps with the dark-blue term of Russian, sinij. However, in a third phase of the investigation, the majority of informants said that lacivert dark blue' was a kind of mavi blue', thus violating one of Berlin and Kay's criteria (noninclusion) for basicness. Thus we have the unusual, but logically possible, case of a term being used with prevalence, consensus, and specificity, while at the same time being acknowledged as a subset of another term. Whatever the status of the two blue terms, however, we found evidence that the cognitive representation of the blue region of color space may reflect the salience of the two blue terms using color grouping, similarity judgments, and same different tasks

title: The categorical perception of colors and facial expressions: The effect of verbal interference
abstract: A series of five experiments examined the categorical perception previously found for color and facial expressions. Using a two-alternative forced-choice recognition memory paradigm, it was found that verbal interference selectively removed the defining feature of categorical perception. Under verbal interference, there was no longer the greater accuracy normally observed for cross-category judgments relative to within-category judgments. The advantage for cross-category comparisons in memory appeared to derive from verbal coding both at encoding and at storage. It thus appears that while both visual and verbal codes may be employed in the recognition memory for colors and facial expressions, subjects only made use of verbal coding when demonstrating categorical perception.

title: Support for lateralization of the Whorf effect beyond the realm of color discrimination
abstract: Recent work has shown that Whorf effects of language on color discrimination are stronger in the right visual field than in the left. Here we show that this phenomenon is not limited to color: The perception of animal figures (cats and dogs) was more strongly affected by linguistic categories for stimuli presented to the right visual field than those presented to the left. Moreover, the magnitude of the visual field asymmetry was reduced when demands on verbal working memory were increased by a secondary task. This reduction did not occur when the secondary task imposed demands on spatial working memory. Taken together, these results demonstrate that the lateralized Whorf effect may be quite general, reflecting an interaction of linguistic and perceptual codes primarily in the left hemisphere.

title: Whorf hypothesis is supported in the right visual field but not the left.
abstract: The question of whether language affects perception has been debated largely on the basis of cross-language data, without considering the functional organization of the brain. The nature of this neural organization predicts that, if language affects perception, it should do so more in the right visual field than in the left visual field, an idea unexamined in the debate. Here, we find support for this proposal in lateralized color discrimination tasks. Reaction times to targets in the right visual field were faster when the target and distractor colors had different names; in contrast, reaction times to targets in the left visual field were not affected by the names of the target and distractor colors. Moreover, this pattern was disrupted when participants performed a secondary task that engaged verbal working memory but not a task making comparable demands on spatial working memory. It appears that people view the right (but not the left) half of their visual world through the lens of their native language, providing an unexpected resolution to the language-and-thought debate.

title: Russian blues reveal effects of language on color discrimination
abstract: English and Russian color terms divide the color spectrum differently. Unlike English, Russian makes an obligatory distinction between lighter blues (“goluboy”) and darker blues (“siniy”). We investigated whether this linguistic difference leads to differences in color discrimination. We tested English and Russian speakers in a speeded color discrimination task using blue stimuli that spanned the siniy/goluboy border. We found that Russian speakers were faster to discriminate two colors when they fell into different linguistic categories in Russian (one siniy and the other goluboy) than when they were from the same linguistic category (both siniy or both goluboy). Moreover, this category advantage was eliminated by a verbal, but not a spatial, dual task. These effects were stronger for difficult discriminations (i.e., when the colors were perceptually close) than for easy discriminations (i.e., when the colors were further apart). English speakers tested on the identical stimuli did not show a category advantage in any of the conditions. These results demonstrate that (i) categories in language affect performance on simple perceptual color tasks and (ii) the effect of language is online (and can be disrupted by verbal interference).

title: Further evidence that Whorfian effects are stronger in the right visual field than the left
abstract: The Whorf hypothesis holds that differences between languages induce differences in perception and/or cognition in their speakers. Much of the experimental work pursuing this idea has focused on the domain of color and has centered on the issue of whether linguistically coded color categories influence color discrimination. A new perspective has been cast on the debate by recent results that suggest that language influences color discrimination strongly in the right visual field but not in the left visual field (LVF). This asymmetry is likely related to the contralateral projection of visual fields to cerebral hemispheres and the specialization of the left hemisphere for language. The current study presents three independent experiments that replicate and extend these earlier results by using different tasks and testing across different color category boundaries. Our results differ in one respect: although we find that Whorfian effects on color are stronger for stimuli in the right visual field than in the LVF, we find that there are significant category effects in the LVF as well. The origin of the significant category effect in the LVF is considered, and two factors that might account for the pattern of results are proposed.

title: Categorical perception of colour in the left and right visual field is verbally mediated: Evidence from Korean
abstract: In this study we demonstrate that Korean (but not English) speakers show Categorical perception (CP) on a visual search task for a boundary between two Korean colour categories that is not marked in English. These effects were observed regardless of whether target items were presented to the left or right visual field. Because this boundary is unique to Korean, these results are not consistent with a suggestion made by Drivonikou [Drivonikou, G. V., Kay, P., Regier, T., Ivry, R. B., Gilbert, A. L., Franklin, A. et al. (2007) Further evidence that Whorfian effects are stronger in the right visual field than in the left. Proceedings of the National Academy of Sciences 104, 1097-1102] that CP effects in the left visual field provide evidence for the existence of a set of universal colour categories. Dividing Korean participants into fast and slow responders demonstrated that fast responders show CP only in the right visual field while slow responders show CP in both visual fields. We argue that this finding is consistent with the view that CP in both visual fields is verbally mediated by the left hemisphere language system.

title: The structure of the color space in naming and memory for two languages
abstract: Ss from two cultures with markedly different color terminologies were tested on two color-judgment tasks. One was a nonverbal task of color matching from memory, while the other was a verbal task of color-naming. Both tasks were performed by 41 American Ss and 40 New Guinea Dani (who have a basically two-term color language). Multidimensional scaling based upon the four resulting sets of data yielded structures that were more similar under the memory condition than under the naming condition. For neither culture were equally distant colors confused in memory more within than across name boundaries. Retention of color images in short-term memory appears to be unaffected by wide cultural differences in the semantic reference of color words.

title: Categorical perception of color is lateralized to the right hemisphere in infants, but to the left hemisphere in adults
abstract: Both adults and infants are faster at discriminating between two colors from different categories than two colors from the same category, even when between- and within-category chromatic separation sizes are equated. For adults, this categorical perception (CP) is lateralized; the category effect is stronger for the right visual field (RVF)–left hemisphere (LH) than the left visual field (LVF)–right hemisphere (RH). Converging evidence suggests that the LH bias in color CP in adults is caused by the influence of lexical color codes in the LH. The current study investigates whether prelinguistic color CP is also lateralized to the LH by testing 4- to 6-month-old infants. A colored target was shown on a differently colored background, and time to initiate an eye movement to the target was measured. Target background pairs were either from the same or different categories, but with equal target-background chromatic separations. Infants were faster at initiating an eye movement to targets on different-category than same-category backgrounds, but only for targets in the LVF–RH. In contrast, adults showed a greater category effect when targets were presented to the RVF–LH. These results suggest that whereas color CP is stronger in the LH than RH in adults, prelinguistic CP in infants is lateralized to the RH. The findings suggest that language-driven CP in adults may not build on prelinguistic CP, but that language instead imposes its categories on a LH that is not categorically prepartitioned.

title: Lateralization of categorical perception of color changes with color term acquisition
abstract: Categorical perception (CP) of color is the faster and more accurate discrimination of two colors from different categories than two colors from the same category, even when same- and different-category chromatic separations are equated. In adults, color CP is lateralized to the left hemisphere (LH), whereas in infants, it is lateralized to the right hemisphere (RH). There is evidence that the LH bias in color CP in adults is due to the influence of color terms in the LH. Here we show that the RH to LH switch in color CP occurs when the words that distinguish the relevant category boundary are learned. A colored target was shown in either the left- or right-visual field on either the same- or different-category background, with equal hue separation for both conditions. The time to initiate an eye movement toward the target from central fixation at target onset was recorded. Color naming and comprehension was assessed. Toddlers were faster at detecting targets on different- than same-category backgrounds and the extent of CP did not vary with level of color term knowledge. However, for toddlers who knew the relevant color terms, the category effect was found only for targets in the RVF (LH), whereas for toddlers learning the color terms, the category effect was found only for targets in the LVF (RH). The findings suggest that lateralization of color CP changes with color term acquisition, and provide evidence for the influence of language on the functional organization of the brain.

title: Neural correlates of colour categories
abstract: This study used an electrophysiological marker of visual detection to investigate adults' processing of colour difference. Event-related potentials were collected from the identical colour (green: G0) presented as the frequent or infrequent stimulus within different colour contexts. Critically, we compared differences within the same colour category (G0 vs. green: G1) to differences between colour categories (G0 vs. blue and G0 vs. red). All differences showed a change-related positivity with similar scalp distribution. It was, however, not simply the magnitude of colour difference that reduced the latencies of the change-related positivity. A change in colour category without a magnitude difference also reduced latency of the event-related potential. Thus, for the first time we report an independent neural correlate of a colour category.

title: Language affects patterns of brain activation associated with perceptual decision
abstract: Well over half a century ago, Benjamin Lee Whorf [Carroll JB (1956) Language, Thought, and Reality: Selected Writings of Benjamin Lee Whorf (MIT Press, Cambridge, MA)] proposed that language affects perception and thought and is used to segment nature, a hypothesis that has since been tested by linguistic and behavioral studies. Although clear Whorfian effects have been found, it has not yet been demonstrated that language influences brain activity associated with perception and/or immediate postperceptual processes (referred hereafter as “perceptual decision”). Here, by using functional magnetic resonance imaging, we show that brain regions mediating language processes participate in neural networks activated by perceptual decision. When subjects performed a perceptual discrimination task on easy-to-name and hard-to-name colored squares, largely overlapping cortical regions were identified, which included areas of the occipital cortex critical for color vision and regions in the bilateral frontal gyrus. Crucially, however, in comparison with hard-to-name colored squares, perceptual discrimination of easy-to-name colors evoked stronger activation in the left posterior superior temporal gyrus and inferior parietal lobule, two regions responsible for word-finding processes, as demonstrated by a localizer experiment that uses an explicit color patch naming task. This finding suggests that the language-processing areas of the brain are directly involved in visual perceptual decision, thus providing neuroimaging support for the Whorf hypothesis.

title: Language regions of brain are operative in color perception
abstract: The effect of language on the categorical perception of color is stronger for stimuli in the right visual field (RVF) than in the left visual field, but the neural correlates of the behavioral RVF advantage are unknown. Here we present brain activation maps revealing how language is differentially engaged in the discrimination of colored stimuli presented in either visual hemifield. In a rapid, event-related functional MRI study, we measured subjects' brain activity while they performed a visual search task. Compared with colors from the same lexical category, discrimination of colors from different linguistic categories provoked stronger and faster responses in the left hemisphere language regions, particularly when the colors were presented in the RVF. In addition, activation of visual areas 2/3, responsible for color perception, was much stronger for RVF stimuli from different linguistic categories than for stimuli from the same linguistic category. Notably, the enhanced activity of visual areas 2/3 coincided with the enhanced activity of the left posterior temporoparietal language region, suggesting that this language region may serve as a top-down control source that modulates the activation of the visual cortex. These findings shed light on the brain mechanisms that underlie the hemifield- dependent effect of language on visual perception.

title: Language and perceptual categorisation
abstract: In a pioneering set of experiments, Rosch investigated the colour processing of a remote traditional culture. It was concluded that colours form universally natural and salient categories. However, our own cross-cultural research, backed up by neuropsychological data and interference studies, indicates that perceptual categories are derived from the words in the speaker's language. The new data support a rather strong version of the Whorfian view that perceptual categories are organized by the linguistic systems of our mind.

title: Language, thought and color: recent developments
abstract: The classic issue of color naming and color cognition has been re-examined in a recent series of articles. Here, we review these developments, and suggest that they move the field beyond a familiar rhetoric of 'nature versus nurture', or 'universals versus relativity', to new concepts and new questions.

title: Influences of categorization on perceptual discrimination.
abstract: Four experiments investigated the influence of categorization training on perceptual discrimination. Ss were trained according to 1 of 4 different categorization regimes. Subsequent to category learning, Ss performed a Same-Different judgment task. Ss' sensitivities (d's) for discriminating between items that varied on category-(ir)relevant dimensions were measured. Evidence for acquired distinctiveness (increased perceptual sensitivity for items that are categorized differently) was obtained. One case of acquired equivalence (decreased perceptual sensitivity for items that are categorized together) was found for separable, but not integral, dimensions. Acquired equivalence within a categorization-relevant dimension was never found for either integral or separable dimensions. The relevance of the results for theories of perceptual learning, dimensional attention, categorical perception, and categorization are discussed.

title: Psychophysical and cognitive aspects of categorical perception: A critical overview
abstract: Categorization is a very basic cognitive activity. It is involved in
 any task that calls for differential responding, from operant discrimination to
 pattern recognition to naming and describing objects and states-of-affairs.
 Explanations of categorization range from nativist theories denying that any
 nontrivial categories are acquired by learning to inductivist theories claiming
 that most categories are learned. "Categorical perception" (CP) is the name
 given to a suggestive perceptual phenomenon that may serve as a useful
 model for categorization in general: For certain perceptual categories,
 within-category differences look much smaller than between-category
 differences even when they are of the same size physically. For example, in
 color perception, differences between reds and differences between yellows
 look much smaller than equal-sized differences that cross the red/yellow
 boundary; the same is true of the phoneme categories /ba/ and /da/. Indeed,
 the effect of the category boundary is not merely quantitative, but qualitative.

title: Basic Color Terms: Their Universality and Evolution
abstract: Preface Introduction 1. The data, hypothesis, and general findings 2. Evolution of basic color terms 3. The data 4. Summary of results and some speculations

title: Resolving the question of color naming universals
abstract: The existence of cross-linguistic universals in color naming is currently contested. Early empirical studies, based principally on languages of industrialized societies, suggested that all languages may draw on a universally shared repertoire of color categories. Recent work, in contrast, based on languages from nonindustrialized societies, has suggested that color categories may not be universal. No comprehensive objective tests have yet been conducted to resolve this issue. We conduct such tests on color naming data from languages of both industrialized and nonindustrialized societies and show that strong universal tendencies in color naming exist across both sorts of language.

title: Focal colors are universal after all.
abstract: It is widely held that named color categories in the world's languages are organized around universal focal colors and that these focal colors tend to be chosen as the best examples of color terms across languages. However, this notion has been supported primarily by data from languages of industrialized societies. In contrast, recent research on a language from a nonindustrialized society has called this idea into question. We examine color-naming data from languages of 110 nonindustrialized societies and show that (i) best-example choices for color terms in these languages cluster near the prototypes for English white, black, red, green, yellow, and blue, and (ii) best-example choices cluster more tightly across languages than do the centers of category extensions, suggesting that universal best examples (foci) may be the source of universal tendencies in color naming.

title: The nature of learned categorical perception effects: a psychophysical approach
abstract: Categorical perception is often cited as a striking example of cognitive influences on perception. However, some evidence suggests the term is a misnomer, with effects based on cognitive not perceptual processing. Here, using a psychophysical approach, we provide evidence consistent with a learned categorical perception effect that is dependent on analysis within the visual processing stream. An improvement in participants' discrimination between grating patterns that they had learned to place in different categories was 'tuned' around the orientation of the patterns experienced during category learning. Thus, here, categorical perception may result from attentionally modulated perceptual learning about diagnostic category features, based upon orientation-selective stages of analysis. This argues strongly that category learning can alter our perception of the world.

title: Language, Learning, and Color Perception
abstract: People perceive colors categorically. But what is the role of the environment (or nurture)—specifically, language—in color perception? The effects of language on the way people categorize and perceive colors have been considered to be minimal, but recent evidence suggests that language may indeed change color perception. Speakers of languages with different color-name repertoires show differences in the way they perceive color. Research shows that categorical effects on color perception can be induced through laboratory training and suggests language can similarly change color perception through the mechanism of perceptual learning.

title: Acquisition of categorical color perception: a perceptual learning approach to the linguistic relativity hypothesis.
abstract: Color perception can be categorical: Between-category discriminations are more accurate than equivalent within-category discriminations. The effects could be inherited, learned, or both. The authors provide evidence that supports the possibility of learned categorical perception (CP). Experiment 1 demonstrated that observers' color discrimination is flexible and improves through repeated practice. Experiment 2 demonstrated that category learning simulates effects of "natural" color categories on color discrimination. Experiment 3 investigated the time course of acquired CP. Experiment 4 found that CP effects are acquired through hue- and lightness-based category learning and obtained interesting data on the dimensional perception of color. The data are consistent with the possibility that language may shape color perception and suggest a plausible mechanism for the linguistic relativity hypothesis.

title: The N2pc component in ERP and the lateralization effect of language on color perception
abstract: This study examined the electrophysiological bases of the effect of language on color perception. In a visual search task, a target was presented to the left or right visual field. The target color was either from the same category as a set of distractors (within-category condition) or from a different category (between-category condition). For both category conditions, the targets elicited a clear N2pc (N2-posterior-contralateral) component in the event-related potential (ERP) in the contralateral hemisphere. In the left hemisphere only, the N2pc amplitude for the between-category condition was larger than that for the within-category condition. These results indicate that the N2pc could be used as an index to describe the lateralization effect of language on color perception.