The Area Activation Model of Saccadic Selectivity in Visual Search

The Area Activation Model of Saccadic Selectivity in Visual Search Marc Pomplun (marc@psych.utoronto.ca) Eyal M. Reingold (reingold@psych.utoronto.ca) Jiye Shen (jiye@psych.utoronto.ca) Diane E. Williams (diane@psych.utoronto.ca) University of Toronto, Department of Psychology 100 St. George Street, Toronto, Ontario, Canada M5S 3G3 Abstract We present an approach towards a simple, explicit model of saccadic selectivity in visual search tasks. The model in its present state includes weights for target-distractor similarities and fixation field size as its only adjustable parameters. Based on these, the model predicts the statistical distribution of saccadic endpoints for any given visual search display. Besides providing an explicit and complete mathematical specification of the model, we demonstrate the performance of its computer simulation in a triple-conjunctive search task. The model successfully simulates empirical data reported by Williams and Reingold (in press). Modeling Visual Search How do we detect a prespecified target item among a set of distractors? Numerous studies employing the paradigm of visual search have attempted to answer this question (see Treisman, 1988 and Wolfe, 1998, for reviews). In a typical visual search task, subjects have to decide whether a search display contains a designated target item, indicating their decision by pressing either a “yes” or a “no” button. In most studies, reaction times (RTs) and error rates were analyzed as a function of the number of items in the display (display size). The majority of current models of visual search were based on data obtained within this paradigm. An early attempt to model visual search is the Feature Integration Theory (Treisman & Gelade, 1980; Treisman, 1988). This theory proposes the existence of preattentive feature maps, one for each stimulus dimension such as color or shape. These maps are created in parallel after stimulus onset and allow immediate target detection if the target is defined by a unique feature in any single dimension (feature search). If the target is defined by a specific combination of features (conjunctive search), attention is necessary to locally combine the information of the corresponding feature maps. As a result, subjects have to inspect the display in an item-by-item fashion until target detection or exhaustive search. The Feature Integration Theory thus explains the finding that reaction time tends to increase with display size in conjunctive search tasks, while it is almost constant in feature search tasks. A more recent approach is the Guided Search Model (Cave & Wolfe, 1990; Wolfe, Cave & Franzel, 1989; Wolfe, 1994), which proposes a two-stage model of visual search. In the first, parallel stage, an activation map containing likely target locations is created on the basis of both top- down and bottom-up sources of activation. The second, serial stage uses the activation map to guide visual attention from item to item, starting with the item with the highest activation, then proceeding to the second highest, and so on, until the target is found or the current activation falls below a certain threshold (see Chun & Wolfe, 1996). Besides many variations of these two models, there are also more complex approaches like the one by Grossberg, Mingolla and Ross (1994). Their model uses artificial neural networks to achieve perceptual grouping of search displays into subregions. Visual search is assumed to proceed serially between these subregions and in parallel within them. Recently, several researchers have analyzed participants’ eye movements during visual search to supplement traditional RT and accuracy measures (e.g. Findlay, 1997; Hooge & Erkelens, 1999; Jacobs, 1987; Luria & Strauss, 1975; Motter & Belky, 1998; Rayner & Fisher, 1987; Scialfa & Joffe, 1998; Shen, Reingold, & Pomplun, in press; Viviani & Swensson, 1982; Williams, Reingold, Moscovitch, & Behrmann, 1997; Williams & Reingold, in press; Zelinsky, 1996; see Rayner, 1998, for a review). Some of these studies have further examined saccadic selectivity, i.e. the proportion of saccades directed to each distractor type, by assigning saccadic endpoints to the closest display item. Such studies have found a strong selectivity towards distractors sharing a particular feature with the target item (e.g. Findlay, 1997; Hooge & Erkelens, 1999; Luria & Strauss, 1975; Motter & Belky, 1998; Scialfa & Joffe, 1998; Shen, Reingold & Pomplun, in press; Williams & Reingold, in press; but see Zelinsky, 1996). Given that eye movements are usually accompanied by shifts of attention (see Hoffman, 1998, for a review), it seems that subjects can selectively attend to a critical subset of items in the display rather than perform an item-by-item search as suggested by the original Feature Integration Theory. To date, no explicit model has been proposed which allows for simulating saccadic selectivity in visual search. In the present article, we propose such an approach, referred to as the Area Activation Model. Following the description of