Sensorimotor Processing and Goal-Directed Movement.

This special issue of Journal of Vision presents a collection of papers on sensorimotor processing and goal<directed movements, with special emphasis on how vision is employed in guiding hand movements. Until recently, research concerning sensory processing and research concerning motor control have followed parallel but independent paths. The partitioning of the two lines of research in practice partly derived from and partly fostered a bipartite view of sensorimotor processing in the brain – that a sensory/perceptual system creates a general purpose representation of the world which serves as the input to the motor systems (and other cognitive systems) that generate action/behavior as an output. On the one hand, this view has led researchers in perception to study how observers use sensory information to explicitly estimate various properties of objects and scenes without reference to how an observer might use that information to guide behavior. On the other, it has led researchers in motor control to treat the sensory input as an exact representation of the world. Recent results from research on vision in natural tasks have seriously challenged this view, suggesting that the visual system does not generate a general<purpose representation of the world, but rather extracts information relevant to the task at hand (Droll, Hayhoe, Triesch & Sullivan, 2005; Land & Hayhoe, 2001). At the same time, researchers in motor control have developed an increasing understanding of how sensory limitations and sensory uncertainty can shape the motor strategies that humans employ to perform tasks. Moreover, many aspects of the problem of sensorimotor control are specific to the mapping from sensory signals to motor outputs and do not exist in either domain in isolation. Sensory feedback control of hand movements, coordinate transformations of spatial representations and the influence of processing speed and attention on sensory contributions to motor control are just a few of these. In short, to understand how human (and animal) actors use sensory information to guide motor behavior, we must study sensory and motor systems as an integrated whole rather than as decomposable modules in a sequence of discrete processing steps. In recent years researchers have begun to focus more and more on sensorimotor integration. Besides the theoretical considerations alluded to above, two advances in the tools available to researchers have made it this possible. The first is the ready availability of equipment that allows experimenters to present complex visual stimuli in realistic 3D environments and to monitor motor behavior in real<time. The second, more profound, advance is the growing application of mathematical tools from statistical (including Bayesian) decision theory (Knill & Richards, 1996) and optimal control theory (Stengel, 1994). Indeed, statistical decision theory, which is now being widely applied to studies of visual perception, is fundamentally a theory of goal<directed actions based on uncertain sensory information (Ernst & Bülthoff, 2004; Maloney, 2002). With problems in both domains framed in a common mathematical language, it is much easier to think about perception and action together. As a consequence, we are seeing more work in sensorimotor integration drawing on insights gained from this type of modeling (Harris & Wolpert, 1998; Saunders & Knill, 2004; Todorov & Jordan, 2002; Trommershäuser et. al., 2003). Milner and Goodale (1995) conjectured that visuomotor computations and visual perception rely on distinct neural Journal of Vision (2007) 7(5):i, 1–2 http://journalofvision.org/7/5/i/ 1