Mental imagery
From Freepedia
The following entry is excerpted and adapted from Kosslyn, Ganis, and Thompson, "Neural Foundations of Imagery," Nature Reviews Neuroscience 2.9, 635-642 (2001) by permission from Nature Reviews Neuroscience , Copyright 2005 Macmillan Magazines Ltd.
Note: This entry is meant to serve as a brief introduction to the notion of mental imagery and as a parent entry for the more specific articles visual mental imagery, auditory imagery, and motor imagery.
Mental imagery occurs when perceptual information is accessed from memory, giving rise to the experience of seeing with the mind's eye', 'hearing with the mind's ear' and so on. By contrast, perception occurs when information is registered directly from the senses. Mental images need not result simply from the recall of previously perceived objects or events; they can also be created by combining and modifying stored perceptual information in novel ways. Imagery has had a central role in theories of mental function since at least the time of Plato. It has fallen in and out of fashion, in large part because it is inherently a private affair, by definition restricted to the confines of the mind, and so it has been difficult to study. In fact, in 1913, the founder of behaviorism, John B. Watson, denied that mental images even existed. Instead, he suggested that thinking consists of subtle movements of the vocal apparatus (Watson 1913). In spite of the demonstration by Alan Paivio and his colleagues that the use of imagery greatly improves memory (Paivio 1971), many researchers were not convinced that imagery is a distinct form of thought. Indeed, Watson's position was echoed 60 years later by Zenon Pylyshyn, who championed the view that mental images are not 'images' at all, but rather rely on mental descriptions no different in kind from those that underlie language. According to Pylyshyn 1973, the pictorial aspects of imagery that are evident to conscious experience are entirely epiphenomenal, like the heat thrown off by a light bulb when you read (which has no role in the reading process).
The emergence of cognitive neuroscience has opened a new chapter in the study of imagery. An enormous amount has been learned about the neural underpinnings of visual perception, memory, emotion and motor control. Much of this information has come from the study of animal models. Unlike language and reasoning, these more basic functions have many common features among higher mammals, including humans. In addition, new neuroimaging technologies, especially positron-emission tomography (PET) and functional magnetic resonance imaging (fMRI), allow theories of imagery to be tested objectively in humans. Researchers have taken advantage of these developments to show that mental imagery draws on much of the same neural machinery as perception in the same modality, and can engage mechanisms used in memory, emotion and motor control.
A variety of methods are used to investigate mental imagery, including studies of the effects of selective brain damage on behavior, neuroimaging and transcranial magnetic stimulation (TMS). Each approach has its strengths and weaknesses, but the methods are complementary. So, for example, neuroimaging provides only correlational data (when engaged in a particular task, a particular set of brain areas is activated), but can monitor the entire brain; TMS, by contrast, can be used to establish causal roles of distinct areas (for example, by showing that performance in a task that draws on a specific brain area is impaired following TMS to that area), but must be targeted to a specific location. To the extent that the same conclusions are reached using different methods, the conclusions drawn from these studies can be taken increasingly seriously.
Conclusions
Imagery is no longer seen as an awkward leftover from a previous, less rigorous age - a topic unfit for polite company. Rather, researchers agree that most of the neural processes that underlie like-modality perception are also used in imagery; and imagery, in many ways, can 'stand in' for (re-present, if you will) a perceptual stimulus or situation. Imagery not only engages the motor system, but also affects the body, much as can actual perceptual experience.
Nevertheless, many questions remain. For example, under what circumstances is the early sensory cortex recruited during imagery? Why is the early sensory cortex often recruited during visual mental imagery, but not during auditory imagery? Why do people differ so much in their imagery abilities? Does genetics affect some aspects of imagery more than others? How does semantic content in images engage specific mechanisms?
Unlike the situation even 20 years ago, questions such as these can now be answered. Indeed, the advent of additional technologies, such as Diffuse Optical Tomography (Obrig 2000) (DOT), promises to facilitate studies of the neural bases of imagery. This technique is portable, very inexpensive, and more forgiving than fMRI when subjects move. It is also totally silent. The drawback is that it can only monitor cortical activity, and not even all of that. However, it can assess the lion's share of cortex, and will allow large-scale individual-differences studies to be done. Such studies can relate differences in patterns of brain activation to differences in performance, which should, in turn, tell us not only about what the brain is doing, but also about how and why people differ in their modes of thinking.
Related Entries
For a more detailed discussion of research into mental imagery, please see:
Mental Imagery References
- Behrmann, M., Winocur, G. & Moscovitch, M. Dissociation between mental imagery and object recognition in a braindamaged patient. Nature 359, 636-637 (1992).
- Behrmann, M. The mind's eye mapped onto the brain's matter. Curr. Dir. Psychol. Sci. 9, 50-54 (2000).
- Chatterjee, A. & Southwood, M. H. cortical blindness and visual imagery. Neurology 45, 2189-2195 (1995).
- Cohen, M. S. et al. Changes in cortical activity during mental rotation: a mapping study using functional MRI. Brain 119, 89-100 (1996).
- Crick, F. & Koch, C. Are we aware of neural activity in primary visual cortex? Nature 375, 121-123 (1995).
- De Vreese, L. P. Two systems for color-naming defects: verbal disconnection vs color imagery disorder. Neuropsychologia 29, 1-18 (1991).
- Decety, J., Jeannerod, J. & Prablanc, C. The timing of mentally represented actions. Behav. brain Res. 34, 35-42 (1989).
- Decety, J. Neural representation for action. Rev. Neurosci. 7, 285-297 (1996).
- Driskell, J., Copper, C. & Moran, A. Does mental practice enhance performance? J. Appl. Psychol. 79, 481-492 (1994).
- Fadiga, L., Fogassi, L., Pavesi, G. & Rizzolatti, G. Motor facilitation during action observation: a magnetic stimulation study. J. Neurophysiol. 73, 2608-2611 (1995).
- Farah, M. J. The neurological basis of mental imagery: a componential analysis.
Cognition 18, 245-272 (1984).
- This is a creative analysis of the perceptual and imagery abilities that are damaged and spared following memory. This analysis shows, without question, that imagery is not a single faculty, but is carried out by the joint operation of a set of processes.
- Farah, M. J., Soso, M. J. & Dasheiff, R. M. Visual angle of the mind's eye before and after unilateral occipital lobectomy. J. Exp. Psychol. Hum. Percept. Perform. 18, 241-246 (1992).
- Gangitano, M., Mottaghy, F. M. & Pascual-Leone, A. Phasespecific modulation of cortical motor output during movement observation. Neuroreport 12, 1489-1492 (2001).
- Ganis, G., Keenan, J. P., Kosslyn, S. M. & Pascual-Leone, A. Transcranial magnetic stimulation of primary motor cortex affects mental rotation. Cereb. Cortex 10, 175-180 (2000).
- Georgopoulos, A. P., Lurito, J. T., Petrides, M., Schwartz, A. B. & Massey, J. T. Mental rotation of the neuronal population vector. Science 243, 234-236 (1989). Shepard, R. N. & Metzler, J. Mental rotation of threedimensional objects. Science 171, 701-703 (1971).
- This is the classic - and in many ways still the best - study of mental rotation. It is methodologically tight and reveals that rotation in the picture plane and in depth are equally easy, even though the stimuli are only pictures of three-dimensional objects.
- Grafton, S. T., Arbib, M. A., Fadiga, L. & Rizzolatti, G. Localization of grasp representations in humans by positron emission tomography. 2. Observation compared with imagination. Exp. brain Res. 112, 103-111 (1996).
- Griffiths, T. D. Musical hallucinosis in acquired deafness. Phenomenology and brain substrate. Brain 123, 2065-2076 (2000).
- Halpern, A. R. & Zatorre, R. J. When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. Cereb. Cortex 9, 697-704 (1999).
- Hari, R. et al. Activation of human primary motor cortex during action observation: a neuromagnetic study. Proc. Natl Acad. Sci. USA 95, 15061-15065 (1998).
- Jankowiak, J., Kinsbourne, M., Shalev, R. S. & Bachman, D. L. Preserved visual imagery and categorization in a case of associative visual agnosia. J. Cogn. Neurosci. 4, 119-131 (1992).
- Jeannerod, M. The representing brain: neural correlates of motor intention and imagery. Behav. brain Sci. 17, 187-245 (1994).
- Jeannerod, M. & Decety, J. Mental motor imagery: a window into the representational stages of action. Curr. Opin. Neurobiol. 5, 727-732 (1995).
- Jordan, K., Heinze, H. J., Lutz, K., Kanowski, M. & Jancke, L. cortical activations during the mental rotation of different visual objects. Neuroimage 13, 143-152 (2001).
- Kanwisher, N., McDermott, J. & Chun, M. M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302-4311 (1997).
- Klein, I., Paradis, A.-L., Poline, J.-B., Kosslyn, S. M. & Le Bihan, D. Transient activity in human calcarine cortex during visual imagery. J. Cogn. Neurosci. 12, 15-23 (2000).
- Kosslyn, S. M., Thompson, W. L., Kim, I. J. & Alpert, N. M. Topographical representations of mental images in primary visual cortex. Nature 378, 496-498 (1995).
- This study provides evidence that imagery not only activates early visual cortex, but activates such cortex selectively, depending on the properties of the visualized object; specifically, objects that subtend different visual angles activate different parts of cortex, as is found in perception.
- Kosslyn, S. M. et al. Neural effects of visualizing and perceiving aversive stimuli: a PET investigation. Neuroreport 7, 1569-1576 (1996).
- Kosslyn, S. M., Thompson, W. L., Kim, I. J., Rauch, S. L. & Alpert, N. M. Individual differences in cerebral blood flow in area 17 predict the time to evaluate visualized letters. J. Cogn. Neurosci. 8, 78-82 (1996).
- Kosslyn, S. M., Thompson, W. L. & Alpert, N. M. Neural systems shared by visual imagery and visual perception: a positron emission tomography study. Neuroimage 6, 320-334 (1997).
- Kosslyn, S. M., DiGirolamo, G., Thompson, W. L. & Alpert, N. M. Mental rotation of objects versus hands: neural mechanisms revealed by positron emission tomography. Psychophysiology 35, 151-161 (1998).
- Kosslyn, S. M. et al. The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science 284, 167-170 (1999).
- This study demonstrates that area 17 is activated during imagery, and that impairing the functioning of this area, in turn, impairs the performance of an imagery task, providing evidence that this area has a causal role in such processing.
- Kosslyn, S. M., Thompson, W. L., Wraga, M. & Alpert, N. M. Imagining rotation by endogenous versus exogenous forces: distinct neural mechanisms. Neuroreport 12, 2519-2525 (2001).
- Kreiman, G., Koch, C. & Fried, I. Imagery neurons in the human brain. Nature 408, 357-361 (2000).
- Lang, P. J., Greenwald, M. K., Bradley, M. M. & Hamm, A. O. Looking at pictures: affective, facial, visceral, and behavioral reactions. Psychophysiology 30, 261-273 (1993).
- LeDoux, J. E. The emotional brain: the Mysterious Underpinnings of emotional Life (Simon & Schuster, New York, 1996.)
- Levine, D. N., Warach, J. & Farah, M. J. Two visual systems in mental imagery: dissociation of 'what' and 'where' in imagery disorders due to bilateral posterior cerebral lesions. Neurology 35, 1010-1018 (1985).
- Maring, J. R. Effects of mental practice on rate of skill acquisition. Phys. Ther. 70, 165-172 (1990).
- Mellet, E., Tzourio N., Denis, M. & Mazoyer, B. A positron emission tomography study of visual and mental spatial exploration. J. Cogn. Neurosci. 4, 433-445 (1995).
- Mellet, E. et al. Functional anatomy of spatial mental imagery generated from verbal instructions. J. Neurosci. 16, 6504-6512 (1996).
- Mellet, E. et al. Neural correlates of topographic mental exploration: the impact of route versus survey perspective learning. Neuroimage 12, 588-600 (2000).
- Ng, V. W. et al. Identifying rate-limiting nodes in large-scale cortical networks for visuospatial processing: an illustration using fMRI. J. Cogn. Neurosci. 13, 537-545 (2001).
- Obrig, H. et al. Near-infrared spectroscopy: does it function in functional activation studies of the adult brain? Int. J. Psychophysiol. 35, 125-142 (2000).
- O'Craven, K. M. & Kanwisher, N. Mental imagery of faces and places activates corresponding stimulus-specific brain regions. J. Cogn. Neurosci. 12, 1013-1023 (2000).
- Paivio, A. Imagery and Verbal Processes (Holt, Rinehart and Winston, New York, 1971).
- Parsons, L. M. et al. Use of implicit motor imagery for visual shape discrimination as revealed by PET. Nature 375, 54-58 (1995).
- Pylyshyn, Z. W. What the mind's eye tells the mind's brain: a critique of mental imagery. Psychol. Bull. 80, 1-24 (1973).
- This is a contemporary critique of visual mental imagery, which focuses on the necessity to have explicit, mechanistic theories. Findings from, and theories in, cognitive neuroscience address many of the concerns voiced here.
- Pylyshyn, Z. W. Psychological explanations and knowledge-dependent processes. Cognition 10, 267-274 (1981).
- Richter, W. et al. Motor area activity during mental rotation studied by time-resolved single-trial fMRI. J. Cogn. Neurosci. 12, 310-320 (2000).
- Rizzolatti, G. et al. Localization of grasp representations in humans by PET: 1. Observation versus execution. Exp. brain Res. 111, 246-252 (1996).
- Rizzolatti, G., Fogassi, L. & Gallese, V. Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Rev. Neurosci. 2, 661-670 (2001).
- Rizzolatti, G., Luppino, G. & Matelli, M. The organization of the cortical motor system: new concepts. Electroencephalogr. Clin. Neurophysiol. 106, 283-296 (1998).
- Sereno, M. I. et al. Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. Science 268, 889-893 (1995).
- This paper is a landmark in the development of techniques to delineate topographically organized areas in the human brain; such techniques will no doubt prove to be increasingly important in the study of mental imagery.
- Skinner, B. F. Why I am not a cognitive psychologist. Behaviorism 5, 1-10 (1977).
- Thompson, W. L. & Kosslyn, S. M. in Brain Mapping II: the Systems (eds Toga, A. W. & Mazziotta, J. C.) 535-560 (Academic, San Diego, 2000).
- This meta-analysis and review shows that different aspects of imagery tasks predict activation in early visual cortex (for example, the need to extract highresolution details), posterior parietal cortex (used in spatial tasks) and inferotemporal cortex (used in imagery tasks that do not require the extraction of high-resolution details).
- Tootell, R. B. H., Hadjikani, N. K., Mendola, J. D., Marrett, S. & Dale, A. M. From retinotopy to recognition: fMRI in human visual cortex. Trends Cogn. Sci. 2, 174-183 (1998).
- Ungerleider, L. G. & Mishkin, M. in Analysis of Visual Behavior (eds Ingle, D. J., Goodale, M. A. & Mansfield, R. J. W.) 549-586 (MIT Press, Cambridge, Massachusetts, 1982).
- Watson, J. B. Psychology as the behaviorist views it. Psychol. Rev. 20, 158-177 (1913).
- Weiss, T., Hansen, E., Rost, R. & Beyer, L. Mental practice of motor skills used in poststroke rehabilitation has own effects on central nervous activation. Int. J. Neurosci. 78, 157-166 (1994).
- Young, A. W., Humphreys, G. W., Riddoch, M. J., Hellawell, D. J. & De Haan, E. H. Recognition impairments and face imagery. Neuropsychologia 32, 693-702 (1994).
- Zatorre, R. J. & Halpern, A. R. Effect of unilateral temporallobe excision on perception and imagery of songs. Neuropsychologia 31, 221-232 (1993).
- Zatorre, R. J., Halpern, A. R., Perry, D. W., Meyer, E. & Evans, A. C. Hearing in the mind's ear: a PET investigation of musical imagery and perception. J. Cogn. Neurosci. 8, 29-46 (1996).
- auditory imagery is in many ways analogous to visual imagery, but activates only 'higher level' brain areas, not early auditory cortex. The similarities and differences between the different modalities illuminate key facets of the underlying mechanisms of imagery.



