Traditionally a large proportion of perceptual research has assumed a specialization of cortical regions for the processing of stimuli in a single sensory modality. However, perception in everyday life usually consists of inputs from multiple sensory channels. Recently the question of how the brain integrates multisensory information has become the focus of a growing number of neuroscientific investigations. This work has identified both multisensory integration regions and crossmodal influences in brain areas traditionally thought to be specific to one sensory modality. Furthermore, several factors have been identified that enhance integration such as spatio-temporal stimulus coincidence and semantic congruency.

Written for academic researchers and graduate students, the present book aims at elucidating the mechanisms of multisensory integration of object-related information with a focus on the visual, auditory, and tactile sensory modalities. Evidence will be presented from studies in both human and nonhuman primates at different levels of analysis ranging from intracranial electrophysiological recordings to non-invasive electro- or magnetoencephalography, functional magnetic resonance imaging, behavioral approaches, and computational modeling. Seventeen chapters have been aggregated in four sections: underlying mechanisms, audio-visual integration, visuo-tactile integration, and plasticity.

About the Editors: Marcus J. Naumer studied biology, philosophy, and psychology at the universities of Freiburg and Landau in Germany. He obtained his PhD from the Faculty of Psychology and Neuroscience, University of Maastricht, The Netherlands. Since 2005 he has headed the Crossmodal Neuroimaging Lab at the Institute of Medical Psychology, Goethe University, Frankfurt, Germany. He conducts basic and clinical research on human multisensory (auditory, visual, and haptic) object perception using functional magnetic resonance imaging and magnetoencephalography.

Jochen Kaiser studied psychology at the universities of Mainz in Germany and Glasgow in Scotland. He obtained a PhD from Imperial College School of Medicine, University of London, UK, in 1998. In 2004 he was appointed Full Professor and Director of the Institute of Medical Psychology at Goethe University in Frankfurt am Main, Germany. He has conducted extensive research on auditory and audio-visual perception, short-term memory and cortical oscillations in humans, using magnetoencephalography and functional magnetic resonance imaging.

Résumé
It should come as no surprise to those interested in sensory processes that its research history is among the longest and richest of the many systematic efforts to understand how our bodies function. The continuing obsession with sensory systems is as much a re?ection of the fundamental need to understand how we experience the physical world as it is to understand how we become who we are based on those very experiences. The senses function as both portal and teacher, and their individual and collective properties have fascinated scientists and philosophers for millennia. In this context, the attention directed toward specifying their properties on a sense-by-sense basis that dominated sensory research in the 20th century seems a prelude to our current preoccupation with how they function in concert. Nevertheless, it was the concentrated effort on the operational principles of in- vidual senses that provided the depth of understanding necessary to inform current efforts to reveal how they act cooperatively. We know that the information provided by any individual sensory modality is not always veridical, but is subject to a myriad of modality-speci?c distortions. Thus, the brain's ability to compare across the senses and to integrate the information they provide is not only a way to examine the accuracy of any individual sensory channel but also a way to enhance the collective information they make available to the brain.

Contenu

General Introduction.- General Introduction.- Mechanisms.- Corticocortical Connectivity Subserving Different Forms of Multisensory Convergence.- Computational Modeling of Multisensory Object Perception.- Methodological Considerations: Electrophysiology of Multisensory Interactions in Humans.- Cortical Oscillations and Multisensory Interactions in Humans.- Multisensory Functional Magnetic Resonance Imaging.- Audio-Visual Integration.- Audiovisual Temporal Integration for Complex Speech, Object-Action, Animal Call, and Musical Stimuli.- Imaging Cross-Modal Influences in Auditory Cortex.- The Default Mode of Primate Vocal Communication and Its Neural Correlates.- Audio-Visual Perception of Everyday Natural Objects - Hemodynamic Studies in Humans.- Single-Trial Multisensory Learning and Memory Retrieval.- Visuo-Tactile Integration.- Multisensory Texture Perception.- Dorsal and Ventral Cortical Pathways for Visuo-haptic Shape Integration Revealed Using fMRI.- Visuo-haptic Perception of Objects and Scenes.- Haptic Face Processing and Its Relation to Vision.- Plasticity.- The Ontogeny of Human Multisensory Object Perception: A Constructivist Account.- Neural Development and Plasticity of Multisensory Representations.- Large-Scale Brain Plasticity Following Blindness and the Use of Sensory Substitution Devices.