Crossmodal correspondences: A tutorial review

Crossmodal correspondences: A tutorial review

2011 | Charles Spence
Crossmodal correspondences refer to the consistent associations between different sensory features, such as between auditory pitch and visual size. These associations help the brain integrate information from different senses to form a coherent perception of the environment. Research has shown that people consistently match high-pitched sounds with small, bright objects located high up in space. Crossmodal correspondences are important for solving the crossmodal binding problem, which is the challenge of determining which stimuli to combine when multiple sensory signals are present. The crossmodal binding problem has traditionally been studied in terms of spatial and temporal factors that influence multisensory integration. However, crossmodal correspondences between various unisensory features may provide another important means of constraining this problem. A large body of research now shows that people exhibit consistent crossmodal correspondences between many stimulus features in different sensory modalities. These correspondences are influenced by semantic and spatiotemporal congruency, which are key constraints that help the brain solve the crossmodal binding problem. Crossmodal correspondences have been studied in various contexts, including sound symbolism, where words are associated with certain physical features. For example, Edward Sapir highlighted the association between the speech sounds /a/ and /i/ and object size. Similarly, Köhler demonstrated that people associate certain nonsense words with specific shapes. These findings have led to a long-standing interest in the topic of sound symbolism, which is still popular today. Research has also shown that crossmodal correspondences can be established at different levels, from low-level stimulus properties such as duration to high-level cognitive correspondences based on stimulus meaning or valence. These correspondences can be influenced by semantic congruency, synaesthetic congruency, and other factors. For example, people may match high-pitched sounds with small and/or bright objects, or loud sounds with visually high-contrast stimuli. Studies have demonstrated that crossmodal correspondences can influence human information processing, particularly in speeded classification tasks. For example, participants respond more slowly to visual stimuli when their elevation is inconsistent with the relative pitch of a task-irrelevant sound. This effect is known as the crossmodal congruency effect. Similarly, participants respond more rapidly to congruent crossmodal stimuli, such as a high-frequency sound paired with a small disk. Crossmodal correspondences have also been shown to influence multisensory integration. For example, in a study by Parise and Spence, participants found it harder to determine the temporal order of auditory and visual stimuli when they were crossmodally congruent. This suggests that crossmodal correspondences can modulate audiovisual integration at a perceptual level. Overall, crossmodal correspondences are important for integrating information from different senses and for solving the crossmodal binding problem. These correspondences are influenced by a variety of factors, including semantic and spatiotemporal congruency, and they can have different developmental trajectories and consequences for human perception and behavior.Crossmodal correspondences refer to the consistent associations between different sensory features, such as between auditory pitch and visual size. These associations help the brain integrate information from different senses to form a coherent perception of the environment. Research has shown that people consistently match high-pitched sounds with small, bright objects located high up in space. Crossmodal correspondences are important for solving the crossmodal binding problem, which is the challenge of determining which stimuli to combine when multiple sensory signals are present. The crossmodal binding problem has traditionally been studied in terms of spatial and temporal factors that influence multisensory integration. However, crossmodal correspondences between various unisensory features may provide another important means of constraining this problem. A large body of research now shows that people exhibit consistent crossmodal correspondences between many stimulus features in different sensory modalities. These correspondences are influenced by semantic and spatiotemporal congruency, which are key constraints that help the brain solve the crossmodal binding problem. Crossmodal correspondences have been studied in various contexts, including sound symbolism, where words are associated with certain physical features. For example, Edward Sapir highlighted the association between the speech sounds /a/ and /i/ and object size. Similarly, Köhler demonstrated that people associate certain nonsense words with specific shapes. These findings have led to a long-standing interest in the topic of sound symbolism, which is still popular today. Research has also shown that crossmodal correspondences can be established at different levels, from low-level stimulus properties such as duration to high-level cognitive correspondences based on stimulus meaning or valence. These correspondences can be influenced by semantic congruency, synaesthetic congruency, and other factors. For example, people may match high-pitched sounds with small and/or bright objects, or loud sounds with visually high-contrast stimuli. Studies have demonstrated that crossmodal correspondences can influence human information processing, particularly in speeded classification tasks. For example, participants respond more slowly to visual stimuli when their elevation is inconsistent with the relative pitch of a task-irrelevant sound. This effect is known as the crossmodal congruency effect. Similarly, participants respond more rapidly to congruent crossmodal stimuli, such as a high-frequency sound paired with a small disk. Crossmodal correspondences have also been shown to influence multisensory integration. For example, in a study by Parise and Spence, participants found it harder to determine the temporal order of auditory and visual stimuli when they were crossmodally congruent. This suggests that crossmodal correspondences can modulate audiovisual integration at a perceptual level. Overall, crossmodal correspondences are important for integrating information from different senses and for solving the crossmodal binding problem. These correspondences are influenced by a variety of factors, including semantic and spatiotemporal congruency, and they can have different developmental trajectories and consequences for human perception and behavior.
Reach us at info@study.space
Understanding Crossmodal correspondences%3A A tutorial review