Back to all research

Properties of imagined experience across visual, auditory, and other sensory modalities

DOI: 10.1016/j.concog.2023.103598
Sulfaro, A. A., Robinson, A. K., & Carlson, T. A. (2024). Properties of imagined experience across visual, auditory, and other sensory modalities. Consciousness and Cognition, 117, 103598. doi:10.1016/j.concog.2023.103598

Abstract

Little is known about the perceptual characteristics of mental images nor how they vary across sensory modalities. We conducted an exhaustive survey into how mental images are experienced across modalities, mainly targeting visual and auditory imagery of a single stimulus, the letter "O", to facilitate direct comparisons. We investigated temporal properties of mental images (e.g. onset latency, duration), spatial properties (e.g. apparent location), effort (e.g. ease, spontaneity, control), movement requirements (e.g. eye movements), real-imagined interactions (e.g. inner speech while reading), beliefs about imagery norms and terminologies, as well as respondent confidence. Participants also reported on the five traditional senses and their prominence during thinking, imagining, and dreaming. Overall, visual and auditory experiences dominated mental events, although auditory mental images were superior to visual mental images on almost every metric tested except regarding spatial properties. Our findings suggest that modality-specific differences in mental imagery may parallel those of other sensory neural processes.

Authors

  • Alexander A Sulfaro2
  • Amanda K. Robinson2
  • Thomas A. Carlson2

Understanding Mental Imagery Across Senses

Overview/Introduction

Mental imagery is the phenomenon where we can "see" or "hear" things in our mind even when they are not present. This study explores how people experience mental images across different senses, focusing on visual and auditory imagery using the letter "O" as a stimulus. The research aims to understand how these mental images differ between the senses and how they relate to real sensory experiences.

Methodology

  • Participants: The study involved 242 participants who completed an online questionnaire.
  • Stimulus: Participants focused on the letter "O" to generate mental images.
  • Questions: The survey asked about various aspects of mental imagery, such as how quickly images appear, how long they last, and how easy they are to control.
  • Comparison: Visual and auditory imagery were compared using the same set of questions to ensure consistency.

Key Findings

  • Dominance of Auditory Imagery: Auditory mental images were generally more vivid and lasted longer than visual images, except in spatial properties where visual images were superior.
  • Onset and Duration: Auditory imagery started more quickly and could be sustained longer than visual imagery.
  • Automatic vs. Intentional: Auditory images were more often automatic, while visual images were more likely to be intentionally constructed.
  • Spatial Properties: Visual images were more likely to be perceived as located outside the head, especially with eyes open, whereas auditory images were typically perceived as inside the head.
  • Cross-Modal Effects: Reading often induced auditory imagery, but listening did not frequently induce visual imagery.

Implications

  • Understanding the Brain: The study suggests that differences in mental imagery across senses may reflect how our brain processes real sensory information.
  • Applications: Insights from this research could inform therapies for conditions like aphantasia (lack of mental imagery) and enhance techniques in education and training that rely on visualization and auditory learning.

Limitations

  • Stimulus Choice: The letter "O" may not fully represent all sensory modalities, limiting the study's scope to visual and auditory experiences.
  • Biases in Reporting: Participants' ability to introspect and report on their experiences accurately may vary, potentially affecting the results.
This research provides a deeper understanding of how we experience mental images and highlights the complexity and variability of these experiences across different sensory modalities.