Multimodality in VR: A survey

D Martin, S Malpica, D Gutierrez, B Masia… - ACM Computing …, 2022 - dl.acm.org
Virtual reality (VR) is rapidly growing, with the potential to change the way we create and
consume content. In VR, users integrate multimodal sensory information they receive to …

[HTML][HTML] Spatial soundscapes and virtual worlds: Challenges and opportunities

C Rajguru, M Obrist, G Memoli - Frontiers in Psychology, 2020 - frontiersin.org
There is increasing effort to characterize the soundscapes around us so that we can design
more compelling and immersive experiences. This review paper focuses on the challenges …

Towards soundscape indices

J Kang, F Aletta, T Oberman, M Erfanian… - Proceedings of the …, 2019 - discovery.ucl.ac.uk
The growing field of soundscape studies considers sound environments as perceived, in
context, with an interdisciplinary approach. This paper outlines an ongoing European …

Using virtual reality and co-design to study the design of large-scale shape-changing interfaces

L Albarrak, O Metatla, A Roudaut - … of the 2023 CHI Conference on …, 2023 - dl.acm.org
Large-scale shape-changing interfaces (SCIs) such as shape-changing walls offer
opportunities for enhancing user experiences within buildings, eg, for navigation. However …

[HTML][HTML] Enhancing learning outcomes through multisensory integration: A fMRI study of audio-visual training in virtual reality

K Alwashmi, G Meyer, F Rowe, R Ward - NeuroImage, 2024 - Elsevier
The integration of information from different sensory modalities is a fundamental process that
enhances perception and performance in real and virtual environments (VR). Understanding …

[HTML][HTML] A Review of Recent Literature on Audio-Based Pseudo-Haptics

S Abdo, B Kapralos, KC Collins, A Dubrowski - Applied Sciences, 2024 - mdpi.com
Immersive virtual learning environments (iVLEs), particularly serious games and virtual
simulations, typically ignore psychomotor skills development, partly due to the difficulty and …

Synergy and medial effects of multimodal cueing with auditory and electrostatic force stimuli on visual field guidance in 360° VR

Y Sawahata, M Harasawa, K Komine - Frontiers in Virtual Reality, 2024 - frontiersin.org
This study investigates the effects of multimodal cues on visual field guidance in 360° virtual
reality (VR). Although this technology provides highly immersive visual experiences through …

Spatialized audio in a custom-built OpenGL-based ear training virtual environment

K Pedersen, V Hulusic, P Amelidis… - … Computer Graphics and …, 2020 - ieeexplore.ieee.org
Interval recognition is an important part of ear training—the key aspect of music education.
Once trained, the musician can identify pitches, melodies, chords, and rhythms by listening …

[HTML][HTML] “有声有色” 的触觉体验: 来自多感觉通道整合的线索

万必成, 杨振, 李宏汀, 马舒 - 心理科学进展, 2022 - journal.psych.ac.cn
虚拟现实技术通过提供视觉, 听觉和触觉等信息为用户创造身临其境的感知体验,
其中触觉反馈面临诸多技术瓶颈使得虚拟现实中的自然交互受限. 基于多感官错觉的伪触觉技术 …

Investigating textual visual sound effects in a virtual environment and their impacts on object perception and sound perception

E Fabre, A Verhulst, A Balandra… - … on Mixed and …, 2021 - ieeexplore.ieee.org
In comics, Textual Sound Effects (TE) can describe sounds, but also actions, events, etc. TE
could be used in Virtual Environment to efficiently create an easily recognizable scene and …