TactualPlot: spatializing data as sound using sensory substitution for touchscreen accessibility

P Chundury, Y Reyazuddin, JB Jordan… - … on Visualization and …, 2023 - ieeexplore.ieee.org
IEEE Transactions on Visualization and Computer Graphics, 2023ieeexplore.ieee.org
Tactile graphics are one of the best ways for a blind person to perceive a chart using touch,
but their fabrication is often costly, time-consuming, and does not lend itself to dynamic
exploration. Refreshable haptic displays tend to be expensive and thus unavailable to most
blind individuals. We propose T actual P lot, an approach to sensory substitution where
touch interaction yields auditory (sonified) feedback. The technique relies on embodied
cognition for spatial awareness—ie, individuals can perceive 2D touch locations of their …
Tactile graphics are one of the best ways for a blind person to perceive a chart using touch, but their fabrication is often costly, time-consuming, and does not lend itself to dynamic exploration. Refreshable haptic displays tend to be expensive and thus unavailable to most blind individuals. We propose T actual P lot , an approach to sensory substitution where touch interaction yields auditory (sonified) feedback. The technique relies on embodied cognition for spatial awareness—i.e., individuals can perceive 2D touch locations of their fingers with reference to other 2D locations such as the relative locations of other fingers or chart characteristics that are visualized on touchscreens. Combining touch and sound in this way yields a scalable data exploration method for scatterplots where the data density under the user's fingertips is sampled. The sample regions can optionally be scaled based on how quickly the user moves their hand. Our development of TactualPlot was informed by formative design sessions with a blind collaborator, whose practice while using tactile scatterplots caused us to expand the technique for multiple fingers. We present results from an evaluation comparing our TactualPlot interaction technique to tactile graphics printed on swell touch paper.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果