PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics Exploration

Elyse D. Z. Chase, Alexa F. Siu, Gene S-H Kim, Abena Boadi-Agyemang, Eric J. Gonzalez, and Sean Follmer. Poster presented at ASSETS 2020.

Abstract

The ability to effectively read and interpret tactile graphics and charts is an essential part of a tactile learner’s path to literacy, but is a skill that requires instruction and training. Many teachers of the visual impaired (TVIs) report that blind and visually impaired students have trouble interpreting graphics independently without individual instruction. We present PantoGuide, a low-cost system that provides audio and haptic guidance, via skin-stretch feedback to the dorsum of a user’s hand while the user explores a tactile graphic overlaid on a touchscreen. This system allows programming of haptic guidance patterns and cues for tactile graphics that can be experienced by students learning remotely or that can be reviewed by a student independently. We propose two teaching scenarios (synchronous and asynchronous) and two guidance interactions (point-to-point and continuous) that the device can support – and demonstrate their use in a set of applications we co-design with one co-author who is blind and a tactile graphics user.

Read more about this project here, or in our paper linked below.

Publication

Elyse D Z Chase*, Alexa F Siu*, Abena Boadi-Agyemang+, Gene S-H Kim+, Eric Gonzales, and Sean Follmer. 2020. PantoGuide: A Haptic and Audio Guidance System To Support Tactile Graphics Exploration. In The 22nd International ACM SIGACCESS Conference on Computers and Accessibility. (*,+ These authors contributed equally to this work.)

Videos