HapticChair

‘Haptic Chair’ is a sensory substitution interface that translate music into vibrotactile feedback, providing rich musical experiences to deaf users via ‘full body haptic stimulation’. After the formal studies were completed, we interacted with our deaf participants in a more informal way that provided insight into how our system worked in a more natural environment. Many of the participants told us that they could identify the rhythm of the song and could ‘hear’ the song much better compared to when using standard hearing aids. Another user mentioned that he wanted to use headphones together with the chair so that he could detect the sound through the headphones as well. A few participants who were born with profound deafness said that this was the first time they actually ‘heard’ a song and they were extremely happy about it. They expressed a wish to buy a similar Haptic Chair and connect it to the radio and television at home. It was observed that majority of the profoundly deaf participants appeared to be ‘hearing’ something when they were sitting on the chair. The Haptic Chair was installed at the Dr Reijntje’s School for the Deaf in Moratuwa, Sri Lanka for more than 7 years which now has become a platform for deaf students and their hearing teachers to connect and communicate via vibrations generated by sound.

Publications

  • Benjamin Petry, Jochen Huber and Suranga Nanayakkara. Scaffolding the Music Listening and Music Making Experience for the Deaf. In Assistive Augmentation. Springer. Cognitive Science and Technology Series. (to appear).
  • Nanayakkara S.C., Wyse L., Ong S.H. and Taylor E. “Enhancing Musical Experience for the Hearing-impaired using Visual and Haptic Inputs”, Human-Computer Interaction, 28 (2), pp.115-160, 2013. [PDF]
  • Nanayakkara, S. C., Wyse, L., Taylor E. A. “The Haptic Chair as a Speech Training Aid for the Deaf”, OZCHI, 2012. [PDF]
  • Nanayakkara, S. C., Wyse, L., Taylor E. A. “Effectiveness of the Haptic Chair in Speech Training”, ASSETS, 2012. [PDF]

Press and Awards