Listening to music is basically the interpretation of sensations, whereas making music requires the performer to actively create content. Hence, music-making requires a closed feedback loop to compare and evaluate the created sound with the intended sound. This becomes a challenging task for those with hearing disabilities who are nevertheless interested in learning to play an instrument.
We developed Music Sensory Substitution (MuSS) Bits, small wireless sensor-display pairs, to provide real-time feedback for sound coming from various audio sources, such as an instrument, a digital device or from the environment. Using sensory substitution, MuSS-Bits translate the audio signal into visual and haptic feedback.