FingerReader
We believe smart devices should be more inclusive, and assistive devices deserve more design and innovation. The low demand for assistive devices has led to high cost and little innovation. While mobile phones have gotten smarter with each passing day, assistive devices like the white cane for the blind, has pretty much remained the same all these years.
In our previous work, we have created a FingerReader-v0 (Finger-worn Assistive Augmentation) with the vision of empowering and enabling people with visual impairments. With FingerReader, blind users are able to simply point at products, text phases etc. and have the results spoken back to them. Our findings suggest that a direct mapping could greatly improve interaction (e.g. easy “re-reading”), as well as scaffold the mental model of a text document effectively, avoiding “ghost text”.
With FingerReader, we aim to transform this proof of concept project into an affordable everyday product that will sustainably change how the visually impaired community can independently access information on the go.
PUBLICATIONS
FingerReader2.0: Designing and Evaluating a Wearable Finger-WornCamera to Assist People with Visual Impairments while Shopping,
Boldu, R., Dancu, A., Matthies, D. J.C., Buddhika, T., Siriwardhana, S., & Nanayakkara, S.C., 2018. FingerReader2. 0: Designing and Evaluating a Wearable Finger-Worn Camera to Assist People with Visual Impairments while Shopping. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(3), 94. ACM.
FingerReader: A Wearable Device to Explore Printed Text on the Go
Shilkrot, R., Huber, J., Meng Ee, W., Maes, P. and Nanayakkara, S.C., 2015, April. FingerReader: a wearable device to explore printed text on the go. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 2363-2372).
Digital Digits: A Comprehensive Survey of Finger Augmentation Devices
Shilkrot, R., Huber, J., Steimle, J., Nanayakkara, S.C. and Maes, P., 2015. Digital digits: A comprehensive survey of finger augmentation devices. ACM Computing Surveys (CSUR), 48(2), pp.1-29.
FingerReader: A Wearable Device to Support Text-Reading on the Go
Shilkrot, R., Huber, J., Liu, C., Maes, P. and Nanayakkara, S.C., 2014. FingerReader: a wearable device to support text reading on the go. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 2359-2364).
A Wearable Text-Reading Device for the Visually-Impaired
Shilkrot, R., Huber, J., Liu, C., Maes, P. and Nanayakkara, S.C., 2014. A wearable text-reading device for the visually-impaired. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 193-194).