fSense

fSense uses photoplethysmograph (PPG) sensors in commercially available smartwatches to sense the force of performing hand gestures and gripping objects. It is used as an additional channel of input on top of existing gestural interactions. Its application scenarios include interacting with a smartwatch without using the touch screen, which could be blocked by the touching finger; interacting with smartphones/smartwatches when the hand is busy holding on to other objects; and force-controlled stroke styles when painting with a digital stylus. This work has been submitted and accepted at the Augmented Human International Conference 2019 (AH2019) and will be presented in March this year in Reims, France.

Publications

  • Thisum Buddhika, Haimo Zhang, Samantha W. T. Chan, Vipula Dissanayake, Suranga Nanayakkara, and Roger Zimmermann. 2019. fSense: Unlocking the Dimension of Force for Gestural Interactions Using Smartwatch PPG Sensor. In Proceedings of the 10th Augmented Human International Conference 2019 (AH2019), 11:1–11:5. [DOI], [PDF]