Smartwatch Prototype Uses Wrist as a JoystickJohn Simpson | October 21, 2016
A Dartmouth College-led team has developed a smartwatch prototype that uses the wrist as an always-available joystick to perform common touchscreen gestures when one's hands are occupied.
WristWhirl was built from a 2" TFT display and a plastic watch strap augmented with 12 infrared proximity sensors and a Piezo vibration sensor placed inside the wrist strap, which is connected to an Arduino DUE board, a type of microcontroller board. The device provides a method for one-handed continuous gestural input for smartwatches.
To develop the WristWhirl prototype, the researchers investigated the biomechanical ability of the wrist by tasking a small group of participants to conduct eight joystick-like gestures while standing and walking. Participants were asked to use their wrist to make four directional marks similar to flicking a touchscreen, as well as four free-form shapes, such as a triangle. The participants made these gestures with their hand up in front of their body, during which they could see the gesture being drawn on the watch's screen, and with their hand down alongside their body.
Participants were found to be able to make directional marks at an average rate of half a second, and free-form shapes at an average rate of approximately 1.5 seconds. Visual feedback appeared to slow participants down, as they were slowest at performing the tasks when their hand was out in front of them and fastest when their hand was down alongside their body.
To measure the accuracy of the free-form paths drawn using WristWhirl, the researchers used the $1 gesture recognizer and found that it was able to recognize the marks with 93.8% accuracy, as compared to 85% accuracy by three human inspectors.
"While other studies have explored the use of one-handed continuous gestures using smartwatches, WristWhirl is the first to explore gestural input," says Xing-Dong Yang, assistant professor of computer science. "Technology like ours shows what smartwatches may be able to do in the future, by allowing users to interact with the device using one hand (the one that the watch is worn on), while freeing up the other hand for other tasks."