Sensing Techniques for Tablet+Stylus Interaction

Download Publication File

Abstract

We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures produced by the nonpreferred hand, from touch gestures produced by the hand holding the pen, which necessarily impart a detectable motion signal to the stylus. We can sense which hand grips the tablet, and determine the screen's relative orientation to the pen. By selectively combining these signals and using them to complement one another, we can tailor interaction to the context, such as by ignoring unintentional touch inputs while writing, or supporting contextually-appropriate tools such as a magnifier for detailed stroke work that appears when the user pinches with the pen tucked between his fingers. These and other techniques can be used to impart new, previously unanticipated subtleties to pen + touch interaction on tablets.

Video

Citation

Ken Hinckley, Michel Pahud, Hrvoje Benko, Pourang Irani, François Guimbretière, Marcel Gavriliu, Xiang 'Anthony' Chen, Fabrice Matulic, William Buxton, Andrew Wilson. 2014. Sensing techniques for tablet+stylus interaction. Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST 2014). Honolulu, USA. 605-614. (Best Paper Award)

Bibtext Entry

@inproceedings{
author = {Hinckley, Ken and Pahud, Michel and Benko, Hrvoje and Irani, Pourang and Guimbreti\`{e}re, Fran\c{c}ois and Gavriliu, Marcel and Chen, Xiang 'Anthony' and Matulic, Fabrice and Buxton, William and Wilson, Andrew},
title = {Sensing Techniques for Tablet+Stylus Interaction},
booktitle = {Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology},
series = {UIST '14},
year = {2014},
isbn = {978-1-4503-3069-5},
location = {Honolulu, Hawaii, USA},
pages = {605--614},
numpages = {10},
url = {http://doi.acm.org.proxy2.lib.umanitoba.ca/10.1145/2642918.2647379},
doi = {10.1145/2642918.2647379},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {bimanual input, grip, motion, pen+touch, sensing, tablet},
}