« Back to Publications list

User Gesture Elicitation of Common Smartphone Tasks for Hand Proximate User Interfaces

The ubiquity of smartphone interactions along with the advancements made in mixed reality applications and gesture recognition present an intriguing space for novel interaction techniques using the hand as an interface. This paper explores the idea of using hand proximate user interfaces (UI), i.e. interactions with and display of interface elements on and around the hand.We conducted two user studies to gain a better understanding of the design space for such interactions. The first study identifies the possible ways in which various elements can be displayed on and around the hand in the context of common smartphone applications. We conduct a second study to build a gesture set for interactions with elements displayed on and around the hand. We contribute an analysis of the data and observations collected from the two studies, resulting in a layout set and a gesture set for interactions with hand proximate UIs.

https://doi.org/10.1145/3396339.3396363

Shariff A. M. Faleel, Michael Gammon, Yumiko Sakamoto, Carlo Menon, and Pourang Irani. 2020. User Gesture Elicitation of Common Smartphone Tasks for Hand Proximate User Interfaces. In 11th Augmented Human International Conference (AH ’20), May 27–29, 2020, Winnipeg, MB, Canada. ACM, New York, NY, USA, 8 pages. https://doi.org/10.1145/3396339.3396363

Authors

Dr. Yumiko Sakamoto

Dr. Yumiko Sakamoto

Senior Research Associate at University of British Columbia
Pourang Irani

Pourang Irani

Professor
Canada Research Chair
at University of British Columbia Okanagan Campus

As well as: Carlo Menon