Designer Led Computational Approach to Generate Mappings for Devices with Low Gestural Resolution

Abstract

We present an approach for the semi-automatic generation of gesture mappings for devices with low gestural resolution such as the Myo Armband, an off-the-shelf EMG capture device. As an exemplar interactive task, we use text-entry: a pervasive and highly complex interaction. We quantify data related to interaction combining systematic studies (i.e., error, speed, accuracy) and semi-structured workshops with experts (e.g., cognitive load, heuristics). We then formalize these factors in a mathematical model and use optimization algorithms (i.e. simulated annealing) to find an optimum gesture mapping. We demonstrated our method in a text-entry application (i.e., complex interactive dialogue) comparing our approach with other computationally determined mappings using naive cost functions. Our results showed that the designers mapping (with all factors weighted by designers) presented a good balance on performance in all factors involved (speed, accuracy, comfort, memorability, etc.), consistently performing better than purely computational mappings. The results indicate that our hybrid approach can yield better results than either pure user-driven methodologies or pure data-driven approaches, for our application context featuring a large solution space and complex high-level factors.

Publisher Link

https://doi.org/10.1007/978-3-030-29381-9_38

Citation

Montano-Murillo R., Han T., Irani P., Martinez-Plasencia D., Subramanian S. (2019) Designer Led Computational Approach to Generate Mappings for Devices with Low Gestural Resolution. In: Lamas D., Loizides F., Nacke L., Petrie H., Winckler M., Zaphiris P. (eds) Human-Computer Interaction – INTERACT 2019. INTERACT 2019. Lecture Notes in Computer Science, vol 11746. Springer, Cham

Bibtext Entry

@inbook{inbook,
author = {Montano, Roberto and Han, Teng and Irani, Pourang and Martinez-Plasencia, Diego and Subramanian, Sriram},
year = {2019},
month = {08},
pages = {623-643},
title = {Designer Led Computational Approach to Generate Mappings for Devices with Low Gestural Resolution},
isbn = {978-3-030-29380-2},
doi = {10.1007/978-3-030-29381-9_38}
}