Surround-See: Enabling Peripheral Vision on Smartphones during Active Use

Abstract

Mobile devices are endowed with significant sensing capabilities. However, their ability to ‘see’ their surroundings, during active use, is limited. We present Surround-See, a self-contained smartphone equipped with an omni-directional camera that enables peripheral vision around the device to augment daily mobile tasks. Surround-See provides mobile devices with a field-of-view collinear to the device screen. This capability facilitates novel mobile tasks such as, pointing at objects in the environment to interact with content, operating the mobile device at a physical distance and allowing the device to detect user activity, even when the user is not holding it. We describe Surround-See’s architecture, and demonstrate applications that exploit peripheral ‘seeing’ capabilities during active use of a mobile device. Users confirm the value of embedding peripheral vision capabilities on mobile devices and offer insights for novel usage methods.

Video

Download the Surround-See: Enabling Peripheral Vision on Smartphones during Active Use video file.

Citation

Xing-Dong Yang, Khalad Hasan, Neil Bruce, Pourang Irani. 2013. Surround-See: Enabling Peripheral Vision on Smartphones during Active Use. In Proceedings of the 26th Symposium on User Interface Software and Technology (UIST'13). St. Andrews, UK. ACM.

Bibtext Entry

@inproceedings{XingDongYang:2013:ALA:2466110.2466115,
author = {Yang, Xing-Dong and Hasan, Khalad and Bruce, Neil and Irani, Pourang},
title = {Surround-See: Enabling Peripheral Vision on Smartphones during Active Use},
booktitle = {Proceedings of the 2013 ACM 26th Symposium on User Interface Software and Technology},
series = {UIST '13},
year = {2013},
location = {St. Andrews, France},
pages = {--},
numpages = {10},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Peripheral mobile vision, mobile ‘seeing’, mobile surround vision.},
}