WorldPoint: Finger Pointing as a Rapid and Natural Trigger for In-the-Wild Mobile Interactions
Pointing with one's finger is a natural and rapid way to denote an area or object of interest. It is routinely used in human-human interaction to increase both the speed and accuracy of communication, but it is rarely utilized in human-computer interactions. In this work, we use the recent inclusion of wide-angle, rear-facing smartphone cameras, along with hardware-accelerated machine learning, to enable real-time, infrastructure-free, finger-pointing interactions on today's mobile phones. We envision users raising their hands to point in front of their phones as a "wake gesture". This can then be coupled with a voice command to trigger advanced functionality. For example, while composing an email, a user can point at a document on a table and say "attach". Our interaction technique requires no navigation away from the current app and is both faster and more privacy-preserving than the current method of taking a photo.
Tue 7 NovDisplayed time zone: Eastern Time (US & Canada) change
14:15 - 15:30 | |||
14:15 25mTalk | WorldPoint: Finger Pointing as a Rapid and Natural Trigger for In-the-Wild Mobile Interactions Papers A: Daehwa Kim Carnegie Mellon University, A: Vimal Mollyn Carnegie Mellon University, A: Chris Harrison Carnegie Mellon University DOI | ||
14:40 25mTalk | 1D-Touch: NLP-Assisted Coarse Text Selection via a Semi-Direct Gesture Papers A: Peiling Jiang UCSD, A: Li Feng City University of Hong Kong, A: Fuling Sun University of California, San Diego, A: Parakrant Sarkar City University of Hong Kong, A: Haijun Xia UCSD, A: Can Liu City University of Hong Kong DOI | ||
15:05 25mTalk | Cross-Domain Gesture Sequence Recognition for Two-Player Exergames using COTS mmWave Radar Papers A: Ahsan Jamal Akbar Shanghai Jiao Tong University, A: Zhiyao Sheng Shanghai Jiao Tong University, A: Qian Zhang Shanghai Jiao Tong University, A: Dong Wang Shanghai Jiao Tong University DOI |