ACM ISS 2023
Sun 5 - Wed 8 November 2023
Tue 7 Nov 2023 14:15 - 14:40 at Schenley Ballroom - Session 4: Gesture Chair(s): Ville Mäkelä

Pointing with one's finger is a natural and rapid way to denote an area or object of interest. It is routinely used in human-human interaction to increase both the speed and accuracy of communication, but it is rarely utilized in human-computer interactions. In this work, we use the recent inclusion of wide-angle, rear-facing smartphone cameras, along with hardware-accelerated machine learning, to enable real-time, infrastructure-free, finger-pointing interactions on today's mobile phones. We envision users raising their hands to point in front of their phones as a "wake gesture". This can then be coupled with a voice command to trigger advanced functionality. For example, while composing an email, a user can point at a document on a table and say "attach". Our interaction technique requires no navigation away from the current app and is both faster and more privacy-preserving than the current method of taking a photo.

Tue 7 Nov

Displayed time zone: Eastern Time (US & Canada) change

14:15 - 15:30
Session 4: GesturePapers at Schenley Ballroom
Chair(s): Ville Mäkelä University of Waterloo
14:15
25m
Talk
WorldPoint: Finger Pointing as a Rapid and Natural Trigger for In-the-Wild Mobile Interactions
Papers
A: Daehwa Kim Carnegie Mellon University, A: Vimal Mollyn Carnegie Mellon University, A: Chris Harrison Carnegie Mellon University
DOI
14:40
25m
Talk
1D-Touch: NLP-Assisted Coarse Text Selection via a Semi-Direct Gesture
Papers
A: Peiling Jiang UCSD, A: Li Feng City University of Hong Kong, A: Fuling Sun University of California, San Diego, A: Parakrant Sarkar City University of Hong Kong, A: Haijun Xia UCSD, A: Can Liu City University of Hong Kong
DOI
15:05
25m
Talk
Cross-Domain Gesture Sequence Recognition for Two-Player Exergames using COTS mmWave Radar
Papers
A: Ahsan Jamal Akbar Shanghai Jiao Tong University, A: Zhiyao Sheng Shanghai Jiao Tong University, A: Qian Zhang Shanghai Jiao Tong University, A: Dong Wang Shanghai Jiao Tong University
DOI