ACM ISS 2023
Sun 5 - Wed 8 November 2023
Mon 6 Nov 2023 11:45 - 12:07 at Schenley Ballroom - Session 1: Mixed Reality Chair(s): Mark Hancock

Determining the correct orientation of objects can be critical to succeed in tasks like assembly and quality assurance. In particular, near-symmetrical objects may require careful inspection of small visual features to disambiguate their orientation. We propose CADTrack, a digital assistant for providing instructions and support for tasks where the object orientation matters but may be hard to disambiguate with the naked eye. Additionally, we present a deep learning pipeline for tracking the orientation of near-symmetrical objects. In contrast to existing approaches, which require labeled datasets involving laborious data acquisition and annotation processes, CADTrack uses a digital model of the object to generate synthetic data and train a convolutional neural network. Furthermore, we extend the architecture of Mask R-CNN with a confidence prediction branch to avoid errors caused by misleading orientation guidance. We evaluate CADTrack in a user study, comparing our tracking-based instructions to other methods to confirm the benefits of our approach in terms of preference and required effort.

Mon 6 Nov

Displayed time zone: Eastern Time (US & Canada) change

11:00 - 12:30
Session 1: Mixed RealityPapers at Schenley Ballroom
Chair(s): Mark Hancock University of Waterloo
11:00
22m
Talk
3D Finger Rotation Estimation from Fingerprint Images
Papers
A: Yongjie Duan Tsinghua University, A: Jinyang Yu BNRist, Department of Automation, Tsinghua University, A: Jianjiang Feng Tsinghua University, A: Ke He Department of Automation, BNRist, Tsinghua University, A: Jiwen Lu Tsinghua University, A: Jie Zhou Department of Automation, BNRist, Tsinghua University
DOI
11:22
22m
Talk
BlendMR: A Computational Method to Create Ambient Mixed Reality InterfacesBest Paper
Papers
A: Violet Yinuo Han Carnegie Mellon University, A: Hyunsung Cho Carnegie Mellon University, A: Kiyosu Maeda The University of Tokyo, A: Alexandra Ion Carnegie Mellon University, A: David Lindlbauer Carnegie Mellon University
DOI
11:45
22m
Talk
CADTrack: Instructions and Support for Orientation Disambiguation of Near-Symmetrical Objects
Papers
A: João Marcelo Evangelista Belo Aarhus University, A: Jon Wissing Aarhus University, A: Tiare Feuchtner , A: Kaj Grønbæk Aarhus University
DOI Media Attached
12:07
22m
Talk
UbiSurface: A Robotic Touch Surface for Supporting Mid-air Planar Interactions in Room-Scale VR
Papers
A: Ryota Gomi Tohoku University, A: Kazuki Takashima , A: Yuki Onishi Singapore Management University, A: Kazuyuki Fujita , A: Yoshifumi Kitamura Tohoku University
DOI