Real-time online interaction is the norm today. Tabletops and other dedicated interactive surface devices with direct input and tangible interaction can enhance remote collaboration, and open up new interaction scenarios based on mixed physical/virtual components. However, they are only available to a small subset of users, as they usually require identical bespoke hardware for every participant, are complex to setup, and need custom scenario-specific applications.
We present SurfaceCast, a software toolkit designed to merge multiple distributed, heterogeneous end-user devices into a single, shared mixed-reality surface. Supported devices include regular desktop and laptop computers, tablets, and mixed-reality headsets, as well as projector-camera setups and dedicated interactive tabletop systems. This device-agnostic approach provides a fundamental building block for exploration of a far wider range of usage scenarios than previously feasible, including future clients using our provided API.
In this paper, we present various example application scenarios which we enhance through the multi-user and multi-device features of the framework. Our results show that the hardware- and content-agnostic architecture of SurfaceCast can run on a wide variety of devices with sufficient performance and fidelity for real-time interaction.
Mon 6 NovDisplayed time zone: Eastern Time (US & Canada) change
17:30 - 20:00 | |||
17:30 21mDemonstration | Augmenting Welding Training: An XR Platform to Foster Muscle Memory and Mindfulness for Skills DevelopmentBest Demo Demos A: Tate Johnson Carnegie Mellon University, A: Ann Li Carnegie Mellon University, A: Andrew Knowles Carnegie Mellon University, A: Zhenfang Chen Carnegie Mellon University, A: Semina Yi Carnegie Mellon University, A: Yumeng Zhuang Carnegie Mellon University, A: Dina El-Zanfaly Carnegie Mellon University, A: Daragh Byrne Carnegie Mellon University DOI Authorizer link | ||
17:51 21mDemonstration | Assisting the Multi-Directional Limb Motion Exercise with Spatial Audio and Interactive Feedback Demos A: Tian Min Keio University, Japan, A: Chengshuo Xia Xidian University, A: Yuta Sugiura Keio University DOI Authorizer link | ||
18:12 21mDemonstration | Demonstrating SurfaceCast: Ubiquitous, Cross-Device Surface Sharing Demos A: Florian Echtler Department of Computer Science, Aalborg University, Denmark, A: Vitus Maierhöfer University of Regensburg, A: Nicolai Brodersen Hansen Aalborg University, A: Raphael Wimmer University of Regensburg DOI Authorizer link | ||
18:34 21mDemonstration | Holographic Sports Training Demos A: Manuel Rebol American University, A: Becky Lake American University, A: Michael Reinisch Graz University of Technology, A: Krzysztof Pietroszek American University, A: Christian Gütl Graz University of Technology DOI Authorizer link | ||
18:55 21mDemonstration | Interactive 3D Annotation of Objects in Moving Videos from Sparse Multi-View Frames Demos A: Kotaro Oomori The University of Tokyo, A: Wataru Kawabe The University of Tokyo, A: Fabrice Matulic Preferred Networks, A: Takeo Igarashi The University of Tokyo, A: Keita Higuchi Preferred Networks DOI Authorizer link | ||
19:17 21mDemonstration | MarbLED: Embedded and Transmissive LED Touch Display System and Its Application Platform for Surface Computing with Engineered Marble Demos A: Yoshito Nakaue , A: Chihiro Ura Kyoto Sangyo University, A: Hiroshi Kano Kyoto Sangyo University, A: Shigeyuki Hirai Kyoto Sangyo University DOI Authorizer link | ||
19:38 21mDemonstration | MindfulBloom: Spatial Finger Painting for Mindfulness Intervention in Augmented Reality Demos A: Sunniva Liu Carnegie Mellon University, A: Eric Zhao Carnegie Mellon University, A: Anthony Renouf Carnegie Mellon University, A: Dina El-Zanfaly Carnegie Mellon University DOI Authorizer link | ||