ACM ISS 2023
Sun 5 - Wed 8 November 2023


In this workshop, we investigate the technology-driven transformation of seamless multimodal experience (SME) through addressing theoretical and methodological issues, exploring dimensions, guidelines, opportunities, as well as challenges for seamlessness innovation in HCI. We look into approaches to harness technologies to unlock the potential of multimodal user interfaces (MUIs) in seamless interactions. We will explore innovative SME concepts using a participatory design tool. The goal is to facilitate a shared understanding of a seamless framework among diverse perspectives, ultimately contributing to the development of a community network that extends beyond the scope of this workshop.

Call for Participation

What is this workshop about?

The workshop “Framing Seamlessness: Enhancing Future Multimodal Interaction from Physical to Virtual Spaces” will take place at ISS 2023. The central goal is to achieve a shared understanding among participants and establish a future framework for seamless multimodal experience in interactive surfaces and spaces, including its design space, guidelines, opportunities, and challenges. The workshop will be engaged with academic and industrial participants globally, spanning mobile interaction, automotive human-machine interface (HMI), musical entertainment, mixed reality (MR) and wearables domains. Ideally, participants will share their perspectives according to seamlessness in interactive surfaces and spaces, learn about the basic conceptual framework of seamless experience, and by groups co-create new concepts related to the shared interest within the industrial partners.

Who should attend this workshop?

We welcome participants from diverse design and HCI domains including but not limited to interactive surfaces and spaces, mixed reality, automotive HMI, mobile and smart terminals interaction, multi-modal interfaces, musical and art entertainment and wearables. Early-career researchers and Ph.D. students are strongly encouraged to participate to broaden their networks and explore new research directions.

How is the workshop structured?

The workshop will consist of an interleaved lunch break between thematic lightning talks and hands-on experiences, catering to both in-person and remote participants. Remote participants can join through our Zoom channel and Miro canvas. In the morning, co-organizers will deliver the lightning talks, followed by group formations. In the afternoon, participants will explore innovative SME concepts using a participatory design tool, followed by a round-table discussion. Ultimately, the representatives of organizers and participators will be invited to summarize the discussion and deliver closing remarks. The workshop will conclude with a shared understanding of seamless multimodal design and creative networks among participants.


Please contact Fangli Song ( for further information.