MistForm

Adaptive Shape Changing Fog Screens for 3D Spatial Interactions

 Overview

We propose MistForm, a shape changing fog display that can support one or two users spatially interacting with either 2D or 3D content. Mistform combines affordances from both shape changing interfaces and mid-air displays. For example, a concave display can maintain content in comfortable reach for a single user, while a convex shape can support several users engaged on individual tasks. MistForm also enables unique interaction possibilities by exploiting the synergies between shape changing interfaces and mid-air fog displays. For instance, moving the screen will affect the brightness and blurriness of the screen at specific locations around the display, creating spaces with similar (collaboration) or different visibility (personalized content). We describe the design of MistForm and analyse its inherent challenges, such as image distortion and uneven brightness on dynamic curved surfaces. We provide a machine learning approach to characterize the shape of the screen and a rendering algorithm to remove aberrations. We finally explore novel interactive possibilities and reflect on their potential and limitations.

 Work Flow

1 Dynamic Actuation of Immaterial Fog Screen

2 Calibration and Modeling of Shape Changing Fog Screen

3 Correction of the Projection Distortion and Uneven Brightness on Curved Fog Screen

 System Demonstration

Context-awareble 2D Interaction for a single or multi user

Natural 3D Depth Interaction

Multi-view 3D Imaging for Two Users

Main Video

Publications

Paper Yutaka Tokuda, Mohd Adili Norasikin, Sriram Subraman, Diego Martinez Plasencia. 2017. MistForm: Adaptive Shape Changing Fog Screens. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI'17), pp.4383--4395. https://doi.org/10.1145/3025453.3025608   PDF Slide [79.9MB]

 Selected Press Coverage