SurfaceFleet: Exploring Distributed Interactions Unbounded from Device, Application, User, and Time
in Proceedings of the 33rd Annual Symposium on User Interface Software and Technology (UIST '20)
Knowledge work increasingly spans multiple computing surfaces. Yet in status quo user experiences, content as well as tools, behaviors, and workflows are largely bound to the current device—running the current application, for the current user, and at the current moment in time.
SurfaceFleet is a system and toolkit that uses resilient distributed programming techniques to explore cross-device interactions that are unbounded in these four dimensions of device, application, user, and time. As a reference implementation, we describe an interface built using Surface Fleet that employs lightweight, semi-transparent UI elements known as Applets.
Applets appear always-on-top of the operating system, application windows, and (conceptually) above the device itself. But all connections and synchronized data are virtualized and made resilient through the cloud.
For example, a sharing Applet known as a Portfolio allows a user to drag and drop unbound Interaction Promises into a document. Such promises can then be fulfilled with content asynchronously, at a later time (or multiple times), from another device, and by the same or a different user.
Time’s short? Choose your level of detail to dive into the paper through video:
- 4 minute video figure showing some of the interactions
- Full 15-min paper talk
- 30s video preview
- 5-minute paper talk
- Supplemental material showing more of the interactions, but slightly outdated
