Supporting Responsive Cohabitation Between Virtual Interfaces and Physical Objects on Everyday Surfaces (EICS ’17)

Systems for providing mixed physical-virtual interaction on desktop surfaces have been proposed for decades, though no such systems have achieved widespread use. One major factor contributing to this lack of acceptance may be that these systems are not designed for the variety and complexity of actual work surfaces, which are often in flux and cluttered with physical objects. In this project, we use an elicitation study and interviews to synthesize a list of ten interactive behaviors that desk-bound, digital interfaces should implement to support responsive cohabitation with physical objects. As a proof of concept, we implemented these interactive behaviors in a working augmented desk system, demonstrating their imminent feasibility.

Download PDF

Xiao, R., Hudson, S.E. and Harrison, C. 2017. Supporting Responsive Cohabitation Between Virtual Interfaces and Physical Objects on Everyday Surfaces. In Proceedings of the 9th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Lisbon, Portugal, June 26 – 29, 2017). EICS ’17. ACM, New York, NY. Article 11.