Jie Ren
ABSTRACT
We envision a combinative use of an AR headset and a smartphone in the future that can provide a more extensive display and precise touch input simultaneously. In this way, the input/output interface of these two devices can fuse to redefine how a user can manage application windows seamlessly on the two devices. In this work, we conducted a formative interview with ten people to provide an understanding of how users would prefer to manage multiple windows on the fused interface. Our interview highlighted that the desire to use a smartphone as a window management interface shaped users' interaction practices of window management operations. This paper reports how their desire to use a smartphone as a window manager is manifested.
Supplemental Material
- Mohammed Al-Sada, Fumiko Ishizawa, Junichi Tsurukawa, and Tatsuo Nakajima. 2016. Input forager: A user-driven interaction adaptation approach for head worn displays. ACM International Conference Proceeding Series December (2016), 115--122. DOI: http://dx.doi.org/10.1145/3012709.3012719Google Scholar
Digital Library
- Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. SymbiosisSketch: Combining 2D & 3D sketching for designing detailed 3D objects in situ. Conference on Human Factors in Computing Systems - Proceedings 2018-April (2018). DOI: http://dx.doi.org/10.1145/3173574.3173759Google ScholarDigital Library
- M. Billinghurst, J. Bowskill, N. Dyer, and J. Morphett. 1998. An evaluation of wearable information spaces. In Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180). 20--27. DOI: http://dx.doi.org/10.1109/VRAIS.1998.658418Google ScholarCross Ref
- Li-Wei Chan, Hui-Shan Kao, Mike Y. Chen, Ming-Sui Lee, Jane Hsu, and Yi-Ping Hung. 2010. Touching the Void: Direct-Touch Interaction for Intangible Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, NY, NY, USA, 2625--2634. DOI: http://dx.doi.org/10.1145/1753326.1753725Google ScholarDigital Library
- Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014b. Ethereal planes: A design framework for 2D information spaces in 3D mixed reality environments. SUI 2014 - Proceedings of the 2nd ACM Symposium on Spatial User Interaction October (2014), 2--12. DOI: http://dx.doi.org/10.1145/2659766.2659769Google ScholarDigital Library
- Barrett M. Ens, Rory Finnegan, and Pourang P. Irani. 2014a. The Personal Cockpit: A Spatial Interface for Effective Task Switching on Head-Worn Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, NY, USA, 3171--3180. DOI: http://dx.doi.org/10.1145/2556288.2557058Google ScholarDigital Library
- Steven Feiner, Blair MacIntyre, Marcus Haupt, and Eliot Solomon. 1993. Windows on the world: 2 D windows for 3 D augmented reality. In ACM Symposium on User Interface Software and Technology. 145--155.Google Scholar
- George W Fitzmaurice. 1993. Situated information spaces and spatially aware palmtop computers. Commun. ACM 36, 7 (1993), 38--50.Google ScholarDigital Library
- Jens Grubert, Matthias Heinisch, Aaron Quigley, and Dieter Schmalstieg. 2015. MultiFi: Multi-fidelity interaction with displays on and around the body. Conference on Human Factors in Computing Systems - Proceedings 2015-April (2015), 3933--3942. DOI: http://dx.doi.org/10.1145/2702123.2702331Google ScholarDigital Library
- S. J. Henderson and S. Feiner. 2009. Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In 2009 8th IEEE International Symposium on Mixed and Augmented Reality. 135--144. DOI: http://dx.doi.org/10.1109/ISMAR.2009.5336486Google ScholarDigital Library
- Joon Hyub Lee, Sang-Gyun An, Yongkwan Kim, and Seok-Hyung Bae. 2018. Projective Windows: Bringing Windows in Space to the Fingertip. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article Paper 218, 8 pages. DOI: http://dx.doi.org/10.1145/3173574.3173792Google ScholarDigital Library
- A. Millette and M. J. McGuffin. 2016. DualCAD: Integrating Augmented Reality with a Desktop GUI and Smartphone Interaction. In 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct). 21--26. DOI: http://dx.doi.org/10.1109/ISMAR-Adjunct.2016.0030Google ScholarCross Ref
- Patrick Reipschläger and Raimund Dachselt. 2019. DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (ISS '19). ACM, NY, NY, USA, 29--41. DOI: http://dx.doi.org/10.1145/3343055.3359718Google ScholarDigital Library
- Anselm Strauss and Juliet Corbin. 1990. Basics of qualitative research. Sage publications.Google Scholar
- Hemant Bhaskar Surale, Aakar Gupta, Mark Hancock, and Daniel Vogel. 2019. TabletInVR: Exploring the Design Space for Using a Multi-Touch Tablet in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article Paper 13, 13 pages. DOI: http://dx.doi.org/10.1145/3290605.3300243Google ScholarDigital Library
- Jia Wang and Robert Lindeman. 2014. Coordinated 3D Interaction in Tablet- and HMD-Based Hybrid Virtual Environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction (SUI '14). ACM, NY, NY, USA, 70--79. DOI: http://dx.doi.org/10.1145/2659766.2659777Google ScholarDigital Library
Index Terms
- Understanding Window Management Interactions in AR Headset + Smartphone Interface
Recommendations
Evaluating Menu Techniques for Handheld AR with a Smartphone & Mid-Air Pen
MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and ServicesAdding a mid-air pen to Handheld Augmented Reality creates a new kind of bimanual interaction for which many fundamental interaction design questions have not been answered yet. In particular, menus are an essential component in most visual interfaces, ...
Improvement of smartphone interface using an AR marker
VRCAI '12: Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in IndustrySmartphones have come into wide use recently, and are increasingly popular not only among young people, but also among middle-aged people as well. Most smartphones use a capacitive full touch screen, where touch commands are made by the user's fingers, ...
Development of an Inexpensive Augmented Reality (AR) Headset
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsWe outline our work in developing an Augmented Reality (AR) headset with low purchase and maintenance costs. Similar to Google Cardboard, the headset uses a smartphone to provide the compute power, connectivity and display. Unlike Google Cardboard, our ...
Comments