The architectural design process involves the development of spatial explorable 3D models, but the computer screen is main medium to communicate information to clients. Yet, Augmented Reality (AR) and Virtual Reality (VR) are the closest way to replicate our world, create new ones and interact within them. AR and VR headsets offer different ways to allow multiple stakeholders to effectively immerse themselves in 3D representations of design projects. But, to interact within these spaces and to perform design modifications, the development of new workflows is required. This research presents a new method where AR is used to visualize and edit project models using both voice recognition and hand-gestures software. While numerous projects are addressing software interoperability issues, user-interaction in an AR space remains a developing area of crucial relevance in research. Although hand-gestures are the usual form of model-state control employed in such systems, voice-control is emerging as a highly desirable and everyday form of human-computer interaction. This paper presents a plugin for the Hololens that allows the user to use voice and hand gestures to enhance the ability to work with 3D models and discusses and evaluates the project.

A link to the CAADRIA published paper can be found here.

Pretty impressive right? We should talk about it!