The user experience with augmented reality applications is at its best when it’s multimodal. As much as possible, users should be able to use gaze, gesture and voice in a seamless blend to create an interaction with the digital world that’s as natural as interaction with the physical world -but with all the added action possibilities that the digital overlay affords. That means that in order to create awesome augmented reality user experiences, you need to be able to design user interaction for all modalities. In this video, we’ll go through what you need to consider when designing voice interaction for augmented reality. Voice interactions have become ubiquitous and are also part of augmented reality, so you should know how to design for them!
Using voice interaction with augmented reality can really benefit the user by making the interaction fast and effortless, but it also has limitations; so, make sure you use it where it’s most appropriate – public places and fine-grained control are not the best match for voice interaction. When you design voice commands, make sure they are brief and simple, so they’re easy for users to utter and remember. To ensure that your entire user base can use your design, check that it can understand people with different accents. Testing your app with different types of users will help in broadening its scope to deliver pleasing and impressive experiences every time.
References and Where to Learn More
You can see Microsoft’s guidelines for voice design for HoloLens here: https://docs.microsoft.com/en-us/windows/mixed-rea...
Hero Image: Copyright holder: Jisc. Copyright terms and license: CC BY-NC-ND