The rise of extended reality (XR) is poised to have a major impact on the field of UX design. As XR technology becomes more sophisticated, UX designers will need to adapt their approaches to account for the unique challenges posed by XR applications. As Augmented reality (AR) technology continues to develop, there is an increasing need for designers who can create engaging and user-friendly AR experiences. This is where UX design comes in, UX designers help create AR experiences that are not only functional but also enjoyable to use. They use their skills in user research, user testing, and interaction design to create AR applications that are easy to use and provide a great user experience. The step from handheld AR to wearable AR headsets is a huge transition for UX designers, thus being obliged to find solutions to new challenges that arise. For example, sociocultural and privacy issues Google Glass faced during its consumer release in 2013.
Adobe Aero enables UX design prototyping and testing for user interaction within an environment using imported 3D objects. The application allows testing and fine-tuning of typical object properties. This allows UX designers to evaluate 3D design choices that can then be adjusted according to the test results. This application is available on mobile devices, but it's still in beta. This is an amazing app that enables designing of 3D objects without the need to code, which can be a great tool for educators to create and use.
The Five Pillars of UX Design for AR
Source: Wikipedia
AR is a spatial technology that is always interconnected with the real world. Designing an AR experience starts by looking at the environment, which can be categorized based on how close or far away it is.
AR in the intimate space: Face filters, hand tacking, or hand augmentation if you use AR glasses.
AR in the personal space: Features real objects or people around you. This can work best in education. Another example would be table-top and card games and augmented packaging (collectible cards with augmented characters that interact with each other)
AR in the social space: This space segment is widely used for multiplayer AR games or augmenting objects on a scale, from furniture to monuments and buildings.
AR in the public space: Anchored to specific locations with enough area to place an augmentation or sites that should be tracked in AR, e.g., Mumok AR.
A successful new product directly depends on how well it intermixes with today's users' minds, both physically and psychologically. The area around the user is the most important element in AR, as mobile devices and AR glasses give opportunity for XR environments, the role of the designer here is to guide the user by including navigation elements to help them get around and experience the environment smoothly.
Creating user-friendly and engaging AR can be a challenge, especially in educational environments. Placing marks and directions on the screen is not enough, a UX designer needs to know the user's purpose, what they're looking at and how are they using it. The most important element in designing AR is usability, not accuracy. Another issue to consider is the limitation of technical devices in supporting AR features. For example, UX designers can guide users' by shaping an outline or a sketched silhouette to give a clue about the shape and size of the desired object for the successful launching of the tracking algorithm.
To make the interaction as smooth as possible with objects at a great distance, UX designers increase the sphere's bounding box to make it less dependent on the distance to the camera. Minimizing input via finger might also be a good idea, especially when designing for tablet users.
The top gestures and features to interact with 3D AR objects are:
Tap to select
Drag starting from the center of the object to translate
Drag from the edge of the object to rotate
Pinch to scale
UI consists of augmented and traditional screen space. Depending on the use case, the UX designer will be using them interchangeably. While UI in the augmented space boosts immersion as the user perceives it as part of the experience, screen space UI is sometimes easier to read and interact with.
AR Device Categories
It uses a designated marker to activate the experience, e.g., QR codes, logos, and product packaging. The shapes should be recognizable for the camera to accurately recognize it within its surroundings.
It uses simultaneous localization and mapping process for placing content in the environment, i.e., IKEA Place app.
It is known as GPS-based AR, not as common as marker-base and markerless based AR. It can be used in travel and tourist industries, e.g., directional guidance (Google maps) and art installations around cities.