Best Products with Mixed Reality: Will Apple Pro Revolutionize the Industry?

Imagine walking down a busy street in your favorite city and seeing not only buildings, people, and cars around you but also a wealth of immersive and interactive digital content. As you walk by, you see some interesting historical buildings. With a wave of your hand, you browse its history and see holographic representations of how it looked at different periods. Then, you continue your walking and see digital billboards showcasing the latest fashion trends. One particular item catches your eye. With a glance, you virtually try it on, and (wow!) it looks perfect! With just a glance, you purchase with a confirmation tap, and the transaction is completed. Seems like a fantasy? Maybe. But this is the power of extended reality, and with Apple's recently unveiled Vision Pro headset, it may be just over the corner. 

Different terms can be used to address this technology that mixes original and virtual reality. Initially, industry experts used the term “augmented reality” (AR). It is sufficient to have a device with a screen to create augmented reality. The technology allows users to see digital objects embedded in the real environment. With the evolution of immersive technologies, experts started talking about “mixed reality” (MR), covering everything between the physical world and virtual reality, where these realities coexist and interact with each other. Today, MR is often used as a term combining AR and VR, although many prefer AR/VR for clarity. The term “extended reality” (XR) has also gained popularity in recent years. It unites all types of digital manipulations with the world - AR, VR, and MR. 

There are numerous areas where MR can be applied: healthcare, education, entertainment (including games), commerce, and many more. There are especially many applications in commerce  - from embedding virtual IKEA furniture into interiors to trying on virtual clothes. Until now, we have mainly been used to MR experiences through mobile or tablet screens. But will this technology move beyond screens for a more immersive experience?

There are already a fantastic number of smart glasses and headsets presented by different companies, including tech giants such as Amazon, Snapchat, Meta, and Microsoft, that have tried to bring MR technology outside the frames of the screens. There are numerous smart glasses, starting from Google Glass, one of the first widely recognized smart glasses, to Ray Ban Smart Glasses released recently. But they focus on features like making calls, photos or videos, and displaying notifications. Some models also incorporate limited AR capabilities, for instance, overlaying digital information onto the user's field of view, displaying navigation instructions, recognizing objects, or providing contextual information based on the user's surroundings.

But what about devices that enable real immersive interaction with digital images using eye and hand-tracking technology? We can name the following prominent released AR/EX headsets that tried to make a breakthrough in the industry:  Microsoft's HoloLens, Magic Leap, and Meta Quest 3. 

Microsoft's HoloLens 2

(Price: $3,500)

Microsoft's HoloLens 2 headset is an updated version of the original HoloLens released in 2016 and 2019, respectively. It combines VR and AR technologies by overlaying holographic images onto the user's field of view, creating an immersive experience. The headset is equipped with sensors, cameras, and advanced processors to track the user's movements and surroundings accurately. HoloLens 2 supports spatial mapping and enables natural interaction using gestures. It also supports spatial audio, eliminating the possibility of environmental isolation. One of the main drawbacks of the device is the small field of view, which some users compare to looking through the window of a helmet worn by welders.

Magic Leap 2 

(Price:  $3,299)

Magic Leap 2 is another prominent MR headset that uses spatial computing technology to blend digital content with the real world. The headset is the updated version of Magic Leap One, released in 2018 and 2022, respectively. It includes features such as eye tracking, hand tracking, and 6DoF (six degrees of freedom) tracking that allow users to interact with digital objects in a more natural and intuitive way. The device is also equipped with modern optics that provide high resolution and clarity, and its relatively wide field of view enhances the feeling of immersion. Since the processor was placed in a separate device, the glasses turned out to be quite lightweight. 

Meta Quest 3 

(Price: $499.99 for 128GB)

Meta Quest 3 is another popular MR headset released in 2023. Initially developed and released by Oculus, Oculus was later acquired by Facebook (now known as Meta). While its predecessor, the Quest 2, is limited to VR, the Quest 3 introduces MR mode, seamlessly blending virtual and real environments. The Meta Quest 3 also surpasses its predecessor in offering a remarkably sharp visual experience with improved resolution, a wider field of view, and exceptional colored passthrough quality. It blurs the boundaries between the real and virtual worlds through two RGB color cameras, a depth sensor, and a high-fidelity real-color camera. Its best price on the market makes it the best available option among all MR headsets for today.

These three XR headsets represent significant milestones in AR and MR industry development and have influenced the evolution of immersive technologies. But unlike their fully VR counterparts that gained their fair share of fans in the entertainment and gaming industries, none of those headsets has actually received widespread adoption among consumers despite manufacturers emphasizing that their gadgets can show both fully VR experiences and work in MR mode. 

But, finally, on February 2, 2024, Apple introduced its first XR headset, Vision Pro, which the company has been developing for at least 16 years. A patent similar to the Apple Vision Pro headset was filed by Apple and accepted by the Patent Office in 2007. Vision Pro represents a significant advancement in XR technology, but considering it is not the first in this arena, why might this time be different? Apple has a history of improving technology and turning it into desirable, user-friendly products, as seen with the iPod, iPhone, and iPad. The bet is whether Vision Pro can succeed where others have failed.

Apple Vision Pro

(Price:  $3,499)

Apple Vision Pro

The Vision Pro headset concept is designed to merge the physical and digital worlds and is controlled through the user's eye, voice, gestures, and hand movements. There's also a Digital Crown for physical controls, just like the Apple Watch. Despite its high cost at $3,499, the headset received positive reviews from specialized media and tech bloggers who tested it in action.

Apple places a big emphasis on the fact that a person wearing a Vision Pro headset is not isolated from the outside world. For example, when a person is completely immersed in the virtual world and another person approaches him, the external screen allows others to make eye contact with the person wearing the Vision Pro headset. Apple has partnered with Zeiss to create optical inserts that magnetically attach to headset lenses for people with glasses. Apple has also put much effort into making the Vision Pro lightweight yet powerful. The display system consists of two micro-OLED displays with a total resolution of 23 million pixels. Videos are rendered in true 4K resolution with a wide color palette and high dynamic range. Multiple cameras, as well as a LiDAR Scanner, track users' eye and hand movements. The headset also supports spatial audio and can scan the user's environment to create an immersive experience. It's all powered by Apple's M2 chip, which runs in parallel with the R1 chip that processes input from the device's cameras, sensors, and microphones. Simply put, M2 is responsible for computing, and R1 ensures smooth operation of the device.

All this is housed in an aluminum and glass case, with a fabric strap that holds the headset on the user's head. The identification system occurs through an eye scan called Optic ID, which ensures that only the owner can access the headset.

It is also worth noting that although Apple Vision Pro opens up many possibilities, the company is asking an impressive $3,500 for the device, which is why many believe it is unlikely to become as widespread and in demand as any iPhone. However, there is information that Apple is already preparing a simplified version of Vision Pro to reduce the device's cost and turn the product into a mass hit. 

Bottom Line

Compared to smartphones or tablets, the use of XR headsets and smart glasses has the potential to improve the way we interact with the world, providing a more immersive and interactive experience. Can they overtake the use of smartphones as the primary way to obtain information and connect with others? We think we are still far away from it. Despite all the advantages, current XR headsets are inconvenient for transportation and require a separate bag. It is almost impossible to put them on/take off quickly. They also attract the attention of others, have a cord connecting the device to the battery, and the battery charge is not sufficient for long-term continuous operation. For now, they resemble the first phones, and the technology is still in its nascent stage and yet to evolve further to address current limitations and user concerns.