In recent years, both Virtual Reality and Augmented Reality have dominated the technology industry like never before. Whether in media coverage, video games or other commercial applications, reality technologies can be found everywhere. The market is already witnessing enormous growth and the future will be even more favorable in terms of sales and revenue.
We have already discussed Virtual Reality vs. Augmented Reality and related terms, but now it's time to familiarize ourselves with the concept of Mixed Reality, also known as Hybrid Reality. This term is a combination of Virtual and Augmented Reality and is gradually taking over the market with its highly impressive capabilities.
Mixed Reality is what exists between the real and the virtual world and despite being a mix; works as an independent technology. It is a much stronger and higher-level reality technology that covers all types of variations made in a virtual or real environment.
To get a clearer idea, let’s go into details:
Mixed Reality Continuum
In 1994, Paul Milgram and Fumio Kishino defined mixed reality as something that lies “anywhere between the extremes of the virtuality continuum.” This Reality-Virtuality Continuum extends from the real environment, followed by augmented reality and augmented virtuality, to the virtual environment.
Mixed Reality Continuum (image courtesy: realitytechnologies.com)
As you can see in the diagram above, the two ends of the continuum are denoted as real environment and virtual environment. The former is completely real, with no computer-generated data, while the latter contains an environment where everything is computer-generated. In between, there are two technologies, namely
Augmented reality: In this, virtual information is placed in the real world setting, where users can experience virtually created images, sounds and feelings. For example, wearing smart glasses or other headphones while playing video games would isolate you from the real world.
Augmented Virtuality: This is the reverse condition where real-world objects are inserted into a computer-generated virtual world. For example, using an application for interior decoration or remodeling any part of the house, it presents a digital view of real objects.
What is mixed reality?
Mixed Reality can be defined as virtual spaces where physical and digital objects coexist and interact with each other in real time. In a broader sense, it includes augmented reality, augmented virtuality and other types of mixed settings. In such an environment, the user is free to navigate both the virtual and the real environment, where virtual objects are anchored in real-world space.
This technology makes use of sensors, advanced optics, and cutting-edge computing powers that are stacked into one device (usually a headset). When using this device, the user can superimpose virtual objects in space and real time, interact with them and manipulate them; where everything seems to be “real”.
Mixed Reality Technology
Mixed Reality maps a physical environment into a 3D image and therefore evaluates where exactly to place digital content in real space. It creates environments where the use of transparent lenses, spatial sound along with an understanding of the physical environment allows the display of holograms that look, sound and behave realistically, which can sometimes be felt.
X-Ray Mixed Reality Project Game demonstration (image courtesy: YouTube)
The image mentioned above is a demonstration of the Microsoft HoloLens Gaming System where the user is playing Project X-Ray . The device that can be seen in his hands appears in the form of a holographic gauntlet that is the weapon to combat enemies. During the game, the user is free to move around the room and would hear the sound as if everything were happening in the same room.
Another surprising fact about this technology is that the game's robots know exactly where the walls and furniture are and can use this information to plan attacks on the player. There are different modes and there is even a holographic shield that can protect the player from larger robots.
Mixed Reality Apps
The use of MR technology is not just restricted to video games and entertainment. There are numerous fields and ways in which we can use MR to interact, play, learn and communicate with the virtual world in a real setting.
Following are some of the applications of Mixed Reality:
1. Communication
Microsoft HoloLens holoportation (image courtesy: YouTube)
In the near future, MR will redefine the way we interact with our friends and family. With the help of Microsoft HoloLens, it was even possible to see and talk to people located thousands of kilometers away through Holoportation. In a demonstration video, it is shown how two people talk face to face without even being present in the same room.
Not only that, but the entire session can also be recorded and played back. Furthermore, because it is a 3D representation, it can be miniaturized and viewed from all different perspectives. It's almost like traveling back in time and being able to observe memories from every possible angle.
2. Education
Esper Project Demo (image courtesy: Vimeo)
As technology has already brought significant changes in education, Mixed Reality will further enhance it with all the details and descriptive visuals. The Esper Project is one such venture by 3D4Medical Lab that aims to help medical students in learning anatomy using Augmented and Mixed Reality .
Using this technology, students can get a detailed view of the human body with all the parts and organs needed to zoom in or out using hand gestures. It would also display details of the organs selected by the user. Furthermore, students can even record and playback classes and learn things through 3D digital images.
3. Advertising
Mixed Reality Advertising (Image courtesy: realvision.ae)
Access to devices and gadgets offers companies new opportunities for market promotion. It's a unique way to display interactive details about products to end consumers in a way never seen before. Many brands will display 3D content on the packaging itself, including digital discounts and product benefits. For example, Coca-Cola can offer a realistic experience of games, music or sporting events in 3D.
4. Machine Learning
Mixed Reality Machine Learning (Image courtesy: evolveent.com)
As Mixed Reality combines physical objects in real spaces with virtual elements, there must be some relevant content in each object that must be used as part of the technology. So an AR startup called Blippar is working on a real-time deep learning engine using advanced computer vision.
Through this technology, almost all everyday objects will be recognized and a certain amount of digital content will be displayed on top of these objects through the network . Instead of using voice or written commands, it would simply need your eyes to unlock search queries, and it would display information like the nutritional value of a fruit, the recipe for a food, or the location of a commodity.
5. Entertainment
Microsoft HoloLens use case in entertainment (image courtesy: thedrum.com)
Microsoft is striving to change the way people watch sports on television. We already have features such as pausing live broadcasts and recording them to watch later or transmitting images and videos from your cell phone to your television and even browsing the Internet on your TV sets.
But the next big thing will be a cool HoloLens feature that would allow users to have a 360-degree view of the game on their TV, where the off-screen area is automatically projected onto the walls. They would also be able to view a 3D holographic view of the game on their coffee table or zoom in to focus on a specific player through hand gestures. It's still early days to reach the masses, but things are gradually changing for sure.
6. Business
Mixed reality commercial application (image courtesy: YouTube)
When dealing with enterprise customers, companies can make great use of mixed reality to leverage the benefits of the technology. For example, a sales rep might go to the doctor and, instead of a normal meeting, might use MRI headsets to demonstrate the medicine, its chemical makeup, and how it works inside the body. This would give a clear and better idea about the product and help in promotion.
Another example is explained in a video released by Windows where a girl is forced to set up a shoe store for a group of customers. With the help of Microsoft HoloLens she is able to move holograms around the space in real time and even get design inspirations to prepare the entire interior. If this could happen in the future, it would completely change the way business is done in business.
Market participants and investments in MR
Microsoft
Microsoft HoloLens headset (image courtesy: microsoft.com)
The prerequisite for Mixed Reality to reach the masses is to make it as portable and accessible as possible. Currently, Microsoft's HoloLens is the world's first and only wireless holographic computer that can be purchased for $3,000. It works without wires, cables, external camera or PC connection and has more computing power than a typical laptop. Currently, it is designed to be used in businesses for tasks such as construction and architecture.
Litter
Apple's future plan to develop an MR mobile device (image courtesy: wearable)
According to market reports, it is speculated that Apple's upcoming iPhone 8 will be a mixed reality device. It would feature next-generation OLED display, wireless charging, and 3D sensor from Primesense. Additionally, it would be equipped with eye sensors that offer a higher frame rate and polygon count than an MR device connected to a PC and an Nvidia graphics card.
Beginners
Additionally, there is a Florida-based startup called Magic Leap that aims to present innovative developments, but for now everything is restricted to video demonstrations. Many big brands (including Google) are investing and the value has already reached US$4.5 billion. Another name on the list is Meta 2, which displays virtual 3D holograms on the display with a wider field of view, where the user can grab, pull or stretch objects. It's likely to be available for purchase by the end of 2017 or later.
Magic Leap promises that mixed reality will be magical (image courtesy: YouTube)
Moving forward, there are certain companies that want to make this technology accessible to the masses. An AR company called Zappar has announced the development of the world's first cardboard mixed reality headset called ZapBox. It comes with cardboard controllers and a special wide-angle camera lens for just $30 on Kickstarter. On the other hand, a startup called Occipital has designed a hybrid MR/VR HMD solution called Bridge for $399, designed especially for iOS users.
ZapBox Cardboard Headset Components (Image courtesy: Digital Trends)
Needless to say, MR has great potential to take control of the future and all the technology giants are investing huge amounts of money for its advancement. In addition to Microsoft and Apple, companies such as Lenovo, Acer and Asus are also developing their respective prototypes. Furthermore, major market players such as Google, Facebook and even Snap Inc. are making acquisitions and investing a lot of money in these ventures.
You can read our Blog and Article section for more topics on electronic engineering, industry and technology.
