What Mixed Reality Means for Enterprises

Mixed reality is predicted to have a significant impact on businesses in manufacturing. This new technology is blending the world around us with the virtual world by utilizing a headset. The most notable difference right now between the older augmented reality (AR) and mixed reality (MR) is that augmented reality is viewed through a flat-screen device, such as a smartphone or tablet. Mixed reality uses headsets such as the Microsoft HoloLens and Google Glass to see virtual information and virtual reality.

So how will mixed reality technology impact businesses, especially manufacturing in the future? One expert predicts that we would have business meetings conducted through a virtual reality world using mixed reality. Such a practice could reduce the need for traveling to meet with business partners. If this practice becomes widespread, it could impact the hotel and transportation industry. This idea is still a long shot and may never happen, though.

Another prediction made by an expert is that mixed reality could impact education, especially hands-on education. Mixed reality can provide information on how to assemble and repair a product right in front of our eyes using a headset. Will this mean that we will no longer have to train technicians to fix and assemble things? Once again, employees will still have to be trained to be familiar with parts and terminology. This does not mean that mixed reality cannot enhance education or provide us with new ways of learning.

By far, the most prominent implementation and use of mixed reality have been in the manufacturing sector. Companies such as Renault Trucks and Thyssen Krupp are giving their employees mixed reality headsets. The headsets let employees see in the form of mixed reality what steps they need to take to assemble or check a product.

Before mixed reality, assembly and quality control employees at Renault would have to resort to using paper instructions. The use of a handset is much more convenient and efficient. BAE Systems, a manufacturer of defense and aerospace equipment, says that its has reduced assembly times by over 50% since it gave employees mixed reality headsets.

Consulting company Deloitte says that up to 10% of Fortune 500 companies are testing or already using mixed reality technology to some extent. A business study conducted by Forester Research states that tens of millions of American workers could be using mixed reality glasses within a decade. The forecast is clear that mixed reality is set to slowly creep into the workforce and increase productivity in the workplace.

This article was originally published at RickGarson.org

The Future of Storytelling Using Interactive Mixed Reality

Storytelling continues to evolve, including the ways the world shares its tales. Oral stories, books, and film are traditional examples, but video games have become a big part of storytelling and have been doing well over the past three decades. It's no longer merely plumbers throwing fireballs or yellow circles eating dots. Now, more than ever, gaming as an art form is blossoming into a way to tell stories and deliver great experiences.

Versions of mixed reality have continuously come in and out of the gaming world, but the current landscape of Vive and Oculus Rift headsets is making a lasting impression. Here are two ways that MR is changing the future of storytelling, gaming, and other entertainment.

Visual novels (VNs) are essentially stories that are read and sometimes played just like a game. Using gaming consoles such as the Playstation or Xbox, you press buttons on the controller to retrieve text. On computers, pressing enter or spacebar has the same effect. Mario Brothers, Halo, Madden, FIFA, and Tetris are all well-known and global franchises. In Japan, an entire format has flourished around this medium, but its fandom isn't as popular yet in the West.

VNs aren't just text on a game cartridge or file. They often have other gameplay elements baked in, such as a basic Roleplaying Game (RPG), shooting game, puzzle game, or almost any other genre added to the text-reading format. Some of the best modern VNs are voiced as well and often include groundbreaking music that is sampled from other countries. This combination of narrated text, sound design, and artwork all come together to create a new form of modular storytelling, which means that any amount of words can be added to any story without the need for matching background images or animated cut scenes. Another benefit of the VN style is that it creates a possibility of alternate endings--and alternate paths even before the ending. Branching paths are a natural way to create a Choose Your Own Adventure (CYOA)-style game.

Hybrid reality (HR) is a method of overlaying digital images on top of a real-world display. Like a Head Up Display (HUD), it simply adds transparent, barely intrusive images to your viewpoint while allowing you to still see what's ahead of you. In storytelling, this can allow artists and developers to bring their tales into the real world. Holograms can be made more realistic by sending images of storytellers or digital graphics directly to headsets worn by people in libraries or their own living rooms.

When telling stories about the past, overlaying images and videos of artistic renditions can bring history alive. Museums use this technology to enhance masterpieces. In addition, visitors to fields that were once rivers or lakes, or parks that were once grand forests, can now be taken back in time through MR headsets.

This article was originally published on rickGarson.com.

How the US Army is Using Mixed Reality to Innovate Tank Training

Mixed reality is now a reality in the U.S. Army. SCOPE, the Synthetic Collective Operational Prototyping Environment, is the Army’s newest training protocol for its armored cavalry units. Developed at the Institute for Creative Technologies at USC and in conjunction with the Army Training Ground at Aberdeen and tank trainers at Fort Benning, SCOPE uses mixed reality to train its future tank commanders. In the past, trainees used role-playing as a training medium, but SCOPE will use AI to accomplish the tasks of tank gunner and loader.

The trainees are placed into a simulated, 3D battlefield environment with the objective of improving their skills, either during a training exercise or out on the battlefield. Tank commanders must learn to quickly consolidate and process input from both mission command and incoming enemies, then make whichever decision will best protect the lives of their crew.

TALK-ON, an early version of SCOPE, has already completed three rounds of testing at Fort Benning, and researchers are optimistic about their positive results. TALK-ON uses cognitive training and communications, but SCOPE will use a sophisticated sensor tracking system to train its commanders.

The project has taken almost two years to develop and is a combined effort of researchers and programmers, many of whom have military experience. This unique approach to tank training uses sensors to track the position of a person’s body and uses a headset to track eye movement so that specific areas can be targeted for additional training. Simulated repetitions enable tank commanders to become more comfortable with their tasks and more proficient at their jobs so they can save time and lives. 

Initially, three commanders will engage in simulated training that will test their performance levels in combat. Eventually, four commanders will participate, which will be representative of a full platoon of tanks. Training will be conducted at Fort Benning and commanders will use a 3D control box and a replicated joystick that will interface with their helmets. 

Each mission will consist of a briefing and various simulated exercises. The data amassed by SCOPE will provide a more comprehensive training regimen for future tank commanders by interpreting the way trainees translate incoming information into a decision. This will enable the Army to maximize the efficiency of its training methods by understanding the motivations behind the commanders’ decisions. Eventually, AI will be used to simulate crew responses as well.

The Army plans to start formal testing of SCOPE in the fiscal year 2020.

This article was originally published on rickGarson.org.

Mixed Reality and Healthcare

Mixed Reality, or “MR,” is the superimposition of virtual images onto real spaces. It is a relatively new technology, but it is already having a major impact on society. One field that is being impacted by MR is healthcare. Here are a few ways that MR is impacting medical practices around the globe.

Educating Young Professionals

Mixed Reality is a useful tool for educating young medical professionals. MR programs can help immerse students in the things that they are learning in a simulated, safe environment. One such program is called HoloPatient. Created by textbook publishing company Pearson in conjunction with Microsoft, HoloPatient uses HoloLens technology to provide students with interactive holograms to help them learn about the human body. These holograms show, in vivid detail, how the parts of the body work together and what they look like when they fail. They could have lasting effects on how professors teach medical students things like anatomy, chemistry, and more. 

Providing Continuity of Care

Mixed Reality could also help doctors provide better continuity of care for patients. It is an unfortunate reality that one doctor or nurse can not provide care for a single patient at all times. However, MR imaging could help doctors and nurses get relevant information about patients faster. Doctors and nurses who use MR are able to quickly learn about a patient’s medical history and relevant conditions, and they are better able to share this information with other medical professionals. With this information, practitioners are better equipped to respond to emergency situations and to provide better, more consistent care to patients who need it.

Making Surgery Easier

Mixed Reality is also making surgeries much easier and safer. Using MR, surgeons are able to see overlays of a patient’s vital data– as well as projections of the patient’s organs, provided by CT scans– overlaid over the patient’s body. According to an article published in the Acta Orthopedica, doctors who use MR technology “might [see] an improvement in outcomes for both surgeon and patient, without reducing the safety of the procedure.” This is because MR “provides a gain in accuracy and safety in the procedure which finally might result in the time-saving and correct positioning of the implant.”

The Benefits of Mixed Reality Learning in Employee Training

Mixed Reality (MR) training programs are very versatile. They can be found in the Department of Defense, major hospitals, and even in retail environments. Their prevalence is a testament to their superior utility over traditional training methods. 

Total Immersion

The concept of MR training is total immersion. MR enables trainees to interact both visually, audibly, and tactically. This total immersion experience helps them to better understand the concepts, objects, and processes involved in the tasks they are learning. MR also allows for a varied repertoire of pedagogical methods to suit the learner. 

For example, entertainment elements can be combined with MR training programs to help trainees stay motivated and focused. The total immersion aspect of MR also allows the instructor to teach from another location. They can be virtually present and work with the student instead of physically traveling to the site. MR training programs allow for versatile training methods which result in better-trained employees. 

Minimized Costs

MR training minimizes cost-expenditures related to training — both human cost and material cost. Minimizing the human cost of training means maximizing the safety of the training process. Instead of hands-on training with dangerous materials (which might also be costly), the materials can be simulated as interacting with the trainee’s real-world equipment. Conversely, if the trainee is learning to work with human subjects, such as a surgeon, they can use MR to eliminate both the cost of expensive medical materials and potential negative impacts on the patient. 

Better Analyze Performance

A less obvious benefit of MR is analytical data about the trainee that can be cross-referenced with data from the machines with which they work. MR can track the trainee’s eye movement, audible cues, and reactions. This allows the employer to not only better understand how the trainee is performing, but potentially gives them insight into new training methods, process reforms, and communication techniques.

MR extends the capabilities of VR and AR to generate a more meaningful experience and useful data. Many industries already implement MR training, and the evidence is overwhelmingly positive. MR provides a better training experience for trainees and employers by increasing safety and accessibility.

IKEA’s Immersive Showroom Experience

Finding interesting items is easy, but trying to tie together interior design can be much more difficult. There are many factors that go into designing a room and it’s hard to say how all these great items will look once they’re put together. That’s why IKEA created a virtual reality immersive showroom experience. 

IKEA Immersive Showroom Experience is available for download on the Oculus Store. It allows the consumer to switch between products and color schemes with ease so the desired look of a room can be easily achieved. Room designs can be saved and purchased directly from the VR experience to ensure everything purchased is what’s being seen through the VR headset. There’s no losing with this innovative new shopping tool. 

Interior design becomes easy when the finished product can be viewed before purchasing a single thing. Immersive Showroom Experience allows for sharing designs with others to show off personal creations or ensure everyone in the home is satisfied with the vision. Save rooms to compare options so the entire household can find the best option for their preferences. 

The combinations are endless. Use IKEA’s entire stockroom to make a personal showroom. It makes placing furniture easier upon arrival and ensures the accents and furniture flow perfectly unlike anything that was available prior to this innovative new showroom experience. 

Endless helpful features are included in this experience, like the ability to change the lighting to ensure the room looks just right at all times. Fabrics and coloration can quickly be swapped to meet everyone’s wants and needs. Panorama view is available for the entire room can be viewed in the most realistic way possible. The room can be seen as a whole as opposed to small chunks. Better than in person showrooms as this experience is catered to the individual creating it. 

Purchase everything needed to achieve that beloved look with ease and never have to worry about interior design perfection again. The whole family is sure to love creating this dream room experience as there are pieces designed for every room, occasion, and style. Know what’s coming before it arrives when downloading this useful tool conveniently from the Oculus Store.

This blog was originally published on RickGarson.com

Educational Learning with a Reality Sandbox

Augmented reality wasn’t very accessible to the general population until recently as more solutions are being released. AR allows people to interact with the physical world while it is simultaneously being manipulated by technology to enhance the experience. New applications such as the augmented reality sandbox are creating educational experiences for small children while the technology was previously aimed at older students. 

How The Augmented Reality Sandbox Works

There’s a computer projector focused on the sandbox itself. A motion sensing device above the sandbox allows for computing the topography within the sandbox making it educational as well as fun. The AR experience shows the formation of mountains and valleys in addition to how water would flow within the hypothetical space. This makes the augmented reality sandbox a great tool in assisting kids to realistically understand ecology in real time as well. With the addition of precipitation simulation, the box is able to show how space works not just in theory, but within different climates by presenting different weather patterns that are created by the user’s movements. Manipulations within the box are projecting on the sand in real time for a high-quality hands-on educational experience. 

Learning Applications

With this innovative project, children are able to see colorful indications that assist in reinforcing topographical concepts. It can help older children in learning how to read topographical maps in a more hands-on way and pre-school aged children and see how their manipulation changes the world around them. The great thing is that it is versatile to a large range of young students while also being a soothing activity. While toddlers may not fully understand the conceptual learning, they will still enjoy the colorful sand experience. 

The augmented reality sandbox is a fun and relaxing educational tool for a large range of curious students. The addition of AR to the children’s museum experience really helps kids to understand the effects that they have on the world around them in addition to how the world works in general. Implementing this kind of technology in learning environments will assist in general understanding as kids will have better access to hands-on learning as opposed to just relying solely on reading comprehension from textbooks.

This blog was originally published on RickGarson.com