This is next-level geeking out right here.
Hands down the biggest problem all forms of VR have right now is showing someone who isn’t in the headset what is going on. Putting a 2D image on a screen that shows me what you see out of one eye doesn’t do much for me. It doesn’t give me the emotional feel, no sense that you as the player are actually in the world you are viewing. It’s a real problem, and a lot of very smart people have found clever ways to solve this in some cases with depth-sensing cameras and green screens. The results are a little mixed, and difficult to reproduce in every game, but still very cool.
Microsoft has its own solution. Originally, this solution was a way to show everyone what was happening inside of Hololens. It has been adapted for occlusive Mixed Reality headsets, and the results are ridiculously cool. Unfortunately, it’s not something any of us are ever going to be able to do on our own.
This big, complicated box of wires here has three different very important parts. At the top, you have Hololens to act as a sort of virtual camera. Wherever the Hololens is in the real world, that’s where the camera will be recording from in the virtual world. Under that you have a big DSLR camera, which is capturing a high quality video of the person in the real world. In this situation, Alex Kipman.