Mixed Reality Filming Without a Green Screen

I’ve made a proof concept video for mixed reality filming without setting up a green screen, having to light it correctly etc.

Essentially this would work for anything like Tilt Brush etc because you can place the virtual item in the physical world, which would include the person, and composite the video that way around – of course using a third person physical and virtual camera view as you would with the normal green screen method. This is obviously much cheaper and less hassle.

Note that my FOV is not properly matched between the virtual and physical cameras so it looks a bit weird. My Vive tracker has arrived since making the video, so I’ll be using a DSLR for anything else I do with this technique.

If this were combined with my Lego HyperReality Blaster then I could actually shoot virtual bullets into the physical world and knock over physical targets also.