See MotionBuilder mocap data streamed to a HoloLens
Indie mocap tools pioneer Jasper Brekelmans has just posted a cool tech demo showing motion-capture data being streamed over WiFi from MotionBuilder to Microsoft’s HoloLens AR headset.
The set-up, built using the Unity game engine, enables the user to see the data applied to a 3D character as if that virtual character were standing in front of them in the room.
A live augmented reality preview of mocap data
“The idea behind it is to give VFX supervisors and directors the ability to see virtual characters on their movie set while walking around, and without the need for looking through a camera/tablet screen,” says Brekelmans.
As well as being low-cost, such a system would give users a live, interactive augmented reality preview of mocap data, using only tools with which they are already familiar.
Control an AR mocap avatar using mouse, gesture and voice controls
In the demo, Brekelmans uses a mixture of standard keyboard and mouse controls to repose the character or start playback inside MotionBuilder; and gesture and voice controls to reposition the 3D avatar in virtual space.
The system includes spatial awareness, so the avatar automatically snaps to the floor or surrounding surfaces; and there is an option to display motion trails. It looks extremely cool.
Availability
At the minute, the system is just a tech preview, but Brekelmans has some more info on the HoloLens and its potential for CG work on his website, which you can read via the link below.