3D capture technology is making incredible strides, but outside of Motion Capture, it remains fairly static. There are too many artifacts and segmentation issues to easily and accurately capture moving and warping objects.
Nor does this provide insights as to the structural properties of an object and its material, e.g. a paper cup, a ceramic mug, an enamel tankard.
However, there are other ways to infer information about the structural properties. This amazing demonstration of derivatives of eulerian movement magnification tech shows the possibilities to digitise object structural properties just from video.
Humanity has a vast repository of video data to work with – approximately 500 hours of it are uploaded to Youtube alone every single minute.
This provides the missing component necessary to accurately simulate and animate physical and virtual objects in real-time within mixed-reality situations. One step closer to 'effortless' AR.
