The Univ of Tokyo: Mmulti-person / VM capture tech: motion analysis and 3D animation

The Univ of Tokyo: Mmulti-person / VM capture tech: motion analysis and 3D animation

The University of Tokyo / NTT DOCOMO

The University of Tokyo’s Nakamura Laboratory says, “We have a technology to capture VMs using only camera images”.

This time, by applying this technology, developed a technology for capturing multiple people / VMs using only camera images.

“VMocap * 1” is applied.

Multi-user / VM capture in a large space without using special equipment or suits” can be performed.

Fields of use:

Sports matches,
Live venues,
Create motion analysis and 3D animation,

You can easily get motion data anywhere.

Generally, special equipment and suits are required to perform motion capture.

In addition, measurement locations and usage scenes are limited.

Conventional technology:

Difficulty of analysis due to overlapping of people on the video,
Can only be used in environments where the background is easy to cut out,
Multi-person / high-precision VM capture technology has not been realized.

The technology this time:

This technology “automatically selects / switches the optimal video from multiple cameras“.

In addition, even under “the situation where the body appears to overlap on the image”, “continuity of human skeletal structure / motion” is estimated by the latest technology.

Futsal: Demonstration of technology

Even in scenes where multiple players move around violently, we confirmed that “highly accurate VM data and bone movement can be acquired.”

Robotics: Motion analysis technology

Applied the motion analysis technology * 2 based on robotics from Nakamura Lab.

“We can calculate and visualize not only the movement of bones but also the strength of the body and the activities of muscles.”

This makes it possible to consistently measure and analyze motion using only the images from multiple cameras.

Future use:

Applicable to soccer, baseball, gymnastics, figure skating,
Training and tactical analysis,
3D animation creation,
It will also be used for exercise evaluation at nursing and rehabilitation sites.

Information | NTT DOCOMO

https://www.nttdocomo.co.jp/info/news_release/2020/01/17_00.html