{"id":94899,"date":"2020-10-21T20:03:55","date_gmt":"2020-10-21T17:03:55","guid":{"rendered":"https:\/\/en.buradabiliyorum.com\/a-human-motion-capture-system-using-a-single-wearable-camera\/"},"modified":"2020-10-21T20:03:55","modified_gmt":"2020-10-21T17:03:55","slug":"a-human-motion-capture-system-using-a-single-wearable-camera","status":"publish","type":"post","link":"https:\/\/buradabiliyorum.com\/en\/a-human-motion-capture-system-using-a-single-wearable-camera\/","title":{"rendered":"#A human motion capture system using a single wearable camera"},"content":{"rendered":"

“#A human motion capture system using a single wearable camera<\/strong>”<\/p>\n

\n
\n
\n
\"MonoEye:
\n MonoEye captures 3D body pose as well as the user’s perspective. MonoEye is based on a single ultra-wide fisheye camera worn on the user’s chest, enabling activity capture in everyday life. Credit: Tokyo Institute of Technology<\/a>
\n <\/figcaption><\/figure>\n<\/div>\n<\/div>\n

Researchers at Tokyo Institute of Technology (Tokyo Tech) and Carnegie Mellon University have together developed a new human motion capture system that consists of a single ultra-wide fisheye camera mounted on the user’s chest. The simplicity of their system could be conducive to a wide range of app<\/a>lications in the sports, medical and entertainment fields.<\/p>\n

Computer vision-based technologies are advancing rapidly owing to recent developments in integrating deep learning. In particular, human motion capture is a highly active research area driving advances for example in robotics, computer generated animation and sports science<\/a>.<\/p>\n

Conventional motion capture systems in specially equipped studios typically rely on having several synchronized cameras attached to the ceiling and walls that capture movements by a person wearing a body suit fitted with numerous sensors. Such systems are often very expensive and limited in terms of the space and environment in which the wearer can move.<\/p>\n

Now, a team of researchers led by Hideki Koike at Tokyo Tech present a new motion capture system that consists of a single ultra-wide fisheye camera mounted on the user’s chest. Their design not only overcomes the space constraints of existing systems but is also cost-effective.<\/p>\n

Named MonoEye, the system can capture the user’s body motion as well as the user’s perspective, or ‘viewport’. “Our ultra-wide fisheye lens has a 280-degree field-of-view and it can capture the user’s limbs, face, and the surrounding environment,” the researchers say.<\/p>\n

To achieve robust multimodal motion capture, the system has been designed with three deep neural networks capable of estimating 3-D body pose, head pose and camera pose in real-time.<\/p>\n

Already, the researchers have trained these neural networks with an extensive synthetic dataset consisting of 680,000 renderings of people with a range of body shapes, clothing, actions, background and lighting conditions, as well as 16,000 frames of photo-realistic images.<\/p>\n

Some challenges remain, however, due to the inevitable domain gap between synthetic and real-world datasets. The researchers plan to keep expanding their dataset with more photo-realistic images to help minimize this gap and improve accuracy.<\/p>\n

The researchers envision that the chest-mounted camera could go on to be transformed into an everyday accessory such as a tie clip, brooch or sports gear in future.<\/p>\n

The team’s work will be presented at the 33rd ACM Symposium on User Interface Software and Technology (UIST), a leading forum for innovations in human\u2013computer interfaces, to be held virtually on 20\u201323 October 2020.\n <\/p>\n\n

\n

OpenMonkeyStudio: A deep-learning-based system to estimate 3-D poses of freely moving macaques\n <\/p><\/div>\n

\n
\n More information:<\/strong>
\n Dong-Hyun Hwang et al. MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera.
\n
Conference. The Association for Computing Machinery (ACM) Symposium on User Interface Software and Technology 2020 (UIST2020) uist.acm.org\/uist2020\/<\/a><\/p><\/div>\n
\n Provided by
\n Tokyo Institute of Technology
\n
\n <\/svg><\/a><\/p><\/div>\n

<\/p>\n

\n

Citation<\/strong>:
\n MonoEye: A human motion capture system using a single wearable camera (2020, October 21)
\n retrieved 22 October 2020
\n from https:\/\/techxplore.com\/news<\/a>\/2020-10-monoeye-human-motion-capture-wearable.html<\/p>\n

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
\n part may be reproduced without the written permission. The content is provided for information purposes only.<\/p><\/div>\n<\/p><\/div>\n