Sunday, July 3, 2022
SCIENMAG: Latest Science and Health News
No Result
View All Result
  • Login
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US
No Result
View All Result
Scienmag - Latest science news from science magazine
No Result
View All Result
Home SCIENCE NEWS Technology and Engineering

MonoEye: A human motion capture system using a single wearable camera

October 21, 2020
in Technology and Engineering
0
Share on FacebookShare on Twitter

IMAGE

Credit: ACM, UIST

Researchers at Tokyo Institute of Technology (Tokyo Tech) and Carnegie Mellon University have together developed a new human motion capture system that consists of a single ultra-wide fisheye camera mounted on the user’s chest. The simplicity of their system could be conducive to a wide range of applications in the sports, medical and entertainment fields.

Computer vision-based technologies are advancing rapidly owing to recent developments in integrating deep learning. In particular, human motion capture is a highly active research area driving advances for example in robotics, computer generated animation and sports science.

Conventional motion capture systems in specially equipped studios typically rely on having several synchronized cameras attached to the ceiling and walls that capture movements by a person wearing a body suit fitted with numerous sensors. Such systems are often very expensive and limited in terms of the space and environment in which the wearer can move.

Now, a team of researchers led by Hideki Koike at Tokyo Tech present a new motion capture system that consists of a single ultra-wide fisheye camera mounted on the user’s chest. Their design not only overcomes the space constraints of existing systems but is also cost-effective.

Named MonoEye, the system can capture the user’s body motion as well as the user’s perspective, or ‘viewport’. “Our ultra-wide fisheye lens has a 280-degree field-of-view and it can capture the user’s limbs, face, and the surrounding environment,” the researchers say.

To achieve robust multimodal motion capture, the system has been designed with three deep neural networks capable of estimating 3D body pose, head pose and camera pose in real-time.

Already, the researchers have trained these neural networks with an extensive synthetic dataset consisting of 680,000 renderings of people with a range of body shapes, clothing, actions, background and lighting conditions, as well as 16,000 frames of photo-realistic images.

Some challenges remain, however, due to the inevitable domain gap between synthetic and real-world datasets. The researchers plan to keep expanding their dataset with more photo-realistic images to help minimize this gap and improve accuracy.

The researchers envision that the chest-mounted camera could go on to be transformed into an everyday accessory such as a tie clip, brooch or sports gear in future.

###

The team’s work will be presented at the 33rd ACM Symposium on User Interface Software and Technology (UIST), a leading forum for innovations in human-computer interfaces, to be held virtually on 20-23 October 2020.

References

Session 3A: Tracking Bodies and Faces Using Cameras

(Wednesday, October 21, 9:00 – 9:20 CDT/UTC-5)

https://uist.acm.org/uist2020/program.html

Title: MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera.

Conference: The Association for Computing Machinery (ACM) Symposium on User Interface Software and Technology (UIST) 2020

https://uist.acm.org/uist2020/

Related link

KOIKE LABORATORY

https://www.vogue.cs.titech.ac.jp/

About Tokyo Institute of Technology

Tokyo Tech stands at the forefront of research and higher education as the leading university for science and technology in Japan. Tokyo Tech researchers excel in fields ranging from materials science to biology, computer science, and physics. Founded in 1881, Tokyo Tech hosts over 10,000 undergraduate and graduate students per year, who develop into scientific leaders and some of the most sought-after engineers in industry. Embodying the Japanese philosophy of “monotsukuri,” meaning “technical ingenuity and innovation,” the Tokyo Tech community strives to contribute to society through high-impact research.

https://www.titech.ac.jp/english/

Media Contact
Emiko Kawaguchi
[email protected]

Original Source

https://www.titech.ac.jp/english/news/2020/048084.html

Tags: Technology/Engineering/Computer Science
Share25Tweet16Share4ShareSendShare
  • How to MRI your dragon

    How to MRI your dragon: Illinois researchers develop first bearded dragon brain atlas

    74 shares
    Share 30 Tweet 19
  • Immune molecules from a llama could provide protection against a vast array of SARS-like viruses including COVID-19, researchers say

    74 shares
    Share 30 Tweet 19
  • Researchers perform non-line-of-sight ghost imaging with human vision

    73 shares
    Share 29 Tweet 18
  • Unique blend of comics and humor is key to success of public awareness posters in Singapore, finds Singapore-US researchers

    72 shares
    Share 29 Tweet 18
  • Human urine-derived stem cells have robust regenerative potential

    72 shares
    Share 29 Tweet 18
  • Researchers develop word-score model capable of estimating hidden hearing loss

    71 shares
    Share 28 Tweet 18
ADVERTISEMENT

About us

We bring you the latest science news from best research centers and universities around the world. Check our website.

Latest NEWS

nTIDE May 2022 COVID Update: Uncertainty about inflation tempers good news for people with disabilities

COVID-19 fattens up our body’s cells to fuel its viral takeover

Famous Sterkfontein Caves deposit 1 million years older than previously thought

Subscribe to Blog via Email

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 190 other subscribers

© 2022 Scienmag- Science Magazine: Latest Science News.

No Result
View All Result
  • HOME PAGE
  • BIOLOGY
  • CHEMISTRY AND PHYSICS
  • MEDICINE
    • Cancer
    • Infectious Emerging Diseases
  • SPACE
  • TECHNOLOGY
  • CONTACT US

© 2022 Scienmag- Science Magazine: Latest Science News.

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
Posting....