Facebook develops full-body tracking technology to pave the way for AR / VR applications

Facebook has been very much focused on augmented reality and virtual reality (VR) technology in entertainment and communications applications, the latest research shows that Facebook is looking for Augmented Reality applications can not only modify or replace the human face, but also can be applied to the whole body According to Techcrunch and SiliconANGLE, Facebook's AI Camera Team researchers disclosed in a blog that they recently developed a new technology that accurately detects body posture and segregates a person from the background, but the model is still in the research phase, Only a few megabytes of data transfer is needed to get instant action on smartphones.Developing the computer vision model for mobile devices is a challenging task in its own right because the mobile model must be designed without the need for large amounts of memory In addition, Facebook researchers said that the body is more difficult to track than the face, the need for real-time accurate detection and tracking of body movements, which is quite challenging task, because the posture and personal status changes are very Because a person may sit, walk or run, may wear a long coat or shorts, or People are often blocked by other people or objects, all of which can significantly increase the difficulty of tracking the human body. Facebook uses computer vision techniques to retrain to solve problems, allowing neural networks to recognize different body gestures and to distinguish between a person and the background behind , Making Augmented Reality animations that can be pinned to the right body part just like motion controllers in 3D animations.Because skeletal tracking systems are not the prequel in many industries, this research focuses on how specific systems and neural networks work, Rather than claiming anything significant, Facebook showed a strong desire to be efficient and to pursue the ease of deployment on mobile devices, with many of the strictest restrictions on sensor data, image resolution and refresh rates, processing power, etc. Facebook's body Tracing techniques may open up many new possibilities for augmented reality content such as creating a body mask, using gestures to control a game, or disabling identity recognition.

2016 GoodChinaBrand | ICP: 12011751 | China Exports