scholarly journals Semantically Synchronizing Multiple-Camera Systems with Human Pose Estimation

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2464
Author(s):  
Zhe Zhang ◽  
Chunyu Wang ◽  
Wenhu Qin
Keyword(s):  
Pose Estimation ◽  
Energy Function ◽  
Human Pose Estimation ◽  
Frame Synchronization ◽  
Camera System ◽  
Multiple Camera ◽  
Camera Systems ◽  
Benchmark Datasets ◽  
Improved Performance ◽  
Human Pose

Multiple-camera systems can expand coverage and mitigate occlusion problems. However, temporal synchronization remains a problem for budget cameras and capture devices. We propose an out-of-the-box framework to temporally synchronize multiple cameras using semantic human pose estimation from the videos. Human pose predictions are obtained with an out-of-the-shelf pose estimator for each camera. Our method firstly calibrates each pair of cameras by minimizing an energy function related to epipolar distances. We also propose a simple yet effective multiple-person association algorithm across cameras and a score-regularized energy function for improved performance. Secondly, we integrate the synchronized camera pairs into a graph and derive the optimal temporal displacement configuration for the multiple-camera system. We evaluate our method on four public benchmark datasets and demonstrate robust sub-frame synchronization accuracy on all of them.

scholarly journals Designing Compact Convolutional Filters for Lightweight Human Pose Estimation

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Shili Niu ◽  
Weihua Ou ◽  
Shihua Feng ◽  
Jianping Gou ◽  
Fei Long ◽  
...  
Keyword(s):  
Pose Estimation ◽  
State Of The Art ◽  
Computational Cost ◽  
Estimation Accuracy ◽  
Human Pose Estimation ◽  
Model Parameters ◽  
Resource Limited ◽  
Benchmark Datasets ◽  
Human Pose ◽  
Low Computational Cost

Existing methods for human pose estimation usually use a large intermediate tensor, leading to a high computational load, which is detrimental to resource-limited devices. To solve this problem, we propose a low computational cost pose estimation network, MobilePoseNet, which includes encoder, decoder, and parallel nonmaximum suppression operation. Specifically, we design a lightweight upsampling block instead of transposing the convolution as the decoder and use the lightweight network as our downsampling part. Then, we choose the high-resolution features as the input for upsampling to reduce the number of model parameters. Finally, we propose a parallel OKS-NMS, which significantly outperforms the conventional NMS in terms of accuracy and speed. Experimental results on the benchmark datasets show that MobilePoseNet obtains almost comparable results to state-of-the-art methods with a low compilation load. Compared to SimpleBaseline, the parameter of MobilePoseNet is only 4%, while the estimation accuracy reaches 98%.

scholarly journals Self-Attention Network for Human Pose Estimation

2021 ◽  
Vol 11 (4) ◽  
pp. 1826
Author(s):  
Hailun Xia ◽  
Tianyang Zhang
Keyword(s):  
Pose Estimation ◽  
Human Pose Estimation ◽  
Attention Network ◽  
Learning Framework ◽  
Benchmark Datasets ◽  
Rgb Images ◽  
Human Pose ◽  
Human Joints ◽  
Symmetric Relations ◽  
2D And 3D

Estimating the positions of human joints from monocular single RGB images has been a challenging task in recent years. Despite great progress in human pose estimation with convolutional neural networks (CNNs), a central problem still exists: the relationships and constraints, such as symmetric relations of human structures, are not well exploited in previous CNN-based methods. Considering the effectiveness of combining local and nonlocal consistencies, we propose an end-to-end self-attention network (SAN) to alleviate this issue. In SANs, attention-driven and long-range dependency modeling are adopted between joints to compensate for local content and mine details from all feature locations. To enable an SAN for both 2D and 3D pose estimations, we also design a compatible, effective and general joint learning framework to mix up the usage of different dimension data. We evaluate the proposed network on challenging benchmark datasets. The experimental results show that our method has significantly achieved competitive results on Human3.6M, MPII and COCO datasets.

scholarly journals 3D Human Pose Estimation in Vietnamese Traditional Martial Art Videos

2019 ◽  
Vol 3 (3) ◽  
pp. 471
Author(s):  
Tuong Thanh Nguyen ◽  
Van-Hung Le ◽  
Duy-Long Duong ◽  
Thanh-Cong Pham ◽  
Dung Le
Keyword(s):  
Pose Estimation ◽  
Martial Arts ◽  
Social Life ◽  
The Body ◽  
Human Pose Estimation ◽  
Body Parts ◽  
Creative Commons ◽  
Martial Art ◽  
Benchmark Datasets ◽  
Human Pose

Preserving, maintaining and teaching traditional martial arts are very important activities in social life. That helps preserve national culture, exercise and self-defense for practitioners. However, traditional martial arts have many different postures and activities of the body and body parts are diverse. The problem of estimating the actions of the human body still has many challenges, such as accuracy, obscurity, etc. In this paper, we survey several strong studies in the recent years for 3-D human pose estimation. Statistical tables have been compiled for years, typical results of these studies on the Human 3.6m dataset have been summarized. We also present a comparative study for 3-D human pose estimation based on the method that uses a single image. This study based on the methods that use the Convolutional Neural Network (CNN) for 2-D pose estimation, and then using 3-D pose library for mapping the 2-D results into the 3-D space. The CNNs model is trained on the benchmark datasets as MSCOCO Keypoints Challenge dataset [1], Human 3.6m [2], MPII dataset [3], LSP [4], [5], etc. We final publish the dataset of Vietnamese's traditional martial arts in Binh Dinh province for evaluating the 3-D human pose estimation. Quantitative results are presented and evaluated.This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium provided the original work is properly cited.  

Part Detector Based Human Pose Estimation in Images and Videos

2011 ◽  
Vol 33 (6) ◽  
pp. 1413-1419
Author(s):  
Yan-chao Su ◽  
Hai-zhou Ai ◽  
Shi-hong Lao
Keyword(s):  
Pose Estimation ◽  
Human Pose Estimation ◽  
Human Pose

scholarly journals Deep 3D human pose estimation: A review

2021 ◽  
pp. 103225
Author(s):  
Jinbao Wang ◽  
Shujie Tan ◽  
Xiantong Zhen ◽  
Shuo Xu ◽  
Feng Zheng ◽  
...  
Keyword(s):  
Pose Estimation ◽  
Human Pose Estimation ◽  
Human Pose ◽  
3D Human Pose Estimation
Sign in / Sign up

Export Citation Format

Share Document