LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment

LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment

27 Feb 2024 | Yiming Ren1, Xiao Han1, Chengfeng Zhao1, Jingya Wang1, Lan Xu1, Jingyi Yu1, Yuexin Ma1,†
LiveHPS is a novel single-LiDAR-based approach for scene-level 3D human pose and shape estimation in large-scale, uncontrolled environments. The method addresses the challenges of varying light conditions, occlusions, and noise by designing an Adaptive Vertex-guided Distillation module to align diverse point distributions with regular SMPL mesh vertex distributions. It also employs a Consecutive Pose Optimizer to refine joint positions using geometric and dynamic information from consecutive frames, and a Skeleton-aware Translation Solver to estimate global translations accurately. The approach achieves state-of-the-art performance on various datasets, including FreeMotion, a large-scale motion dataset with multi-modal and multi-view data from LiDARs, cameras, and IMUs. Extensive experiments demonstrate the robustness and effectiveness of LiveHPS in real-world applications.LiveHPS is a novel single-LiDAR-based approach for scene-level 3D human pose and shape estimation in large-scale, uncontrolled environments. The method addresses the challenges of varying light conditions, occlusions, and noise by designing an Adaptive Vertex-guided Distillation module to align diverse point distributions with regular SMPL mesh vertex distributions. It also employs a Consecutive Pose Optimizer to refine joint positions using geometric and dynamic information from consecutive frames, and a Skeleton-aware Translation Solver to estimate global translations accurately. The approach achieves state-of-the-art performance on various datasets, including FreeMotion, a large-scale motion dataset with multi-modal and multi-view data from LiDARs, cameras, and IMUs. Extensive experiments demonstrate the robustness and effectiveness of LiveHPS in real-world applications.
Reach us at info@study.space
[slides and audio] LiveHPS%3A LiDAR-Based Scene-Level Human Pose and Shape Estimation in Free Environment