Publication: Human 3D Pose Estimation with a Tilting Camera for Social Mobile Robot Interaction.
Loading...
Identifiers
Date
2019-11-13
Authors
Garcia-Salguero, Mercedes
Gonzalez-Jimenez, Javier
Moreno, Francisco-Angel
Advisors
Journal Title
Journal ISSN
Volume Title
Publisher
MDPI AG
Abstract
Human-Robot interaction represents a cornerstone of mobile robotics, especially within the field of social robots. In this context, user localization becomes of crucial importance for the interaction. This work investigates the capabilities of wide field-of-view RGB cameras to estimate the 3D position and orientation (i.e., the pose) of a user in the environment. For that, we employ a social robot endowed with a fish-eye camera hosted in a tilting head and develop two complementary approaches: (1) a fast method relying on a single image that estimates the user pose from the detection of their feet and does not require either the robot or the user to remain static during the reconstruction; and (2) a method that takes some views of the scene while the camera is being tilted and does not need the feet to be visible. Due to the particular setup of the tilting camera, special equations for 3D reconstruction have been developed. In both approaches, a CNN-based skeleton detector (OpenPose) is employed to identify humans within the image. A set of experiments with real data validate our two proposed methods, yielding similar results than commercial RGB-D cameras while surpassing them in terms of coverage of the scene (wider FoV and longer range) and robustness to light conditions.
Description
MeSH Terms
Skeleton
Musculoskeletal System
Social Interaction
Imaging, Three-Dimensional
Robotics
Humans
Musculoskeletal System
Social Interaction
Imaging, Three-Dimensional
Robotics
Humans
DeCS Terms
Cabeza
Ambiente
Selección del sitio de tratamiento de residuos
Esqueleto
Robótica
Orientación
Diagnóstico
Ojo
Trabajo
Métodos
Ambiente
Selección del sitio de tratamiento de residuos
Esqueleto
Robótica
Orientación
Diagnóstico
Ojo
Trabajo
Métodos
CIE Terms
Keywords
3D computer vision, OpenPose, RGB-D cameras, camera pose calibration, human body pose estimation, human–robot interaction
Citation
Garcia-Salguero M, Gonzalez-Jimenez J, Moreno FA. Human 3D Pose Estimation with a Tilting Camera for Social Mobile Robot Interaction. Sensors (Basel). 2019 Nov 13;19(22):4943.