Publication:
Human 3D Pose Estimation with a Tilting Camera for Social Mobile Robot Interaction.

Loading...
Thumbnail Image

Date

2019-11-13

Authors

Garcia-Salguero, Mercedes
Gonzalez-Jimenez, Javier
Moreno, Francisco-Angel

Advisors

Journal Title

Journal ISSN

Volume Title

Publisher

MDPI AG
Metrics
Google Scholar
Export

Research Projects

Organizational Units

Journal Issue

Abstract

Human-Robot interaction represents a cornerstone of mobile robotics, especially within the field of social robots. In this context, user localization becomes of crucial importance for the interaction. This work investigates the capabilities of wide field-of-view RGB cameras to estimate the 3D position and orientation (i.e., the pose) of a user in the environment. For that, we employ a social robot endowed with a fish-eye camera hosted in a tilting head and develop two complementary approaches: (1) a fast method relying on a single image that estimates the user pose from the detection of their feet and does not require either the robot or the user to remain static during the reconstruction; and (2) a method that takes some views of the scene while the camera is being tilted and does not need the feet to be visible. Due to the particular setup of the tilting camera, special equations for 3D reconstruction have been developed. In both approaches, a CNN-based skeleton detector (OpenPose) is employed to identify humans within the image. A set of experiments with real data validate our two proposed methods, yielding similar results than commercial RGB-D cameras while surpassing them in terms of coverage of the scene (wider FoV and longer range) and robustness to light conditions.

Description

MeSH Terms

Skeleton
Musculoskeletal System
Social Interaction
Imaging, Three-Dimensional
Robotics
Humans

DeCS Terms

Cabeza
Ambiente
Selección del sitio de tratamiento de residuos
Esqueleto
Robótica
Orientación
Diagnóstico
Ojo
Trabajo
Métodos

CIE Terms

Keywords

3D computer vision, OpenPose, RGB-D cameras, camera pose calibration, human body pose estimation, human–robot interaction

Citation

Garcia-Salguero M, Gonzalez-Jimenez J, Moreno FA. Human 3D Pose Estimation with a Tilting Camera for Social Mobile Robot Interaction. Sensors (Basel). 2019 Nov 13;19(22):4943.