A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback

Paolo Stegagno, Massimo Basile, Heinrich Bulthoff, Antonio Franchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Citations (Scopus)

Abstract

We present the development of a semi-autonomous quadrotor UAV platform for indoor teleoperation using RGB-D technology as exceroceptive sensor. The platform integrates IMU and Dense Visual Odometry pose estimation in order to stabilize the UAV velocity and track the desired velocity commanded by a remote operator though an haptic interface. While being commanded, the quadrotor autonomously performs a persistent pan-scanning of the surrounding area in order to extend the intrinsically limited field of view. The RGB-D sensor is used also for collision-safe navigation using a probabilistically updated local obstacle map. In the operator visual feedback, pan-scanning movement is real time compensated by an IMU-based adaptive filtering algorithm that lets the operator perform the drive experience in a oscillation-free frame. An additional sensory channel for the operator is provided by the haptic feedback, which is based on the obstacle map and velocity tracking error in order to convey information about the environment and quadrotor state. The effectiveness of the platform is validated by means of experiments performed without the aid of any external positioning system.

Original languageEnglish
Title of host publicationProceedings - IEEE International Conference on Robotics and Automation
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages3862-3869
Number of pages8
DOIs
Publication statusPublished - 2014 Sep 22
Externally publishedYes
Event2014 IEEE International Conference on Robotics and Automation, ICRA 2014 - Hong Kong, China
Duration: 2014 May 312014 Jun 7

Other

Other2014 IEEE International Conference on Robotics and Automation, ICRA 2014
CountryChina
CityHong Kong
Period14/5/3114/6/7

Fingerprint

Unmanned aerial vehicles (UAV)
Feedback
Scanning
Haptic interfaces
Adaptive filtering
Sensors
Remote control
Mathematical operators
Navigation
Experiments

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Stegagno, P., Basile, M., Bulthoff, H., & Franchi, A. (2014). A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback. In Proceedings - IEEE International Conference on Robotics and Automation (pp. 3862-3869). [6907419] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2014.6907419

A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback. / Stegagno, Paolo; Basile, Massimo; Bulthoff, Heinrich; Franchi, Antonio.

Proceedings - IEEE International Conference on Robotics and Automation. Institute of Electrical and Electronics Engineers Inc., 2014. p. 3862-3869 6907419.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Stegagno, P, Basile, M, Bulthoff, H & Franchi, A 2014, A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback. in Proceedings - IEEE International Conference on Robotics and Automation., 6907419, Institute of Electrical and Electronics Engineers Inc., pp. 3862-3869, 2014 IEEE International Conference on Robotics and Automation, ICRA 2014, Hong Kong, China, 14/5/31. https://doi.org/10.1109/ICRA.2014.6907419
Stegagno P, Basile M, Bulthoff H, Franchi A. A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback. In Proceedings - IEEE International Conference on Robotics and Automation. Institute of Electrical and Electronics Engineers Inc. 2014. p. 3862-3869. 6907419 https://doi.org/10.1109/ICRA.2014.6907419
Stegagno, Paolo ; Basile, Massimo ; Bulthoff, Heinrich ; Franchi, Antonio. / A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback. Proceedings - IEEE International Conference on Robotics and Automation. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 3862-3869
@inproceedings{06a7f7901ea34d76a7fb743c7dd8e0c7,
title = "A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback",
abstract = "We present the development of a semi-autonomous quadrotor UAV platform for indoor teleoperation using RGB-D technology as exceroceptive sensor. The platform integrates IMU and Dense Visual Odometry pose estimation in order to stabilize the UAV velocity and track the desired velocity commanded by a remote operator though an haptic interface. While being commanded, the quadrotor autonomously performs a persistent pan-scanning of the surrounding area in order to extend the intrinsically limited field of view. The RGB-D sensor is used also for collision-safe navigation using a probabilistically updated local obstacle map. In the operator visual feedback, pan-scanning movement is real time compensated by an IMU-based adaptive filtering algorithm that lets the operator perform the drive experience in a oscillation-free frame. An additional sensory channel for the operator is provided by the haptic feedback, which is based on the obstacle map and velocity tracking error in order to convey information about the environment and quadrotor state. The effectiveness of the platform is validated by means of experiments performed without the aid of any external positioning system.",
author = "Paolo Stegagno and Massimo Basile and Heinrich Bulthoff and Antonio Franchi",
year = "2014",
month = "9",
day = "22",
doi = "10.1109/ICRA.2014.6907419",
language = "English",
pages = "3862--3869",
booktitle = "Proceedings - IEEE International Conference on Robotics and Automation",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - A semi-autonomous UAV platform for indoor remote operation with visual and haptic feedback

AU - Stegagno, Paolo

AU - Basile, Massimo

AU - Bulthoff, Heinrich

AU - Franchi, Antonio

PY - 2014/9/22

Y1 - 2014/9/22

N2 - We present the development of a semi-autonomous quadrotor UAV platform for indoor teleoperation using RGB-D technology as exceroceptive sensor. The platform integrates IMU and Dense Visual Odometry pose estimation in order to stabilize the UAV velocity and track the desired velocity commanded by a remote operator though an haptic interface. While being commanded, the quadrotor autonomously performs a persistent pan-scanning of the surrounding area in order to extend the intrinsically limited field of view. The RGB-D sensor is used also for collision-safe navigation using a probabilistically updated local obstacle map. In the operator visual feedback, pan-scanning movement is real time compensated by an IMU-based adaptive filtering algorithm that lets the operator perform the drive experience in a oscillation-free frame. An additional sensory channel for the operator is provided by the haptic feedback, which is based on the obstacle map and velocity tracking error in order to convey information about the environment and quadrotor state. The effectiveness of the platform is validated by means of experiments performed without the aid of any external positioning system.

AB - We present the development of a semi-autonomous quadrotor UAV platform for indoor teleoperation using RGB-D technology as exceroceptive sensor. The platform integrates IMU and Dense Visual Odometry pose estimation in order to stabilize the UAV velocity and track the desired velocity commanded by a remote operator though an haptic interface. While being commanded, the quadrotor autonomously performs a persistent pan-scanning of the surrounding area in order to extend the intrinsically limited field of view. The RGB-D sensor is used also for collision-safe navigation using a probabilistically updated local obstacle map. In the operator visual feedback, pan-scanning movement is real time compensated by an IMU-based adaptive filtering algorithm that lets the operator perform the drive experience in a oscillation-free frame. An additional sensory channel for the operator is provided by the haptic feedback, which is based on the obstacle map and velocity tracking error in order to convey information about the environment and quadrotor state. The effectiveness of the platform is validated by means of experiments performed without the aid of any external positioning system.

UR - http://www.scopus.com/inward/record.url?scp=84929207780&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84929207780&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2014.6907419

DO - 10.1109/ICRA.2014.6907419

M3 - Conference contribution

AN - SCOPUS:84929207780

SP - 3862

EP - 3869

BT - Proceedings - IEEE International Conference on Robotics and Automation

PB - Institute of Electrical and Electronics Engineers Inc.

ER -