TY - GEN
T1 - Efficient real-time video stabilization for UAVs using only IMU data
AU - Odelga, Marcin
AU - Kochanek, Nicholas
AU - Bulthoff, Heinrich H.
N1 - Funding Information:
Nicholas Kochanek is supported by the RISE Program run by the Deutscher Akademischer Austauschdienst.
Publisher Copyright:
© 2017 IEEE.
Copyright:
Copyright 2018 Elsevier B.V., All rights reserved.
PY - 2017/11/8
Y1 - 2017/11/8
N2 - While some unmanned aerial vehicles (UAVs) have the capacity to carry mechanically stabilized camera equipment, weight limits or other problems may make mechanical stabilization impractical. As a result many UAVs rely on fixed cameras to provide a video stream to an operator or observer. With a fixed camera, the video stream is often unsteady due to the multirotor's movement from wind and acceleration. These video streams are often analyzed by both humans and machines, and the unwanted camera movement can cause problems for both. For a human observer, unwanted movement may simply make it harder to follow the video, while for computer algorithms, it may severely impair the algorithm's intended function. There has been significant research on how to stabilize videos using feature tracking to determine camera movement, which in turn is used to manipulate frames and stabilize the camera stream. We believe, however, that this process could be greatly simplified by using data from a UAV's on-board inertial measurement unit (IMU) to stabilize the camera feed. In this paper we present an algorithm for video stabilization based only on IMU data from a UAV platform. Our results show that our algorithm successfully stabilizes the camera stream with the added benefit of requiring less computational power.
AB - While some unmanned aerial vehicles (UAVs) have the capacity to carry mechanically stabilized camera equipment, weight limits or other problems may make mechanical stabilization impractical. As a result many UAVs rely on fixed cameras to provide a video stream to an operator or observer. With a fixed camera, the video stream is often unsteady due to the multirotor's movement from wind and acceleration. These video streams are often analyzed by both humans and machines, and the unwanted camera movement can cause problems for both. For a human observer, unwanted movement may simply make it harder to follow the video, while for computer algorithms, it may severely impair the algorithm's intended function. There has been significant research on how to stabilize videos using feature tracking to determine camera movement, which in turn is used to manipulate frames and stabilize the camera stream. We believe, however, that this process could be greatly simplified by using data from a UAV's on-board inertial measurement unit (IMU) to stabilize the camera feed. In this paper we present an algorithm for video stabilization based only on IMU data from a UAV platform. Our results show that our algorithm successfully stabilizes the camera stream with the added benefit of requiring less computational power.
UR - http://www.scopus.com/inward/record.url?scp=85047642966&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85047642966&partnerID=8YFLogxK
U2 - 10.1109/RED-UAS.2017.8101668
DO - 10.1109/RED-UAS.2017.8101668
M3 - Conference contribution
AN - SCOPUS:85047642966
T3 - 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017
SP - 210
EP - 215
BT - 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017
Y2 - 3 October 2017 through 5 October 2017
ER -