Abstract
While some unmanned aerial vehicles (UAVs) have the capacity to carry mechanically stabilized camera equipment, weight limits or other problems may make mechanical stabilization impractical. As a result many UAVs rely on fixed cameras to provide a video stream to an operator or observer. With a fixed camera, the video stream is often unsteady due to the multirotor's movement from wind and acceleration. These video streams are often analyzed by both humans and machines, and the unwanted camera movement can cause problems for both. For a human observer, unwanted movement may simply make it harder to follow the video, while for computer algorithms, it may severely impair the algorithm's intended function. There has been significant research on how to stabilize videos using feature tracking to determine camera movement, which in turn is used to manipulate frames and stabilize the camera stream. We believe, however, that this process could be greatly simplified by using data from a UAV's on-board inertial measurement unit (IMU) to stabilize the camera feed. In this paper we present an algorithm for video stabilization based only on IMU data from a UAV platform. Our results show that our algorithm successfully stabilizes the camera stream with the added benefit of requiring less computational power.
| Original language | English |
|---|---|
| Title of host publication | 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017 |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 210-215 |
| Number of pages | 6 |
| ISBN (Electronic) | 9781538609392 |
| DOIs | |
| Publication status | Published - 2017 Nov 8 |
| Externally published | Yes |
| Event | 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017 - Linkoping, Sweden Duration: 2017 Oct 3 → 2017 Oct 5 |
Other
| Other | 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017 |
|---|---|
| Country | Sweden |
| City | Linkoping |
| Period | 17/10/3 → 17/10/5 |
Fingerprint
ASJC Scopus subject areas
- Artificial Intelligence
- Aerospace Engineering
- Control and Optimization
- Modelling and Simulation
- Education
Cite this
Efficient real-time video stabilization for UAVs using only IMU data. / Odelga, Marcin; Kochanek, Nicholas; Bulthoff, Heinrich.
2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017. Institute of Electrical and Electronics Engineers Inc., 2017. p. 210-215 8101668.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Efficient real-time video stabilization for UAVs using only IMU data
AU - Odelga, Marcin
AU - Kochanek, Nicholas
AU - Bulthoff, Heinrich
PY - 2017/11/8
Y1 - 2017/11/8
N2 - While some unmanned aerial vehicles (UAVs) have the capacity to carry mechanically stabilized camera equipment, weight limits or other problems may make mechanical stabilization impractical. As a result many UAVs rely on fixed cameras to provide a video stream to an operator or observer. With a fixed camera, the video stream is often unsteady due to the multirotor's movement from wind and acceleration. These video streams are often analyzed by both humans and machines, and the unwanted camera movement can cause problems for both. For a human observer, unwanted movement may simply make it harder to follow the video, while for computer algorithms, it may severely impair the algorithm's intended function. There has been significant research on how to stabilize videos using feature tracking to determine camera movement, which in turn is used to manipulate frames and stabilize the camera stream. We believe, however, that this process could be greatly simplified by using data from a UAV's on-board inertial measurement unit (IMU) to stabilize the camera feed. In this paper we present an algorithm for video stabilization based only on IMU data from a UAV platform. Our results show that our algorithm successfully stabilizes the camera stream with the added benefit of requiring less computational power.
AB - While some unmanned aerial vehicles (UAVs) have the capacity to carry mechanically stabilized camera equipment, weight limits or other problems may make mechanical stabilization impractical. As a result many UAVs rely on fixed cameras to provide a video stream to an operator or observer. With a fixed camera, the video stream is often unsteady due to the multirotor's movement from wind and acceleration. These video streams are often analyzed by both humans and machines, and the unwanted camera movement can cause problems for both. For a human observer, unwanted movement may simply make it harder to follow the video, while for computer algorithms, it may severely impair the algorithm's intended function. There has been significant research on how to stabilize videos using feature tracking to determine camera movement, which in turn is used to manipulate frames and stabilize the camera stream. We believe, however, that this process could be greatly simplified by using data from a UAV's on-board inertial measurement unit (IMU) to stabilize the camera feed. In this paper we present an algorithm for video stabilization based only on IMU data from a UAV platform. Our results show that our algorithm successfully stabilizes the camera stream with the added benefit of requiring less computational power.
UR - http://www.scopus.com/inward/record.url?scp=85047642966&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85047642966&partnerID=8YFLogxK
U2 - 10.1109/RED-UAS.2017.8101668
DO - 10.1109/RED-UAS.2017.8101668
M3 - Conference contribution
AN - SCOPUS:85047642966
SP - 210
EP - 215
BT - 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems, RED-UAS 2017
PB - Institute of Electrical and Electronics Engineers Inc.
ER -