Learning to focus and track extreme climate events

Sookyung Kim, Sunghyun Park, Sunghyo Chung, Joonseok Lee, Yunsung Lee, Hyojin Kim, Mr Prabhat, Jaegul Choo

Research output: Contribution to conferencePaper

Abstract

This paper tackles the task of extreme climate event tracking. It has unique challenges compared to other visual object tracking problems, including a wider range of spatio-temporal dynamics, the unclear boundary of the target, and the shortage of a labeled dataset. We propose a simple but robust end-to-end model based on multi-layered ConvLSTMs, suitable for climate event tracking. It first learns to imprint the location and the appearance of the target at the first frame in an auto-encoding fashion. Next, the learned feature is fed to the tracking module to track the target in subsequent time frames. To tackle the data shortage problem, we propose data augmentation based on conditional generative adversarial networks. Extensive experiments show that the proposed framework significantly improves tracking performance of a hurricane tracking task over several state-of-the-art methods.

Original languageEnglish
Publication statusPublished - 2020
Event30th British Machine Vision Conference, BMVC 2019 - Cardiff, United Kingdom
Duration: 2019 Sep 92019 Sep 12

Conference

Conference30th British Machine Vision Conference, BMVC 2019
CountryUnited Kingdom
CityCardiff
Period19/9/919/9/12

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Fingerprint Dive into the research topics of 'Learning to focus and track extreme climate events'. Together they form a unique fingerprint.

  • Cite this

    Kim, S., Park, S., Chung, S., Lee, J., Lee, Y., Kim, H., Prabhat, M., & Choo, J. (2020). Learning to focus and track extreme climate events. Paper presented at 30th British Machine Vision Conference, BMVC 2019, Cardiff, United Kingdom.