Learning Non-Parametric Surrogate Losses with Correlated Gradients

Seungdong Yoa, Jinyoung Park, Hyunwoo J. Kim

Research output: Contribution to journalArticlepeer-review

Abstract

Training models by minimizing surrogate loss functions with gradient-based algorithms is a standard approach in various vision tasks. This strategy often leads to suboptimal solutions due to the gap between the target evaluation metrics and surrogate loss functions. In this paper, we propose a framework to learn a surrogate loss function that approximates the evaluation metric with correlated gradients. We observe that the correlated gradients significantly benefit the gradient-based algorithms to improve the quality of solutions. We verify the effectiveness of our method in various tasks such as multi-class classification, ordinal regression, and pose estimation with three evaluation metrics and five datasets. Our extensive experiments showed that our method outperforms conventional loss functions and surrogate loss learning methods.

Original languageEnglish
Pages (from-to)141199-141209
Number of pages11
JournalIEEE Access
Volume9
DOIs
Publication statusPublished - 2021

Keywords

  • computer vision
  • deep learning
  • Learning loss
  • machine learning

ASJC Scopus subject areas

  • Computer Science(all)
  • Materials Science(all)
  • Engineering(all)

Fingerprint

Dive into the research topics of 'Learning Non-Parametric Surrogate Losses with Correlated Gradients'. Together they form a unique fingerprint.

Cite this