Deep fashion recommendation system with style feature decomposition

Yong Goo Shin, Yoon Jae Yeo, Min Cheol Sagong, Seo Won Ji, Sung Jea Ko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently, convolutional neural network (CNN) -based fashion recommendation techniques, which automatically recommend the matching clothes to the consumer, have been widely researched. In general, the feature vector of a fashion item, i.e. clothes vector, obtained by CNN conveys two types of information: style and category, where the style indicates the distinctive characteristic of the clothes and the category represents the common properties of the clothes in the same class. Due to the mixed information of style and category, however, the clothes vector often recommends the unmatching clothes. To solve this problem, we propose a style feature extraction (SFE) layer, which effectively decomposes the clothes vector into style and category. Based on the characteristics that the category information has small variations in the same class while being distinguished from other classes, we extract and remove the category information from the clothes vector to obtain more accurate style information. Experimental results show that the proposed method achieves state-of-the-art results in terms of link prediction, which is a performance measure of a stylish match. In addition, as a simple CNN layer, it is expected that the proposed SFE layer is compatible with all popular CNN architectures.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE 9th International Conference on Consumer Electronics, ICCE-Berlin 2019
EditorsGordan Velikic, Christian Gross
PublisherIEEE Computer Society
Pages301-305
Number of pages5
ISBN (Electronic)9781728127453
DOIs
Publication statusPublished - 2019 Sep
Event9th IEEE International Conference on Consumer Electronics, ICCE-Berlin 2019 - Berlin, Germany
Duration: 2019 Sep 82019 Sep 11

Publication series

NameIEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin
Volume2019-September
ISSN (Print)2166-6814
ISSN (Electronic)2166-6822

Conference

Conference9th IEEE International Conference on Consumer Electronics, ICCE-Berlin 2019
CountryGermany
CityBerlin
Period19/9/819/9/11

Keywords

  • Convolutional neural network
  • Deep learning
  • Recommendation system
  • Visual compatibility

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Industrial and Manufacturing Engineering
  • Media Technology

Fingerprint Dive into the research topics of 'Deep fashion recommendation system with style feature decomposition'. Together they form a unique fingerprint.

  • Cite this

    Shin, Y. G., Yeo, Y. J., Sagong, M. C., Ji, S. W., & Ko, S. J. (2019). Deep fashion recommendation system with style feature decomposition. In G. Velikic, & C. Gross (Eds.), Proceedings - 2019 IEEE 9th International Conference on Consumer Electronics, ICCE-Berlin 2019 (pp. 301-305). [8966228] (IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin; Vol. 2019-September). IEEE Computer Society. https://doi.org/10.1109/ICCE-Berlin47944.2019.8966228