Multipath-DenseNet: A Supervised ensemble architecture of densely connected convolutional networks

Bilal Lodhi, Jaewoo Kang

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Deep networks with skip-connections such as ResNets have achieved great results in recent years. DenseNet exploits the ResNet skip-connections by connecting each layer in convolution neural network to all preceding layers and achieves state-of-the-art accuracy. It is well-known that deeper networks are more efficient and easier to train than shallow or wider networks. Despite the high performance of very deep networks, they are limited in terms of vanishing gradient, diminishing forward flow, and slower training time. In this paper, we propose to combine the benefits of the depth and width of networks. We train supervised independent shallow networks on the same input in a block fashion. We use a state-of-the-art DenseNet block to increase the number of paths for gradient flow. Our proposed architecture has several advantages over other deeper networks including DenseNet; our architecture which we call Multipath-DenseNet is deeper as well as wider, reduces training time, and uses a smaller number of parameters. We evaluate our proposed architecture on the following four object recognition datasets: CIFAR-10, CIFAR-100, SVHN, and ImageNet. The evaluation results show that Multipath-DenseNet achieves significant improvement in performance over DenseNet on the benchmark datasets.

Original languageEnglish
Pages (from-to)63-72
Number of pages10
JournalInformation Sciences
Volume482
DOIs
Publication statusPublished - 2019 May 1

Keywords

  • Deep-learning
  • Image classification
  • Neural network

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Theoretical Computer Science
  • Computer Science Applications
  • Information Systems and Management
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Multipath-DenseNet: A Supervised ensemble architecture of densely connected convolutional networks'. Together they form a unique fingerprint.

  • Cite this