Densely Connected Convolutional Networks

Densely Connected Convolutional Networks

28 Jan 2018 | Gao Huang*, Zhuang Liu*, Laurens van der Maaten, Kilian Q. Weinberger
The paper introduces the Dense Convolutional Network (DenseNet), a novel architecture that enhances the information flow and gradient propagation in convolutional neural networks (CNNs). Unlike traditional CNNs, DenseNet connects each layer to every other layer, creating $\frac{L(L+1)}{2}$ direct connections in an $L$-layer network. This dense connectivity pattern allows for feature reuse, alleviates the vanishing gradient problem, and reduces the number of parameters. The authors evaluate DenseNet on four benchmark datasets (CIFAR-10, CIFAR-100, SVHN, and ImageNet) and demonstrate significant improvements over state-of-the-art methods while requiring fewer parameters and computational resources. The dense connectivity also introduces a regularizing effect, reducing overfitting on smaller datasets. The paper discusses the advantages of DenseNets, including their parameter efficiency, improved information flow, and implicit deep supervision, and provides implementation details and experimental results to support these claims.The paper introduces the Dense Convolutional Network (DenseNet), a novel architecture that enhances the information flow and gradient propagation in convolutional neural networks (CNNs). Unlike traditional CNNs, DenseNet connects each layer to every other layer, creating $\frac{L(L+1)}{2}$ direct connections in an $L$-layer network. This dense connectivity pattern allows for feature reuse, alleviates the vanishing gradient problem, and reduces the number of parameters. The authors evaluate DenseNet on four benchmark datasets (CIFAR-10, CIFAR-100, SVHN, and ImageNet) and demonstrate significant improvements over state-of-the-art methods while requiring fewer parameters and computational resources. The dense connectivity also introduces a regularizing effect, reducing overfitting on smaller datasets. The paper discusses the advantages of DenseNets, including their parameter efficiency, improved information flow, and implicit deep supervision, and provides implementation details and experimental results to support these claims.
Reach us at info@study.space
[slides and audio] Densely Connected Convolutional Networks