Look And Think Twice: Capturing Top-Down Visual Attention With Feedback Convolutional Neural Networks
2015 IEEE International Conference on Computer Vision (ICCV)(2015)
摘要
While feedforward deep convolutional neural networks (CNNs) have been a great success in computer vision, it is important to note that the human visual cortex generally contains more feedback than feedforward connections. In this paper, we will briefly introduce the background of feedbacks in the human visual cortex, which motivates us to develop a computational feedback mechanism in deep neural networks. In addition to the feedforward inference in traditional neural networks, a feedback loop is introduced to infer the activation status of hidden layer neurons according to the "goal" of the network, e.g., high-level semantic labels. We analogize this mechanism as "Look and Think Twice." The feedback networks help better visualize and understand how deep neural networks work, and capture visual attention on expected objects, even in images with cluttered background and multiple objects. Experiments on ImageNet dataset demonstrate its effectiveness in solving tasks such as image classification and object localization.
更多查看译文
关键词
top-down visual attention,feedback convolutional neural network,CNN,computer vision,computational feedback mechanism,deep neural network,feedforward inference,feedback loop,high-level semantic label
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络