References & Citations
Computer Science > Machine Learning
Title: End-to-End Instance Segmentation with Recurrent Attention
(Submitted on 30 May 2016 (v1), last revised 13 Jul 2017 (this version, v5))
Abstract: While convolutional neural networks have gained impressive success recently in solving structured prediction problems such as semantic segmentation, it remains a challenge to differentiate individual object instances in the scene. Instance segmentation is very important in a variety of applications, such as autonomous driving, image captioning, and visual question answering. Techniques that combine large graphical models with low-level vision have been proposed to address this problem; however, we propose an end-to-end recurrent neural network (RNN) architecture with an attention mechanism to model a human-like counting process, and produce detailed instance segmentations. The network is jointly trained to sequentially produce regions of interest as well as a dominant object segmentation within each region. The proposed model achieves competitive results on the CVPPP, KITTI, and Cityscapes datasets.
Submission history
From: Mengye Ren [view email][v1] Mon, 30 May 2016 20:40:20 GMT (8852kb,D)
[v2] Tue, 6 Sep 2016 15:09:06 GMT (8891kb,D)
[v3] Sun, 27 Nov 2016 17:41:57 GMT (8221kb,D)
[v4] Mon, 16 Jan 2017 23:08:35 GMT (8221kb,D)
[v5] Thu, 13 Jul 2017 00:53:33 GMT (5962kb,D)
Link back to: arXiv, form interface, contact.