Attention-guided Unified Network for Panoptic Segmentation

Jan 2019

tl;dr: Exploit FG instance masks to refine BG stuff masks.

Overall impression

Using FG masks to refine BG masks is a natural idea as they are complementary to each other (the definition of panoptic segmentation indicates the mutual exclusiveness of BG and FG). The authors poured a lot of effort of coming up with the RoIUpsample layer to exploit the masks.

Key ideas