Associative Embedding: End-to-End Learning for Joint Detection and Grouping

January 2020

tl;dr: Learn keypoints detection and association at the same time.

Overall impression

This is the foundation of CornerNet which ignited a new wave of anchor less single-stage object detector in 2019.

It can be also used for instance segmentation (and perhaps for tracking as well). Basically any CV problem that can be viewed as joint detection and grouping can benefit from associative embedding.

Super Point learns keypoint detector and embedding at the same time.

The associative embedding idea is also used in Pixels to Graphs.

Key ideas

Technical details