Learning-Deep-Learning

Rethinking ImageNet Pre-training

March 2020

tl;dr: ImageNet pretraining speeds up training but not necessarily increases accuracy.

Overall impression

Tons of ablation study. Another solid work from FAIR.

We should start exploring group normalization

Key ideas

Technical details

Notes