chen_big_2020: Big Self-Supervised Models are Strong Semi-Supervised Learners
Big Self-Supervised Models are Strong Semi-Supervised Learners
Key Idea
The paper proposes a three-step semi-supervised learning framework for visual data
-
unsupervised or self-supervised pretraining using a modified SimCLR
-
Supervised fine-tuning
-
Distillation using unlabeled data
