EasyCV/docs/source/model_zoo_ssl.md
wenmeng zhou 81b91086eb
feat: readthedocs support & tutorial docs refinement (#29)
* readthedocs build support

* change opencv version from 4.4.0.40 to 4.1.2.30

* update config file path with github url

* fix: clone AutoAugmentPolicy from torchvision error

* reorganize requirements file

* add model compression tutorial and cls modelzoo to readme.md

* add optional req
2022-04-26 10:38:58 +08:00

8.5 KiB

Self-supervised Learning Model Zoo

Pretrained models

MAE

Pretrained on ImageNet dataset.

Config Epochs Download
mae_vit_base_patch16_8xb64_400e 400 model
mae_vit_base_patch16_8xb64_1600e 1600 model
mae_vit_large_patch16_8xb32_1600e 1600 model

DINO

Pretrained on ImageNet dataset.

Config Epochs Download
dino_deit_small_p16_8xb32_100e 100 model - log

MoBY

Pretrained on ImageNet dataset.

Config Epochs Download
moby_deit_small_p16_4xb128_300e 300 model - log

MoCo V2

Pretrained on ImageNet dataset.

Config Epochs Download
mocov2_resnet50_8xb32_200e 200 model - log

SwAV

Pretrained on ImageNet dataset.

Config Epochs Download
swav_resnet50_8xb32_200e 200 model - log

Benchmarks

For detailed usage of benchmark tools, please refer to benchmark README.md.

ImageNet Linear Evaluation

Algorithm Linear Eval Config Pretrained Config Top-1 (%) Download
SwAV swav_resnet50_8xb2048_20e_feature swav_resnet50_8xb32_200e 73.618 log
DINO dino_deit_small_p16_8xb2048_20e_feature dino_deit_small_p16_8xb32_100e 71.248 log
MoBY moby_deit_small_p16_8xb2048_30e_feature moby_deit_small_p16_4xb128_300e 72.214 log
MoCo-v2 mocov2_resnet50_8xb2048_40e_feature mocov2_resnet50_8xb32_200e 66.8 log

ImageNet Finetuning

Algorithm Fintune Config Pretrained Config Top-1 (%) Download
MAE mae_vit_base_patch16_8xb64_100e_lrdecay075_fintune mae_vit_base_patch16_8xb64_400e 83.13 fintune model - log
mae_vit_base_patch16_8xb64_100e_lrdecay065_fintune mae_vit_base_patch16_8xb64_1600e 83.49 fintune model - log
mae_vit_large_patch16_8xb16_50e_lrdecay075_fintune mae_vit_large_patch16_8xb32_1600e 85.49 fintune model - log