mmpretrain/configs/_base_/schedules
Ma Zerun 076ee10cac
[Feature] Add swin-transformer model. (#271)
* Add swin transformer archs S, B and L.

* Add SwinTransformer configs

* Add train config files of swin.

* Align init method with original code

* Use nn.Unfold to merge patch

* Change all ConfigDict to dict

* Add init_cfg for all subclasses of BaseModule.

* Use mmcv version init function

* Add Swin README

* Use safer cfg copy method

* Improve docstring and variable name.

* Fix some difference in randaug

Fix BGR bug, align scheduler config.

Fix label smoothing parameter difference.

* Fix missing droppath in attn

* Fix bug of relative posititon table if window width is not equal to
height.

* Make `PatchMerging` more general, support kernel, stride, padding and
dilation.

* Rename `residual` to `identity` in attention and FFN.

* Add `auto_pad` option to auto pad feature map

* Improve docstring.

* Fix bug in ShiftWMSA padding.

* Remove unused `key` and `value` in ShiftWMSA

* Move `PatchMerging` into utils and use common `PatchEmbed`.

* Use latest `LinearClsHead`, train augments and label smooth settings.
And remove original `SwinLinearClsHead`.

* Mark some configs as "Evalution Only".

* Remove useless comment in config

* 1. Move ShiftWindowMSA and WindowMSA to `utils/attention.py`
2. Add docstrings of each module.
3. Fix some variables' names.
4. Other small improvement.

* Add unit tests of swin-transformer and patchmerging.

* Fix some bugs in unit tests.

* Fix bug of rel_position_index if window is not square.

* Make WindowMSA implicit, and add unit tests.

* Add metafile.yml, update readme and model_zoo.
2021-07-01 09:30:42 +08:00
..
cifar10_bs128.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs256.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs256_140e.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs256_coslr.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs256_epochstep.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs1024_adamw_swin.py [Feature] Add swin-transformer model. (#271) 2021-07-01 09:30:42 +08:00
imagenet_bs1024_linearlr_bn_nowd.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs2048.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs2048_AdamW.py [Bug]Fix weight decay (#227) 2021-04-28 17:16:43 +08:00
imagenet_bs2048_coslr.py Use build_runner (#54) 2020-10-15 21:12:50 +08:00
imagenet_bs4096_AdamW.py [Feature]Modify modelzoo readme (#230) 2021-04-29 15:18:55 +08:00