mmclassification/mmcls/models/backbones
Ma Zerun 076ee10cac
[Feature] Add swin-transformer model. (#271)
* Add swin transformer archs S, B and L.

* Add SwinTransformer configs

* Add train config files of swin.

* Align init method with original code

* Use nn.Unfold to merge patch

* Change all ConfigDict to dict

* Add init_cfg for all subclasses of BaseModule.

* Use mmcv version init function

* Add Swin README

* Use safer cfg copy method

* Improve docstring and variable name.

* Fix some difference in randaug

Fix BGR bug, align scheduler config.

Fix label smoothing parameter difference.

* Fix missing droppath in attn

* Fix bug of relative posititon table if window width is not equal to
height.

* Make `PatchMerging` more general, support kernel, stride, padding and
dilation.

* Rename `residual` to `identity` in attention and FFN.

* Add `auto_pad` option to auto pad feature map

* Improve docstring.

* Fix bug in ShiftWMSA padding.

* Remove unused `key` and `value` in ShiftWMSA

* Move `PatchMerging` into utils and use common `PatchEmbed`.

* Use latest `LinearClsHead`, train augments and label smooth settings.
And remove original `SwinLinearClsHead`.

* Mark some configs as "Evalution Only".

* Remove useless comment in config

* 1. Move ShiftWindowMSA and WindowMSA to `utils/attention.py`
2. Add docstrings of each module.
3. Fix some variables' names.
4. Other small improvement.

* Add unit tests of swin-transformer and patchmerging.

* Fix some bugs in unit tests.

* Fix bug of rel_position_index if window is not square.

* Make WindowMSA implicit, and add unit tests.

* Add metafile.yml, update readme and model_zoo.
2021-07-01 09:30:42 +08:00
..
__init__.py [Feature] Add swin-transformer model. (#271) 2021-07-01 09:30:42 +08:00
alexnet.py
base_backbone.py [Feature]Delete comments (#298) 2021-06-12 21:45:22 +08:00
lenet.py
mobilenet_v2.py [Fix] Fix init_weights bug in some backbones and update Readme (#318) 2021-06-30 19:41:58 +08:00
mobilenet_v3.py Fix Mobilenetv3 structure and add pretrained model (#291) 2021-06-27 23:19:36 +08:00
regnet.py
resnest.py
resnet.py [Fix] Fix init_weights bug in some backbones and update Readme (#318) 2021-06-30 19:41:58 +08:00
resnet_cifar.py
resnext.py
seresnet.py
seresnext.py
shufflenet_v1.py [Fix] Fix init_weights bug in some backbones and update Readme (#318) 2021-06-30 19:41:58 +08:00
shufflenet_v2.py [Fix] Fix init_weights bug in some backbones and update Readme (#318) 2021-06-30 19:41:58 +08:00
swin_transformer.py [Feature] Add swin-transformer model. (#271) 2021-07-01 09:30:42 +08:00
vgg.py [Feature]Delete comments (#298) 2021-06-12 21:45:22 +08:00
vision_transformer.py [Feature]Delete comments (#298) 2021-06-12 21:45:22 +08:00