mmpretrain/mmcls/models
Ma Zerun 076ee10cac
[Feature] Add swin-transformer model. (#271)
* Add swin transformer archs S, B and L.

* Add SwinTransformer configs

* Add train config files of swin.

* Align init method with original code

* Use nn.Unfold to merge patch

* Change all ConfigDict to dict

* Add init_cfg for all subclasses of BaseModule.

* Use mmcv version init function

* Add Swin README

* Use safer cfg copy method

* Improve docstring and variable name.

* Fix some difference in randaug

Fix BGR bug, align scheduler config.

Fix label smoothing parameter difference.

* Fix missing droppath in attn

* Fix bug of relative posititon table if window width is not equal to
height.

* Make `PatchMerging` more general, support kernel, stride, padding and
dilation.

* Rename `residual` to `identity` in attention and FFN.

* Add `auto_pad` option to auto pad feature map

* Improve docstring.

* Fix bug in ShiftWMSA padding.

* Remove unused `key` and `value` in ShiftWMSA

* Move `PatchMerging` into utils and use common `PatchEmbed`.

* Use latest `LinearClsHead`, train augments and label smooth settings.
And remove original `SwinLinearClsHead`.

* Mark some configs as "Evalution Only".

* Remove useless comment in config

* 1. Move ShiftWindowMSA and WindowMSA to `utils/attention.py`
2. Add docstrings of each module.
3. Fix some variables' names.
4. Other small improvement.

* Add unit tests of swin-transformer and patchmerging.

* Fix some bugs in unit tests.

* Fix bug of rel_position_index if window is not square.

* Make WindowMSA implicit, and add unit tests.

* Add metafile.yml, update readme and model_zoo.
2021-07-01 09:30:42 +08:00
..
backbones [Feature] Add swin-transformer model. (#271) 2021-07-01 09:30:42 +08:00
classifiers fix a bug when samples_per_gpu==1 (#311) 2021-06-30 20:57:21 +08:00
heads Use parameter default value to control default behavior of init_cfg in (#319) 2021-06-30 19:13:27 +08:00
losses Refactor LabelSmoothLoss (#285) 2021-06-12 21:32:18 +08:00
necks GlabelAveragePooling support 1d, 2d and 3d by param, and add neck test (#236) 2021-05-10 15:00:50 +08:00
utils [Feature] Add swin-transformer model. (#271) 2021-07-01 09:30:42 +08:00
__init__.py Add classifiers, heads, necks and losses 2020-07-07 19:32:06 +08:00
builder.py inherits mmcv registry (#252) 2021-05-14 23:36:56 +08:00