* Update swin_transformer.py
fix bug;
layer_norm 0,1,2,3 will be the same and resulted in an error when out_indices dict exceed one element.
* fix bug, layer_norm 0,1,2,3
* Add unit tests for multiple out_indices
Co-authored-by: cxiang26 <cq.xiang@foxmail.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
* Defaults to return tuple in all backbones.
* Compat downstream of swin transformer.
* Support tuple input for multi label head and stacked head.
* Fix backbone unit tests for tuple output.
* Add downstream inference unit tests for mmdet.
* Update gitignore
* Add unit tests for `return_tuple` option
* Add unit tests for head input tuple.
* Add warning in `simple_test`
* Add TIMMBackbone return tuple.
* Modify timm backbone unit test.
* Add API inference in the docs and fix readthedocs config.
* Replace some relative link in docs.
* Format docstring for reStructuredText syntax.
* Fix vit paper link
* Fix docstring of `show_results` function in `BaseClassifier`.
* Add swin transformer archs S, B and L.
* Add SwinTransformer configs
* Add train config files of swin.
* Align init method with original code
* Use nn.Unfold to merge patch
* Change all ConfigDict to dict
* Add init_cfg for all subclasses of BaseModule.
* Use mmcv version init function
* Add Swin README
* Use safer cfg copy method
* Improve docstring and variable name.
* Fix some difference in randaug
Fix BGR bug, align scheduler config.
Fix label smoothing parameter difference.
* Fix missing droppath in attn
* Fix bug of relative posititon table if window width is not equal to
height.
* Make `PatchMerging` more general, support kernel, stride, padding and
dilation.
* Rename `residual` to `identity` in attention and FFN.
* Add `auto_pad` option to auto pad feature map
* Improve docstring.
* Fix bug in ShiftWMSA padding.
* Remove unused `key` and `value` in ShiftWMSA
* Move `PatchMerging` into utils and use common `PatchEmbed`.
* Use latest `LinearClsHead`, train augments and label smooth settings.
And remove original `SwinLinearClsHead`.
* Mark some configs as "Evalution Only".
* Remove useless comment in config
* 1. Move ShiftWindowMSA and WindowMSA to `utils/attention.py`
2. Add docstrings of each module.
3. Fix some variables' names.
4. Other small improvement.
* Add unit tests of swin-transformer and patchmerging.
* Fix some bugs in unit tests.
* Fix bug of rel_position_index if window is not square.
* Make WindowMSA implicit, and add unit tests.
* Add metafile.yml, update readme and model_zoo.
