b16310182b
[Fix] Fix type in Swin Transformer ( #1274 )
2022-02-09 19:08:32 +08:00
66b778c064
[Improve] Use MMCV load_state_dict func in ViT/Swin ( #1272 )
...
* [Improve] Use MMCV load_state_dict func in ViT/Swin
* use CheckpointLoader instead
2022-02-09 00:52:42 -05:00
3057ef6d9b
[Fix] Fix wrong init usage in transformer models ( #1069 )
...
* fix wrong trunc_normal_init usage
* fix mit init weights
* fix vit init weights
* fix mit init weights
* fix typo
* fix swin init weights
2021-12-06 19:59:33 +08:00
10886b00f0
fix load ckpt bug in swin ( #928 )
2021-09-30 07:50:44 -07:00
85227b46c7
[Improvement] Refactor Swin-Transformer ( #800 )
...
* [Improvement] Refactor Swin-Transformer
* fixed swin test
* update patch emebd, add more tests
* fixed test
* remove pretrain_style
* fixed padding
* resolve coments
* use mmcv 2tuple
* refactor init_cfg
Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>
2021-09-29 08:46:33 +08:00
4003b8f421
[Feature] Support BiSeNetV2 ( #804 )
...
* BiSeNetV2 first commit
* BiSeNetV2 unittest
* remove pytest
* add pytest module
* fix ConvModule input name
* fix pytest error
* fix unittest
* refactor
* BiSeNetV2 Refactory
* fix docstrings and add some small changes
* use_sigmoid=False
* fix potential bugs about upsampling
* Use ConvModule instead
* Use ConvModule instead
* fix typos
* fix typos
* fix typos
* discard nn.conv2d
* discard nn.conv2d
* discard nn.conv2d
* delete **kwargs
* uploading markdown and model
* final commit
* BiSeNetV2 adding Unittest for its modules
* BiSeNetV2 adding Unittest for its modules
* BiSeNetV2 adding Unittest for its modules
* BiSeNetV2 adding Unittest for its modules
* BiSeNetV2 adding Unittest for its modules
* BiSeNetV2 adding Unittest for its modules
* BiSeNetV2 adding Unittest for its modules
* Fix README conflict
* Fix unittest problem
* Fix unittest problem
* BiSeNetV2
* Fixing fps
* Fixing typpos
* bisenetv2
2021-09-26 18:52:16 +08:00
4981ff68c2
[Fix] Fix docstring link problem in readthedocs ( #845 )
...
* fix docstring link
* fix docstring link
* fix docstring link
* fix docstring link
* fix docstring link
* fix docstring link
2021-09-02 17:06:43 +08:00
c11da07e18
[Enhancement] Delete convert function and add instruction to ViT/Swin README.md ( #791 )
...
* delete convert function and add instruction to README.md
* unified model convert and README
* remove url
* fix import error
* fix unittest
* rename pretrain
* rename vit and deit pretrain
* Update upernet_deit-b16_512x512_160k_ade20k.py
* Update upernet_deit-b16_512x512_80k_ade20k.py
* Update upernet_deit-b16_ln_mln_512x512_160k_ade20k.py
* Update upernet_deit-b16_mln_512x512_160k_ade20k.py
* Update upernet_deit-s16_512x512_160k_ade20k.py
* Update upernet_deit-s16_512x512_80k_ade20k.py
* Update upernet_deit-s16_ln_mln_512x512_160k_ade20k.py
* Update upernet_deit-s16_mln_512x512_160k_ade20k.py
Co-authored-by: Jiarui XU <xvjiarui0826@gmail.com>
Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>
2021-08-25 15:00:41 -07:00
441be4e435
[Dcos] Add header for files ( #796 )
...
* Add header for files
* Delete header in config files
2021-08-16 23:16:55 -07:00
f80066910c
[Fix] Replace interpolate with resize ( #731 )
...
* Replace interpolate with resize
* Replace nn.Upsample with ops.Upsample
* Fix test
2021-07-28 16:56:22 +08:00
4b218bc635
[Fix] Fix ATTENTION registry ( #729 )
...
* register ATTENTION registry from the parent ATTENTION registry of MMCV to avoid conflict with other repos
* remove redundant file
2021-07-27 23:19:12 +08:00
4d34581897
[Feature] Segformer backbone re-implementation ( #594 )
...
* [Feature]Segformer re-implementation
* Using act_cfg and norm_cfg to control activation and normalization
* Split this PR into several little PRs
* Fix lint error
* Remove SegFormerHead
* parameters init refactor
* 1. Refactor segformer backbone parameters init;
2. Remove rebundant functions and unit tests;
* Remove rebundant codes
* 1. Remove rebundant codes;
2. Modify module name;
* Refactor the backbone of segformer using mmcv.cnn.bricks.transformer.py
* Fix some code logic bugs.
* Add mit_convert.py to match pretrain keys of segformer.
* Resolve some comments.
* 1. Add some assert to ensure right params;
2. Support flexible peconv position;
* Add pe_index assert and fix unit test.
* 1. Add doc string for MixVisionTransformer;
2. Add some unit tests for MixVisionTransformer;
* Use hw_shape to pass shape of feature map.
* 1. Fix doc string of MixVisionTransformer;
2. Simplify MixFFN;
3. Modify H, W to hw_shape;
* Add more unit tests.
* Add doc string for shape convertion functions.
* Add some unit tests to improve code coverage.
* Fix Segformer backbone pretrain weights match bug.
* resolve the shape convertion functions doc string.
* Add pad_to_patch_size arg.
* Modify default value of pad_to_patch_size arg.
2021-07-19 09:40:40 -07:00
b6c7c77a08
[WIP] Add Swin Transformer ( #511 )
...
* add Swin Transformer
* add Swin Transformer
* fixed import
* Add some swin training settings.
* Fix some filename error.
* Fix attribute name: pretrain -> pretrained
* Upload mmcls implementation of swin transformer.
* Refactor Swin Transformer to follow mmcls style.
* Refactor init_weigths of swin_transformer.py
* Fix lint
* Match inference precision
* Add some comments
* Add swin_convert to load official style ckpt
* Remove arg: auto_pad
* 1. Complete comments for each block;
2. Correct weight convert function;
3. Fix the pad of Patch Merging;
* Clean function args.
* Fix vit unit test.
* 1. Add swin transformer unit tests;
2. Fix some pad bug;
3. Modify config to adapt new swin implementation;
* Modify config arg
* Update readme.md of swin
* Fix config arg error and Add some swin benchmark msg.
* Add MeM and ms test content for readme.md of swin transformer.
* Fix doc string of swin module
* 1. Register swin transformer to model list;
2. Modify pth url which keep meta attribute;
* Update swin.py
* Merge config settings.
* Modify config style.
* Update README.md
Add ViT link
* Modify main readme.md
Co-authored-by: Jiarui XU <xvjiarui0826@gmail.com>
Co-authored-by: sennnnn <201730271412@mail.scut.edu.cn>
Co-authored-by: Junjun2016 <hejunjun@sjtu.edu.cn>
2021-07-01 23:41:55 +08:00
MengzhangLI
Jerry Jiarui XU
Junjun2016
谢昕辰
Miguel Méndez
sennnnn
Ze Liu