mmpretrain

Commit Graph

Author	SHA1	Message	Date
mzr1996	b5193a9029	[Fix] Reduce unit test memory usage of T2T-ViT	2022-05-16 17:01:30 +08:00
Ma Zerun	c708770b42	[Enhance] Support dynamic input shape for ViT-based algorithms. (#706 ) * Move `resize_pos_embed` to `mmcls.models.utils` * Refactor Vision Transformer * Refactor DeiT * Refactor MLP-Mixer * Refactor Swin-Transformer * Remove `indexing` arg * Support dynamic inputs for t2t_vit * Add copyright * Fix bugs in swin transformer * Add `pad_small_maps` option * Update swin transformer * Handle `attn_mask` in checkpoints of swin * Imporve by comments	2022-03-03 13:10:12 +08:00
Ma Zerun	fffa30dd48	[Feature] Add Tokens-to-Token ViT backbone and converted checkpoints. (#467 ) * add t2t backbone * register t2t_vit * add t2t_vit config * [Temp] Align posterize transform with timm. * Fix lint * Refactor t2t-vit * Add config for t2t-vit * Add metafile and README for t2t-vit * Add unit tests * configs * Update metafile and README * Improve docstring * Fix batch size which should be 8x64 instead of 8x128 * Fix typo * Update model zoo * Update training augments config. * Move some arguments of T2TModule to T2TViT * Update docs. * Update unit test Co-authored-by: HIT-cwh <2892770585@qq.com>	2021-10-29 10:37:16 +08:00

Author

SHA1

Message

Date

mzr1996

b5193a9029

[Fix] Reduce unit test memory usage of T2T-ViT

2022-05-16 17:01:30 +08:00

Ma Zerun

c708770b42

[Enhance] Support dynamic input shape for ViT-based algorithms. (#706 )

* Move `resize_pos_embed` to `mmcls.models.utils`

* Refactor Vision Transformer

* Refactor DeiT

* Refactor MLP-Mixer

* Refactor Swin-Transformer

* Remove `indexing` arg

* Support dynamic inputs for t2t_vit

* Add copyright

* Fix bugs in swin transformer

* Add `pad_small_maps` option

* Update swin transformer

* Handle `attn_mask` in checkpoints of swin

* Imporve by comments

2022-03-03 13:10:12 +08:00

Ma Zerun

fffa30dd48

[Feature] Add Tokens-to-Token ViT backbone and converted checkpoints. (#467 )

* add t2t backbone

* register t2t_vit

* add t2t_vit config

* [Temp] Align posterize transform with timm.

* Fix lint

* Refactor t2t-vit

* Add config for t2t-vit

* Add metafile and README for t2t-vit

* Add unit tests

* configs

* Update metafile and README

* Improve docstring

* Fix batch size which should be 8x64 instead of 8x128

* Fix typo

* Update model zoo

* Update training augments config.

* Move some arguments of T2TModule to T2TViT

* Update docs.

* Update unit test

Co-authored-by: HIT-cwh <2892770585@qq.com>

2021-10-29 10:37:16 +08:00

3 Commits (5665b8349a13a357386f705130e3f41ac538a9e5)