mmpretrain

Commit Graph

Author	SHA1	Message	Date
Ma Zerun	c708770b42	[Enhance] Support dynamic input shape for ViT-based algorithms. (#706 ) * Move `resize_pos_embed` to `mmcls.models.utils` * Refactor Vision Transformer * Refactor DeiT * Refactor MLP-Mixer * Refactor Swin-Transformer * Remove `indexing` arg * Support dynamic inputs for t2t_vit * Add copyright * Fix bugs in swin transformer * Add `pad_small_maps` option * Update swin transformer * Handle `attn_mask` in checkpoints of swin * Imporve by comments	2022-03-03 13:10:12 +08:00
Ma Zerun	f9a2b04cee	[Feature] Add DeiT backbone and checkpoints. (#576 ) * Support DeiT backbone. * Use hook to automatically resize pos embed * Update ViT training setting * Add deit configs and update docs * Fix vit arch assertion * Remove useless init function * Add unit tests. * Fix resize_pos_embed for DeiT * Improve according to comments.	2021-12-15 22:44:57 +08:00

Author

SHA1

Message

Date

Ma Zerun

c708770b42

[Enhance] Support dynamic input shape for ViT-based algorithms. (#706 )

* Move `resize_pos_embed` to `mmcls.models.utils`

* Refactor Vision Transformer

* Refactor DeiT

* Refactor MLP-Mixer

* Refactor Swin-Transformer

* Remove `indexing` arg

* Support dynamic inputs for t2t_vit

* Add copyright

* Fix bugs in swin transformer

* Add `pad_small_maps` option

* Update swin transformer

* Handle `attn_mask` in checkpoints of swin

* Imporve by comments

2022-03-03 13:10:12 +08:00

Ma Zerun

f9a2b04cee

[Feature] Add DeiT backbone and checkpoints. (#576 )

* Support DeiT backbone.

* Use hook to automatically resize pos embed

* Update ViT training setting

* Add deit configs and update docs

* Fix vit arch assertion

* Remove useless init function

* Add unit tests.

* Fix resize_pos_embed for DeiT

* Improve according to comments.

2021-12-15 22:44:57 +08:00

2 Commits (df6edd7f5a53cd6fa3a5c979fddf542fa926c671)