6 Commits (e80418a424aaefb81c95df458216bb3e9af246c4)

Author	SHA1	Message	Date
Ma Zerun	dbf3df21a3	[Refactor] Use `out_type` to specify ViT-like backbone output. (#1408) ... * [Refactor] Use to specify ViT-like backbone output. * Fix ClsBatchNormNeck * Update mmpretrain/models/necks/mae_neck.py --------- Co-authored-by: Yixiao Fang <36138628+fangyixiao18@users.noreply.github.com>	2023-03-09 11:02:58 +08:00
mzr1996	0979e78573	Rename the package name to `mmpretrain`.	2023-02-17 15:20:55 +08:00
Ma Zerun	b7d0d521eb	[Refactor] Use `mmengine` instead of `mmcv` and refactor some transforms. (#986) ... * [Refactor] Refactor the rest data transforms and fix some docstring. * Use `mmengine` instead of `mmcv` * Refactor KFold dataset tools * Fix docstring according to comments	2022-08-24 15:59:02 +08:00
mzr1996	dd660ed99e	[Improve] Clean useless code and reduce unit tests memory usage.	2022-07-18 11:11:13 +08:00
Ma Zerun	c708770b42	[Enhance] Support dynamic input shape for ViT-based algorithms. (#706) ... * Move `resize_pos_embed` to `mmcls.models.utils` * Refactor Vision Transformer * Refactor DeiT * Refactor MLP-Mixer * Refactor Swin-Transformer * Remove `indexing` arg * Support dynamic inputs for t2t_vit * Add copyright * Fix bugs in swin transformer * Add `pad_small_maps` option * Update swin transformer * Handle `attn_mask` in checkpoints of swin * Imporve by comments	2022-03-03 13:10:12 +08:00
Ma Zerun	f9a2b04cee	[Feature] Add DeiT backbone and checkpoints. (#576) ... * Support DeiT backbone. * Use hook to automatically resize pos embed * Update ViT training setting * Add deit configs and update docs * Fix vit arch assertion * Remove useless init function * Add unit tests. * Fix resize_pos_embed for DeiT * Improve according to comments.	2021-12-15 22:44:57 +08:00