b017670e1b
[Improve] Use PyTorch official `scaled_dot_product_attention` to accelerate `MultiheadAttention`. ( #1434 )
...
* [Improve] Use PyTorch official `scaled_dot_product_attention` to accelerate `MultiheadAttention`.
* Support `--local-rank` and `--amp` option for new version PyTorch.
* Fix imports and UT.
2023-03-29 15:50:44 +08:00
c4ccae40db
[Docs] Update user guides docs and tools for MMPretrain. ( #1429 )
...
* [Docs] Update user guides docs and tools for MMPretrain.
* Fix UT
* Fix Chinese docs.
* Improve according to comments.
* Fix windows CI.
2023-03-27 14:32:26 +08:00
6cedce234e
[Refactor] Update dev scripts to be compatible with selfsup tasks. ( #1412 )
...
* [Refactor] Update dev scripts to be compatible with selfsup tasks.
* Fix some missing fields in config files.
* Set maximum number of gpus for local training.
* Update README files
* Update according to comments.
2023-03-20 14:30:57 +08:00
8875e9da92
[Docs] Update migration.md ( #1417 )
...
* update migration
* refine table
* update zh_cn
* fix lint
* Polish the documentation by ChatGPT.
* Update sphinx version and fix some warning.
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-17 10:30:09 +08:00
76a1f3f735
[Refactor] Refactor the `browse_dataset.py` to support selfsup pipeline. ( #1414 )
...
* refactor browsedataset to support selfsup pipeline
* update make_grid to support list input
* mode 'transformed' supports list
* Beautify the visualization image.
* Fix compatitibly bug with matplotlib=3.5
* remove print
* fix bug of resize
* Apply mask only on the first image.
* Remove master only for some API in visualizer.
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-15 14:18:36 +08:00
3472ee5d2c
[Feature] Implememnt the universal visualizer for multiple task. ( #1404 )
...
* [Feature] Implememnt the universal visualizer for multiple task.
* Update tools
* Improve according to comments.
* Fix tools docs
* Add --test-cfg option and set default collate function.
2023-03-09 11:36:54 +08:00
dbf3df21a3
[Refactor] Use `out_type` to specify ViT-like backbone output. ( #1408 )
...
* [Refactor] Use to specify ViT-like backbone output.
* Fix ClsBatchNormNeck
* Update mmpretrain/models/necks/mae_neck.py
---------
Co-authored-by: Yixiao Fang <36138628+fangyixiao18@users.noreply.github.com>
2023-03-09 11:02:58 +08:00
274a67223e
[Feature] Implement layer-wise learning rate decay optimizer constructor. ( #1399 )
...
* [Feature] Implement layer-wise learning rate decay optimizer constructor.
* Use num_layers instead of max_depth to avoid misleading
* Add UT
* Update docstring
* Update log info
* update LearningRateDecay configs
---------
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-07 17:30:39 +08:00
827be6e22d
[Fix] Fix value error while start training. ( #1400 )
...
* fix value error of randint
* add missing key in configs
2023-03-07 08:51:31 +08:00
08dc8c75d3
[Refactor] Add selfsup algorithms. ( #1389 )
...
* remove basehead
* add moco series
* add byol simclr simsiam
* add ut
* update configs
* add simsiam hook
* add and refactor beit
* update ut
* add cae
* update extract_feat
* refactor cae
* add mae
* refactor data preprocessor
* update heads
* add maskfeat
* add milan
* add simmim
* add mixmim
* fix lint
* fix ut
* fix lint
* add eva
* add densecl
* add barlowtwins
* add swav
* fix lint
* update readtherdocs rst
* update docs
* update
* Decrease UT memory usage
* Fix docstring
* update DALLEEncoder
* Update model docs
* refactor dalle encoder
* update docstring
* fix ut
* fix config error
* add val_cfg and test_cfg
* refactor clip generator
* fix lint
* pass check
* fix ut
* add lars
* update type of BEiT in configs
* Use MMEngine style momentum in EMA.
* apply mmpretrain solarize
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-06 16:53:15 +08:00
a05c79e806
[Refactor] Move transforms in mmselfsup to mmpretrain. ( #1396 )
...
* [Refactor] Move transforms in mmselfsup to mmpretrain.
* Update transform docs and configs. And register some mmcv transforms in
mmpretrain.
* Fix missing transform wrapper.
* update selfsup transforms
* Fix UT
* Fix UT
* update gaussianblur inconfigs
---------
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-03 15:01:11 +08:00
c9670173aa
[Refactor] Move and refactor utils from mmselfsup. ( #1385 )
...
* add heads
* add losses
* fix
* remove mim head
* add modified backbones and target generators
* fix lint
* fix lint
* add heads
* add losses
* fix
* add data preprocessor from mmselfsup
* add ut for data prepocessor
* add GatherLayer
* add ema
* add batch shuffle
* add misc
* fix lint
* update
* update docstring
2023-02-28 17:04:40 +08:00
414ba80274
[Refactor] Refactor APIs, add `ImageRetrievalInferencer` and `FeatureExtractor`. ( #1380 )
...
* [Refactor] Refactor APIs, add `ImageRetrievalInferencer` and `FeatureExtractor'.
* Update image retrieval
* Update FeatureExtractor
* Fix UT
2023-02-28 16:31:42 +08:00
e453a45d31
[Refactor] Add self-supervised backbones and target generators. ( #1379 )
...
* add heads
* add losses
* fix
* remove mim head
* add modified backbones and target generators
* add unittest
* refactor caevit
* add window_size check
* fix lint
* apply new DataSample
* fix ut error
* update ut
* fix ut
* fix lint
* Update base modules.
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-02-28 15:59:17 +08:00
63d9f27fde
[Refactor] Add necks, heads and losses for the self-supervised task. ( #1376 )
...
* add necks
* refactor linear neck
* rename simmim neck
* add heads
* add losses
* fix
* add unittest
* update
* update cae
* remove mim head
* update config
2023-02-28 10:05:00 +08:00
75c79311f4
[Refactor] Update datasets ( #1375 )
...
* add ut
* add places205
* support ann_file without labels
* temp test
* update custom
* update
* update ut
* Update CustomDataset.
* Update Places205.
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-02-27 15:42:22 +08:00
36bea13fca
[Refactor] Refactor ClsDatasample to a union DataSample. ( #1371 )
...
* [Refactor] Refactor ClsDatasample to a union DataSample.
* Add method
* Fix docstring
* Update docstring.
2023-02-23 10:07:53 +08:00
4016f1348e
Fix CI
2023-02-17 15:33:16 +08:00
0979e78573
Rename the package name to `mmpretrain`.
2023-02-17 15:20:55 +08:00
Ma Zerun
Yixiao Fang