130 Commits

Author SHA1 Message Date
Ezra-Yu
47e033c466
[Fix] fix pbn bug (#1466) 2023-04-07 15:38:04 +08:00
Yixiao Fang
79ddc0f874
[Refactor] Update CI and issue template (#1463)
* Update CI

* update issue template

* update

* update collect_env function
2023-04-07 14:29:41 +08:00
Ezra-Yu
05124dbb71 fix lint 2023-04-06 22:01:11 +08:00
Ezra-Yu
b8cab5c9f7 update readme 2023-04-06 21:56:25 +08:00
Ezra-Yu
3932ddec10 update ckpt path 2023-04-06 21:56:25 +08:00
techmonsterwang
a6c24d104e update riformer mmpretrain 2023-04-06 21:56:25 +08:00
techmonsterwang
32c258ff19 update riformer mmpretrain 2023-04-06 21:56:25 +08:00
techmonsterwang
0b70c108b0 update riformer mmpretrain 2023-04-06 21:56:25 +08:00
Yixiao Fang
1ee9bbe050
[Docs] Update links (#1457)
* update links

* update readtherdocs

* update

* update

* fix lint

* update

* update

* update

* update cov branch

* update

* update

* update
2023-04-06 20:58:52 +08:00
Yixiao Fang
75dceaa78f
[Refactor] Add ln to vit avg_featmap output (#1447) 2023-04-06 11:59:39 +08:00
Ezra-Yu
3a25b13eb3
[Fix] Update CI (#1454)
* update ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* update window ci

* ignore tests/test_tools.py
2023-04-06 10:52:08 +08:00
Ma Zerun
b017670e1b
[Improve] Use PyTorch official scaled_dot_product_attention to accelerate MultiheadAttention. (#1434)
* [Improve] Use PyTorch official `scaled_dot_product_attention` to accelerate `MultiheadAttention`.

* Support `--local-rank` and `--amp` option for new version PyTorch.

* Fix imports and UT.
2023-03-29 15:50:44 +08:00
Ma Zerun
c4ccae40db
[Docs] Update user guides docs and tools for MMPretrain. (#1429)
* [Docs] Update user guides docs and tools for MMPretrain.

* Fix UT

* Fix Chinese docs.

* Improve according to comments.

* Fix windows CI.
2023-03-27 14:32:26 +08:00
Ma Zerun
6cedce234e
[Refactor] Update dev scripts to be compatible with selfsup tasks. (#1412)
* [Refactor] Update dev scripts to be compatible with selfsup tasks.

* Fix some missing fields in config files.

* Set maximum number of gpus for local training.

* Update README files

* Update according to comments.
2023-03-20 14:30:57 +08:00
Yixiao Fang
8875e9da92
[Docs] Update migration.md (#1417)
* update migration

* refine table

* update zh_cn

* fix lint

* Polish the documentation by ChatGPT.

* Update sphinx version and fix some warning.

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-17 10:30:09 +08:00
Yixiao Fang
76a1f3f735
[Refactor] Refactor the browse_dataset.py to support selfsup pipeline. (#1414)
* refactor browsedataset to support selfsup pipeline

* update make_grid to support list input

* mode 'transformed' supports list

* Beautify the visualization image.

* Fix compatitibly bug with matplotlib=3.5

* remove print

* fix bug of resize

* Apply mask only on the first image.

* Remove master only for some API in visualizer.

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-15 14:18:36 +08:00
Ma Zerun
3472ee5d2c
[Feature] Implememnt the universal visualizer for multiple task. (#1404)
* [Feature] Implememnt the universal visualizer for multiple task.

* Update tools

* Improve according to comments.

* Fix tools docs

* Add --test-cfg option and set default collate function.
2023-03-09 11:36:54 +08:00
Ma Zerun
dbf3df21a3
[Refactor] Use out_type to specify ViT-like backbone output. (#1408)
* [Refactor] Use  to specify ViT-like backbone output.

* Fix ClsBatchNormNeck

* Update mmpretrain/models/necks/mae_neck.py

---------

Co-authored-by: Yixiao Fang <36138628+fangyixiao18@users.noreply.github.com>
2023-03-09 11:02:58 +08:00
Ma Zerun
274a67223e
[Feature] Implement layer-wise learning rate decay optimizer constructor. (#1399)
* [Feature] Implement layer-wise learning rate decay optimizer constructor.

* Use num_layers instead of max_depth to avoid misleading

* Add UT

* Update docstring

* Update log info

* update LearningRateDecay configs

---------

Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-07 17:30:39 +08:00
Yixiao Fang
827be6e22d
[Fix] Fix value error while start training. (#1400)
* fix value error of randint

* add missing key in configs
2023-03-07 08:51:31 +08:00
Yixiao Fang
08dc8c75d3
[Refactor] Add selfsup algorithms. (#1389)
* remove basehead

* add moco series

* add byol simclr simsiam

* add ut

* update configs

* add simsiam hook

* add and refactor beit

* update ut

* add cae

* update extract_feat

* refactor cae

* add mae

* refactor data preprocessor

* update heads

* add maskfeat

* add milan

* add simmim

* add mixmim

* fix lint

* fix ut

* fix lint

* add eva

* add densecl

* add barlowtwins

* add swav

* fix lint

* update readtherdocs rst

* update docs

* update

* Decrease UT memory usage

* Fix docstring

* update DALLEEncoder

* Update model docs

* refactor dalle encoder

* update docstring

* fix ut

* fix config error

* add val_cfg and test_cfg

* refactor clip generator

* fix lint

* pass check

* fix ut

* add lars

* update type of BEiT in configs

* Use MMEngine style momentum in EMA.

* apply mmpretrain solarize

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-06 16:53:15 +08:00
Ma Zerun
a05c79e806
[Refactor] Move transforms in mmselfsup to mmpretrain. (#1396)
* [Refactor] Move transforms in mmselfsup to mmpretrain.

* Update transform docs and configs. And register some mmcv transforms in
mmpretrain.

* Fix missing transform wrapper.

* update selfsup transforms

* Fix UT

* Fix UT

* update gaussianblur inconfigs

---------

Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-03 15:01:11 +08:00
Yixiao Fang
c9670173aa
[Refactor] Move and refactor utils from mmselfsup. (#1385)
* add heads

* add losses

* fix

* remove mim head

* add modified backbones and target generators

* fix lint

* fix lint

* add heads

* add losses

* fix

* add data preprocessor from mmselfsup

* add ut for data prepocessor

* add GatherLayer

* add ema

* add batch shuffle

* add misc

* fix lint

* update

* update docstring
2023-02-28 17:04:40 +08:00
Ma Zerun
414ba80274
[Refactor] Refactor APIs, add ImageRetrievalInferencer and FeatureExtractor. (#1380)
* [Refactor] Refactor APIs, add `ImageRetrievalInferencer` and `FeatureExtractor'.

* Update image retrieval

* Update FeatureExtractor

* Fix UT
2023-02-28 16:31:42 +08:00
Yixiao Fang
e453a45d31
[Refactor] Add self-supervised backbones and target generators. (#1379)
* add heads

* add losses

* fix

* remove mim head

* add modified backbones and target generators

* add unittest

* refactor caevit

* add window_size check

* fix lint

* apply new DataSample

* fix ut error

* update ut

* fix ut

* fix lint

* Update base modules.

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-02-28 15:59:17 +08:00
Yixiao Fang
63d9f27fde
[Refactor] Add necks, heads and losses for the self-supervised task. (#1376)
* add necks

* refactor linear neck

* rename simmim neck

* add heads

* add losses

* fix

* add unittest

* update

* update cae

* remove mim head

* update config
2023-02-28 10:05:00 +08:00
Yixiao Fang
75c79311f4
[Refactor] Update datasets (#1375)
* add ut

* add places205

* support ann_file without labels

* temp test

* update custom

* update

* update ut

* Update CustomDataset.

* Update Places205.

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-02-27 15:42:22 +08:00
Ma Zerun
36bea13fca
[Refactor] Refactor ClsDatasample to a union DataSample. (#1371)
* [Refactor] Refactor ClsDatasample to a union DataSample.

* Add  method

* Fix docstring

* Update docstring.
2023-02-23 10:07:53 +08:00
mzr1996
4016f1348e Fix CI 2023-02-17 15:33:16 +08:00
mzr1996
0979e78573 Rename the package name to mmpretrain. 2023-02-17 15:20:55 +08:00