Yuan Liu
90f6292d89
[Refactor]: Refactor CAE ( #645 )
...
* [Feature]: Add target generator config and param
* [Feature]: Use target generator to generate target
* [Fix]: Fix lint
* [Fix]: Fix UT
* [Fix]: Delete petrel
* [Fix]: Delete download ckpt
* [Fix]: Refactor CAE config
2022-12-30 17:27:20 +08:00
Wangbo Zhao(黑色枷锁)
da8b6c5146
[Feature] Support EVA-MAE style ( #632 )
...
* [Feature] Support EVA-MAE style
* [Feature] Refine After Review1
* [Feature] Refine After Review2 and Review3. Add ckpt links
* [Feature] Refine After Review4
* [Feature] Refine After Review5
* [Feature] Refine After Review6
* [Feature] Fix file name
2022-12-27 15:47:32 +08:00
Yixiao Fang
73cd764b5f
[Feature] Support pixel reconstruction visualization ( #570 )
...
* refactor reconstruction visualization
* support simmim visualization
* fix reconstruction bug of MAE
* support visualization of MaskFeat
* refaction mae visualization demo
* add unit test
* fix lint and ut
* update
* add docs
* set random seed
* update
* update docstring
* add torch version check
* update
* rename
* update version
* update
* fix lint
* add docstring
* update docs
2022-12-06 19:45:01 +08:00
Yuan Liu
d73c953804
[Feature]: MILAN supported ( #600 )
...
* [Feature]: Add milan ft config
* [Feature]: Add milan linear prob
* [Feature]: Set diff rank seed in mae ft
* [Feature]: V1
* [Feature]: Add target generator
* [Feature]: Add MILAN head and loss
* [Feature]: Refine milan
* [Feature]: Delete redundant mask and ids_shuffle
* [Feature]: Delete redundant return value of attention masking
* [Feature]: Detele return attention param
* [Feature]: Add typehint and docstring for PromptDecoder and PromptAttention
* [Feature]: Add type hint and docstring
* [Feature]: Fix lint
* [Fix]: Remove petrel backend
* [Feature]: Delete redundant code in clip
* [Feature]: Add ut for milan algorithm
* [Feature]: Delete redundant code
* [Feature]: Use mock for target generator
* [Feature]: Add docstring
* [Feature]: Create classification folder in milan
* [Feature]: Add README
* [Feature]: Add metafile
* [Feature]: Add main paper readme
* [Feature]: Update model zoom
* [Feature]: Fix review
* [Feature]: Fix config path bug
* [Feature]: Fix review#2
* [Feature]: Delete MILAN loss
* [Fix]: Add metafile
* [Fix]: Fix lint
* [Feature]: Change the test milan
* [Feature]: Update the config file name
2022-12-06 19:42:13 +08:00
RenQin
7a7b048f23
[Feature]: Add BEiT Support ( #425 )
...
* [Feature]: Add BEiT Support
* [Fix]: fix bugs after update
* [Fix]: fix bugs in backbone
* [Refactor]: refactor config
* [Feature]: Support BEiTv2
* [Fix]: Fix UT
* [Fix]: rename some configs
* [Fix]: fix beitv2neck
* [Refactor]: refactor beitv2
* [Fix]: fix lint
* refactor configs
* refactor beitv2
* update configs
* add dalle target generator
* refactor for beitv1
* refactor rel_pos_bias of beit
* update configs
* update configs
* update v1 configs
* update v2 configs
* refactoe layer decay
* update unittest
* fix lint
* fix ut
* add docstrings
* rename
* fix lint
* add beit model and log links
* fix lint
* update according to review
* update
* update
* update LearningRateDecayOptimWrapperConstructor
related configs
* update init and backbone
* update neck and vqkd
* refactor neck
* fix lint
* add some comments
* fix typo
Co-authored-by: 任琴 <PJLAB\renqin@shai14001114l.pjlab.org>
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2022-12-06 16:40:05 +08:00
Yixiao Fang
bc0807d3cf
Update CI and UT ( #601 )
...
* update ci
* update ut
* fix lint
* update
2022-12-02 17:09:00 +08:00
lkylkylky
e761acd1bd
[Feature] Add Maskfeat-1.x Support ( #494 )
...
* [Feature]: Add MaskfeatMaskGenerator Pipeline
* [Feature]: Add MaskFeatMaskGenerator Pipeline
* [Feature]: Add Backbone of MaskFeat
* [Feature]: Add HogLayerC for MaskFeat
* [Feature]: Add Loss of MaskFeat
* [Feature]: Add Head of MaskFeat
* [Feature]: Add Algorithms of MaskFeat
* [Feature]: Add Config of MaskFeat
* [Fix] fix ut of MaskFeatMaskGenerator
* refine configs
* update
* refactor to support hog generator
* update config
* update
* update config and metafiel
* update maskfeat model link
* fix ut
* refine codes
* fix lint
* refine docstring
* refactor maskfeat head
* update model links
* fix ut
* refine docstring
* update model-index
* using BEiTMaskGenerator
* refine configs
* update ut
* fix lint
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2022-11-03 16:09:36 +08:00
RenQin
41747f73c7
[Refactor]: refactor MAE visualization ( #471 )
...
* [Refactor]: refactor MAE visualization
* [Fix]: fix lint
* [Refactor]: refactor MAE visualization
* [Feature]: add mae_visualization.py
* [UT]: add unit test
* [Refactor]: move mae_visualization.py to tools/analysis_tools
* [Docs]: Add the purpose of the function unpatchify()
* [Fix]: fix lint
2022-11-03 16:09:36 +08:00
Yixiao Fang
ff5f5ae2a9
[CI] update CI package ( #476 )
...
* update circleci
* update github action
* fix windows error
* update
* update pr and merge state
* fix lint
* update
* update
* update circle ci
* fix
* fix ut
2022-10-12 19:35:44 +08:00
Yuan Liu
20488d01b4
[Refactor]: Refactor data flow ( #429 )
...
* [Refactor]: Refactor data flow
* [Fix]: Change data sample to data samples
* [Fix]: Change batch_inputs to inputs
* [Fix]: Fix lint and UT
* [Fix]: Fix UT
* [Fix]: Fix lint
* [Fix]: Fix docstring
* [Fix]: Fix UT
* [Refactor]: Add assert in data preprocessor
* [Fix]: Fix lint
2022-08-30 11:34:04 +08:00
Yixiao Fang
3c51e86d44
[Fix] Fix ut ( #422 )
...
* add register all modules
* add scope
2022-08-19 14:36:26 +08:00
Yixiao Fang
ba50b7450b
[Refactor] Rename mmselfsup.data to mmselfsup.structures ( #385 )
2022-07-30 16:36:48 +08:00
Yixiao Fang
c7101c7648
[Enhance] support non-dist training of simclr ( #352 )
...
* support non-dist training of simclr
* revise ut
2022-07-19 14:21:26 +08:00
Yixiao Fang
af3b261dce
[Enhance] support non-dist training of mocov3 ( #346 )
...
* support non-dist training of mocov3
* revise docstring
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
4cb6aa3895
[Refactor] refactor package
2022-07-18 11:06:44 +08:00
xiejiahao.vendor
f4c19381c9
[Refactor] refactor dc and odc
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
d390a03a47
[Refactor] support to train moco in non-dist environment
2022-07-18 11:06:44 +08:00
renqin
4c5c4b88f4
[Refactor]: refactor npid algorithm
2022-07-18 11:06:44 +08:00
renqin
dfa4d180df
[Refactor]: refactor swav algorithm
2022-07-18 11:06:44 +08:00
renqin
5f778aa552
[Refactor]: refactor densecl algorithm
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
1e16016b27
[Refactor] refactor byol
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
acf001d554
[Refactor]: Refactor CAE
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
61fdc30c59
[Refactor] refactor simclr
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
c9a532e1c0
[Refactor] refactor mocov3 benchmark
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
bc199203a0
[Refactor] refactor rotation pred
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
87ed42aaeb
[Refactor] refactor barlowtwins
2022-07-18 11:06:44 +08:00
renqin
7528fbcbe8
[Refactor]: refactor simsiam algorithm
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
5a84e88609
[Refactor] refactor mocov3
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
bcc4576ace
[Refactor]: Refactor relative loc
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
5ba17adb23
[Refactor]: Refactor SimMIM
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
b9df061e7f
[Refactor] refactor moco according to new basemodel
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
35e0988527
[Refactor]: Refactor base model and create a sample for MAE
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
0a2a811acf
[Fix]: Fix lint
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
c39277b216
[Feature] apply EMA from mmengine and add CosineEMA
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
17136bf935
[Feature]: Add pseudo_label in selfsupdatasample
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
2f2813ecd4
[Refactor]: Refactor ODC
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
0baac605d1
[Refactor]: Refactor NPID
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
0c88e8dceb
[Refactor]: Refactor loss
2022-07-18 11:06:44 +08:00
renqin
99de0c1aeb
[Refactor]: refactor RelativeLoc model and RandomPatchWithLabels transform
2022-07-18 11:06:44 +08:00
renqin
e39e3bbac0
[Refactor]: refactor RotationPred model and RotationWithLabels transform
2022-07-18 11:06:44 +08:00
YuanLiuuuuuu
d1b7466d9b
[Refactor]: Refactor deepcluster
2022-07-18 11:06:44 +08:00
renqin
9ad2f6e6d5
[Refactor]: refactor the interface of byol, densecl, swav, barlowtwins and simclr
2022-07-18 11:06:44 +08:00
liuyuan1.vendor
be1dd2f5c2
[Refactor]: Refactor CAE
2022-07-18 11:06:44 +08:00
liuyuan1.vendor
e687aff595
[Refactor]: Change the interface of SimMIM
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
e87be11a98
[Refactor] refactor moco and mocov3
2022-07-18 11:06:44 +08:00
fangyixiao.vendor
11c3a6a3af
[Refactor] refactor SimSiam
2022-07-18 11:06:44 +08:00
liuyuan1.vendor
2063a54c2a
[Refactor]: Refactor the interface of MAE
2022-07-18 11:06:44 +08:00
fangyixiao18
751c817b1f
[UT] clean unit test
2022-07-18 11:06:44 +08:00
Yixiao Fang
bbdf670d00
Bump version to v0.9.1 ( #322 )
...
* [Fix]: Set qkv bias to False for cae and True for mae (#303 )
* [Fix]: Add mmcls transformer layer choice
* [Fix]: Fix transformer encoder layer bug
* [Fix]: Change UT of cae
* [Feature]: Change the file name of cosine annealing hook (#304 )
* [Feature]: Change cosine annealing hook file name
* [Feature]: Add UT for cosine annealing hook
* [Fix]: Fix lint
* read tutorials and fix typo (#308 )
* [Fix] fix config errors in MAE (#307 )
* update readthedocs algorithm readme (#310 )
* [Docs] Replace markdownlint with mdformat (#311 )
* Replace markdownlint with mdformat to avoid installing ruby
* fix typo
* add 'ba' to codespell ignore-words-list
* Configure Myst-parser to parse anchor tag (#309 )
* [Docs] rewrite install.md (#317 )
* rewrite the install.md
* add faq.md
* fix lint
* add FAQ to README
* add Chinese version
* fix typo
* fix format
* remove modification
* fix format
* [Docs] refine README.md file (#318 )
* refine README.md file
* fix lint
* format language button
* rename getting_started.md
* revise index.rst
* add model_zoo.md to index.rst
* fix lint
* refine readme
Co-authored-by: Jiahao Xie <52497952+Jiahao000@users.noreply.github.com>
* [Enhance] update byol models and results (#319 )
* Update version information (#321 )
Co-authored-by: Yuan Liu <30762564+YuanLiuuuuuu@users.noreply.github.com>
Co-authored-by: Yi Lu <21515006@zju.edu.cn>
Co-authored-by: RenQin <45731309+soonera@users.noreply.github.com>
Co-authored-by: Jiahao Xie <52497952+Jiahao000@users.noreply.github.com>
2022-06-01 09:59:05 +08:00
Yuan Liu
399b5a0d6e
Bump version to v0.9.0 ( #299 )
...
* [Feature]: MAE pre-training with fp16 (#271 )
* [Feature]: MAE pre-training with fp16
* [Fix]: Fix lint
* [Fix]: Fix SimMIM config link, and add SimMIM to model_zoo (#272 )
* [Fix]: Fix link error
* [Fix]: Add SimMIM to model zoo
* [Fix]: Fix lint
* [Fix] fix 'no init_cfg' error for pre-trained model backbones (#256 )
* [UT] add unit test for apis (#276 )
* [UT] add unit test for apis
* ignore pytest log
* [Feature] Add extra dataloader settings in configs. (#264 )
* [Feature] support to set validation samples per gpu independently
* set default to be cfg.data.samples_per_gpu
* modify the tools/test.py
* using 'train_dataloader', 'val_dataloader', 'test_dataloader' for specific settings
* test 'evaluation' branch
* [Fix]: Change imgs_per_gpu to samples_per_gpu MAE (#278 )
* [Feature]: Add SimMIM 192 pt 224 ft (#280 )
* [Feature]: Add SimMIM 192 pt 224 ft
* [Feature]: Add simmim 192 pt 224 ft to readme
* [Fix] fix key error bug when registering custom hooks (#273 )
* [UT] remove pytorch1.5 test (#288 )
* [Benchmark] rename linear probing config file names (#281 )
* [Benchmark] rename linear probing config file names
* update config links
* Avoid GPU memory leak with prefetch dataloader (#277 )
* [Feature] barlowtwins (#207 )
* [Fix]: Fix mmcls upgrade bug (#235 )
* [Feature]: Add multi machine dist_train (#232 )
* [Feature]: Add multi machine dist_train
* [Fix]: Change bash to sh
* [Fix]: Fix missing sh suffix
* [Refactor]: Change bash to sh
* [Refactor] Add unit test (#234 )
* [Refactor] add unit test
* update workflow
* update
* [Fix] fix lint
* update test
* refactor moco and densecl unit test
* fix lint
* add unit test
* update unit test
* remove modification
* [Feature]: Add MAE metafile (#238 )
* [Feature]: Add MAE metafile
* [Fix]: Fix lint
* [Fix]: Change LARS to AdamW in the metafile of MAE
* Add barlowtwins
* Add unit test for barlowtwins
* Adjust training params
* add decorator to pass CI
* adjust params
* Add barlowtwins
* Add unit test for barlowtwins
* Adjust training params
* add decorator to pass CI
* adjust params
* add barlowtwins configs
* revise LatentCrossCorrelationHead
* modify ut to save memory
* add metafile
* add barlowtwins results to model zoo
* add barlow twins to homepage
* fix batch size bug
* add algorithm readme
* add type hints
* reorganize the model zoo
* remove one config
* recover the config
* add missing docstring
* revise barlowtwins
* reorganize coco and voc benchmark
* add barlowtwins to index.rst
* revise docstring
Co-authored-by: Yuan Liu <30762564+YuanLiuuuuuu@users.noreply.github.com>
Co-authored-by: Yixiao Fang <36138628+fangyixiao18@users.noreply.github.com>
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
* [Fix] fix --local-rank (#290 )
* [UT] reduce memory usage while runing unit test (#291 )
* [Feature]: CAE Supported (#284 )
* [Feature]: Add mc
* [Feature]: Add dataset of CAE
* [Feature]: Init version of CAE
* [Feature]: Add mc
* [Fix]: Change beta to (0.9, 0.999)
* [Fix]: New feature
* [Fix]: Decouple the qkv bias
* [Feature]: Decouple qkv bias in MultiheadAttention
* [Feature]: New mask generator
* [Fix]: Fix TransformEncoderLayer bug
* [Feature]: Add MAE CAE linear prob
* [Fix]: Fix config
* [Fix]: Delete redundant mc
* [Fix]: Add init value in mim cls vit
* [Fix]: Fix cae ft config
* [Fix]: Delete repeated init_values
* [Fix]: Change bs from 64 to 128 in CAE ft
* [Fix]: Add mc in cae pt
* [Fix]: Fix momemtum update bug
* [Fix]: Add no weight_decay for gamma
* [Feature]: Add mc for cae pt
* [Fix]: Delete mc
* [Fix]: Delete redundant files
* [Fix]: Fix lint
* [Feature]: Add docstring to algo, backbone, neck and head
* [Fix]: Fix lint
* [Fix]: network
* [Feature]: Add docstrings for network blocks
* [Feature]: Add docstring to ToTensor
* [Feature]: Add docstring to transoform
* [Fix]: Add type hint to BEiTMaskGenerator
* [Fix]: Fix lint
* [Fix]: Add copyright to dalle_e
* [Fix]: Fix BlockwiseMaskGenerator
* [Feature]: Add UT for CAE
* [Fix]: Fix dalle state_dict path not existed bug
* [Fix]: Delete file_client_args related code
* [Fix]: Remove redundant code
* [Refactor]: Add fp16 to the name of cae pre-train config
* [Refactor]: Use FFN from mmcv
* [Refactor]: Change network_blocks to trasformer_blocks
* [Fix]: Fix mask generator name bug
* [Fix]: cae pre-train config bug
* [Fix]: Fix docstring grammar
* [Fix]: Fix mc related code
* [Fix]: Add object parent to transform
* [Fix]: Delete unnecessary modification
* [Fix]: Change blockwisemask generator to simmim mask generator
* [Refactor]: Change cae mae pretrain vit to cae mae vit
* [Refactor]: Change lamb to lambd
* [Fix]: Remove blank line
* [Fix]: Fix lint
* [Fix]: Fix UT
* [Fix]: Delete modification to swin
* [Fix]: Fix lint
* [Feature]: Add README and metafile
* [Feature]: Update index.rst
* [Fix]: Update model_zoo
* [Fix]: Change MAE to CAE in algorithm
* [Fix]: Change SimMIMMaskGenerator to CAEMaskGenerator
* [Fix]: Fix model zoo
* [Fix]: Change to dalle_encoder
* [Feature]: Add download link for dalle
* [Fix]: Fix lint
* [Fix]: Fix UT
* [Fix]: Update metafile
* [Fix]: Change b to base
* [Feature]: Add dalle download link in warning
* [Fix] add arxiv link in readme
Co-authored-by: Jiahao Xie <52497952+Jiahao000@users.noreply.github.com>
* [Enhance] update SimCLR models and results (#295 )
* [Enhance] update simclr models and results
* [Fix] revise comments to indicate settings
* Update version (#296 )
* [Feature]: Update to 0.9.0
* [Feature]: Add version constrain for mmcls
* [Fix]: Fix bug
* [Fix]: Fix version bug
* [Feature]: Update version in install.md
* update changelog
* update readme
* [Fix] fix uppercase
* [Fix] fix uppercase
* [Fix] fix uppercase
* update version dependency
* add cae to readme
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
Co-authored-by: Jiahao Xie <52497952+Jiahao000@users.noreply.github.com>
Co-authored-by: Yixiao Fang <36138628+fangyixiao18@users.noreply.github.com>
Co-authored-by: Ming Li <73068772+mitming@users.noreply.github.com>
Co-authored-by: xcnick <xcnick0412@gmail.com>
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
Co-authored-by: Jiahao Xie <52497952+Jiahao000@users.noreply.github.com>
2022-04-29 20:01:30 +08:00
