ae7a7b7560
Bump version to 1.0.0 ( #1686 )
...
* bump version to 1.0.0
* update
* update
* fix lint
* update
* update
* update changelog
* update
2023-07-05 11:51:12 +08:00
7cbfb36c14
[Refactor] Fix spelling ( #1681 )
...
* [Refactor] Fix spelling
* [Refactor] Fix spelling
* [Refactor] Fix spelling
* [Refactor] Fix spelling
2023-07-05 11:07:43 +08:00
d4a6dfa00a
Add benchmark options ( #1654 )
...
* update dev_scripts
* update metafile
* update multimodal floating range
* fix lint
* update
* update
* fix lint
* Update metric map
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-06-20 14:18:57 +08:00
6847d20d57
[Feature] Support multiple multi-modal algorithms and inferencers. ( #1561 )
...
* [Feat] Migrate blip caption to mmpretrain. (#50 )
* Migrate blip caption to mmpretrain
* minor fix
* support train
* [Feature] Support OFA caption task. (#51 )
* [Feature] Support OFA caption task.
* Remove duplicated files.
* [Feature] Support OFA vqa task. (#58 )
* [Feature] Support OFA vqa task.
* Fix lint.
* [Feat] Add BLIP retrieval to mmpretrain. (#55 )
* init
* minor fix for train
* fix according to comments
* refactor
* Update Blip retrieval. (#62 )
* [Feature] Support OFA visual grounding task. (#59 )
* [Feature] Support OFA visual grounding task.
* minor add TODO
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* [Feat] Add flamingos coco caption and vqa. (#60 )
* first init
* init flamingo coco
* add vqa
* minor fix
* remove unnecessary modules
* Update config
* Use `ApplyToList`.
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
* [Feature]: BLIP2 coco retrieval (#53 )
* [Feature]: Add blip2 retriever
* [Feature]: Add blip2 all modules
* [Feature]: Refine model
* [Feature]: x1
* [Feature]: Runnable coco ret
* [Feature]: Runnable version
* [Feature]: Fix lint
* [Fix]: Fix lint
* [Feature]: Use 364 img size
* [Feature]: Refactor blip2
* [Fix]: Fix lint
* refactor files
* minor fix
* minor fix
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* Remove
* fix blip caption inputs (#68 )
* [Feat] Add BLIP NLVR support. (#67 )
* first init
* init flamingo coco
* add vqa
* add nlvr
* refactor nlvr
* minor fix
* minor fix
* Update dataset
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
* [Feature]: BLIP2 Caption (#70 )
* [Feature]: Add language model
* [Feature]: blip2 caption forward
* [Feature]: Reproduce the results
* [Feature]: Refactor caption
* refine config
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* [Feat] Migrate BLIP VQA to mmpretrain (#69 )
* reformat
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* refactor code
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* Update RefCOCO dataset
* [Fix] fix lint
* [Feature] Implement inference APIs for multi-modal tasks. (#65 )
* [Feature] Implement inference APIs for multi-modal tasks.
* [Project] Add gradio demo.
* [Improve] Update requirements
* Update flamingo
* Update blip
* Add NLVR inferencer
* Update flamingo
* Update hugging face model register
* Update ofa vqa
* Update BLIP-vqa (#71 )
* Update blip-vqa docstring (#72 )
* Refine flamingo docstring (#73 )
* [Feature]: BLIP2 VQA (#61 )
* [Feature]: VQA forward
* [Feature]: Reproduce accuracy
* [Fix]: Fix lint
* [Fix]: Add blank line
* minor fix
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* [Feature]: BLIP2 docstring (#74 )
* [Feature]: Add caption docstring
* [Feature]: Add docstring to blip2 vqa
* [Feature]: Add docstring to retrieval
* Update BLIP-2 metafile and README (#75 )
* [Feature]: Add readme and docstring
* Update blip2 results
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
* [Feature] BLIP Visual Grounding on MMPretrain Branch (#66 )
* blip grounding merge with mmpretrain
* remove commit
* blip grounding test and inference api
* refcoco dataset
* refcoco dataset refine config
* rebasing
* gitignore
* rebasing
* minor edit
* minor edit
* Update blip-vqa docstring (#72 )
* rebasing
* Revert "minor edit"
This reverts commit 639cec757c215e654625ed0979319e60f0be9044.
* blip grounding final
* precommit
* refine config
* refine config
* Update blip visual grounding
---------
Co-authored-by: Yiqin Wang 王逸钦 <wyq1217@outlook.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
* Update visual grounding metric
* Update OFA docstring, README and metafiles. (#76 )
* [Docs] Update installation docs and gradio demo docs. (#77 )
* Update OFA name
* Update Visual Grounding Visualizer
* Integrate accelerate support
* Fix imports.
* Fix timm backbone
* Update imports
* Update README
* Update circle ci
* Update flamingo config
* Add gradio demo README
* [Feature]: Add scienceqa (#1571 )
* [Feature]: Add scienceqa
* [Feature]: Change param name
* Update docs
* Update video
---------
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>
Co-authored-by: yingfhu <yingfhu@gmail.com>
Co-authored-by: Yuan Liu <30762564+YuanLiuuuuuu@users.noreply.github.com>
Co-authored-by: Yiqin Wang 王逸钦 <wyq1217@outlook.com>
Co-authored-by: Rongjie Li <limo97@163.com>
2023-05-19 16:50:04 +08:00
0826df8963
[Feature] Add ViT of SAM ( #1476 )
...
* add vit of sam
* update
* update
* add ut
* update ut
* remove num_classes
* support dynamic input
* add ut
* add comments
* update ut
2023-04-13 17:03:28 +08:00
1ee9bbe050
[Docs] Update links ( #1457 )
...
* update links
* update readtherdocs
* update
* update
* fix lint
* update
* update
* update
* update cov branch
* update
* update
* update
2023-04-06 20:58:52 +08:00
6cedce234e
[Refactor] Update dev scripts to be compatible with selfsup tasks. ( #1412 )
...
* [Refactor] Update dev scripts to be compatible with selfsup tasks.
* Fix some missing fields in config files.
* Set maximum number of gpus for local training.
* Update README files
* Update according to comments.
2023-03-20 14:30:57 +08:00
3472ee5d2c
[Feature] Implememnt the universal visualizer for multiple task. ( #1404 )
...
* [Feature] Implememnt the universal visualizer for multiple task.
* Update tools
* Improve according to comments.
* Fix tools docs
* Add --test-cfg option and set default collate function.
2023-03-09 11:36:54 +08:00
08dc8c75d3
[Refactor] Add selfsup algorithms. ( #1389 )
...
* remove basehead
* add moco series
* add byol simclr simsiam
* add ut
* update configs
* add simsiam hook
* add and refactor beit
* update ut
* add cae
* update extract_feat
* refactor cae
* add mae
* refactor data preprocessor
* update heads
* add maskfeat
* add milan
* add simmim
* add mixmim
* fix lint
* fix ut
* fix lint
* add eva
* add densecl
* add barlowtwins
* add swav
* fix lint
* update readtherdocs rst
* update docs
* update
* Decrease UT memory usage
* Fix docstring
* update DALLEEncoder
* Update model docs
* refactor dalle encoder
* update docstring
* fix ut
* fix config error
* add val_cfg and test_cfg
* refactor clip generator
* fix lint
* pass check
* fix ut
* add lars
* update type of BEiT in configs
* Use MMEngine style momentum in EMA.
* apply mmpretrain solarize
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-03-06 16:53:15 +08:00
dda3d6565b
[Docs] Update generate_readme.py and readme files. ( #1388 )
...
* Update generate_readme.py and readme files.
* Update reamde
* Update docs
* update metafile
* update simmim readme
* update
* update mae
* fix lint
* update mocov2
* update readme pic
* fix lint
* Fix mmcls download links.
* Fix Chinese docs.
* Decrease readthedocs requirements.
---------
Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-03-02 13:29:07 +08:00
89000c10eb
[Refactor] Refactor configs and metafile ( #1369 )
...
* update base datasets
* update base
* update barlowtwins
* update with new convention
* update
* update
* update
* add schedule
* add densecl
* add eva
* add mae
* add maskfeat
* add milan and mixmim
* add moco
* add swav simclr
* add simmim and simsiam
* refine
* update
* add to model index
* update config inheritance
* fix error in metafile
* Update pre-commit and metafile check script
* update metafile
* fix name error
* Fix classification model name and config name
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-02-23 11:17:16 +08:00
0979e78573
Rename the package name to `mmpretrain`.
2023-02-17 15:20:55 +08:00
8352951f3d
[Feature] Support XCiT Backbone. ( #1305 )
...
* update model file
* Update XCiT implementation and configs.
* Update metafiles
* Update metafile
* Fix floor divide
* Imporve memory usage
---------
Co-authored-by: qingtian <459291290@qq.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-02-15 10:32:35 +08:00
6b9e2b55dd
[Feature] Support LeViT backbone. ( #1238 )
...
* 网络搭建完成、能正常推理
* 网络搭建完成、能正常推理
* 网络搭建完成、能正常推理
* 添加了模型转换未验证，配置文件 但有无法运行
* 模型转换、结构验证完成，可以推理出正确答案
* 推理精度与原论文一致 已完成转化
* 三个方法改为class 暂存
* 完成推理精度对齐 误差0.04
* 暂时使用的levit2mmcls
* 训练跑通，训练相关参数未对齐
* '训练相关参数对齐'参数'
* '修复训练时验证导致模型结构改变无法复原问题'
* '修复训练时验证导致模型结构改变无法复原问题'
* '添加mixup和labelsmooth'
* '配置文件补齐'
* 添加模型转换
* 添加meta文件
* 添加meta文件
* 删除demo.py测试文件
* 添加模型README文件
* docs文件回滚
* model-index删除末行空格
* 更新模型metafile
* 更新metafile
* 更新metafile
* 更新README和metafile
* 更新模型README
* 更新模型metafile
* Delete the model class and get_LeViT_model methods in the mmcls.models.backone.levit file
* Change the class name to Google Code Style
* use arch to provide default architectures
* use nn.Conv2d
* mmcv.cnn.fuse_conv_bn
* modify some details
* remove down_ops from the architectures.
* remove init_weight function
* Modify ambiguous variable names
* Change the drop_path in config to drop_path_rate
* Add unit test
* remove train function
* add unit test
* modify nn.norm1d to build_norm_layer
* update metafile and readme
* Update configs and LeViT implementations.
* Update README.
* Add docstring and update unit tests.
* Revert irrelative modification.
* Fix unit tests
* minor fix
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-01-17 17:43:42 +08:00
c98dc4555c
[Feature] Support VIG Backbone. ( #1304 )
...
* 添加vig源文件
* 某些模块修改到mmcls风格
* 修改到mmcls风格
* 修改
* 添加VIG模型及源文件
* update model file
* update model file and config
* change class name and some variable name
* change class name and some variable name
* update
* update
* change nn.BatchNorm to mmcv.cnn.build_norm_layer
* update
* change nn.Seq to mmcls
* change backbone to stage_blocks
* add vig_head
* update
* update config file
* update
* add readme and metafile
* update model-index.yml
* update model file
* rename config file and add docstring
* variable rename
* update readme and metafile
* update readme
* update
* Update VIG backbone implementation and docs.
* Fix configs.
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-01-17 16:55:56 +08:00
aa53f7790c
[Tool] Add metafile fill and validation tools. ( #1297 )
...
* [Tool] Add metafile fill and validation tools.
* Fix pre-commit hooks and update fill tool.
* Update metafile
* Update fill tool
* Remove support no config.
* Add 3rdparty check.
2023-01-10 10:06:56 +08:00
060b0ed3b5
[Feature] Support ConvNeXt-V2 backbone. ( #1294 )
...
* [Feature] Support ConvNeXt-V2.
* Use registry of mmcls instead of mmengine.
* Add README.
* Add unit tests and docs.
2023-01-06 16:13:41 +08:00
0e4163668f
[Feature] Add some scripts for development. ( #1257 )
...
* [Feature] Add some scripts for development.
* Add `generate_readme.py`.
* Update according to comments
2022-12-19 13:53:13 +08:00
2535c1ecd7
[Feature] Support EVA. ( #1239 )
...
* add eva
* add eva
* add eva
* sklearn -> scikit-learn
* add large
* Update model names and links.
* Fix resize pos embed error when loading fp16 weight.
* Remove verbose configs.
Co-authored-by: mzr1996 <mzr1996@163.com>
2022-12-14 13:21:33 +08:00
d05cbbcf9b
[Feature] Support HorNet Backbone for dev1.x. ( #1094 )
...
* add hornet
* add hornet
* fix mixup config
* add optim cfgs
Co-authored-by: Ezra-Yu <18586273+Ezra-Yu@users.noreply.github.com>
2022-11-04 15:33:46 +08:00
23cad6a0e1
[Enhance] Support `--batch-size` option in the validation benchmark tool.
2022-10-08 11:14:35 +08:00
81f10ccbb7
[Feature] Support EdgeNeXt for dev-1.x. ( #1037 )
...
* [Feature] add EdgeNeXt for dev-1.x
* [Feature] add update
* Imporve EdgeNeXt
* Fix div error in low pytorch version
Co-authored-by: mzr1996 <mzr1996@163.com>
2022-09-21 13:27:04 +08:00
e9e2d48cb2
[Improve] Update benchmark scripts ( #1028 )
...
* Update train benchmark scripts
* Add `--cfg-options` for dev scripts and enhance `--range`.
* Fix bug of regex expression.
* Fix minor bugs
* Update ShuffleNet configs
* Update rsb-a1 configs and label smooth loss mode.
* Update inference dev scripts
* From `mmengine` instead of `mmcv` import fileio.
* Fix lint
* Update pre-commit hook
* Use `use_sigmoid` option instead of "bce" mode in label smooth loss.
2022-09-20 15:50:21 +08:00
1c82863449
fix lint
2022-07-18 11:11:13 +08:00
6ed3860ea6
refactor UTs
2022-07-18 11:11:13 +08:00
0f30c392a3
from core to engine
2022-07-18 11:11:13 +08:00
24bcf069f8
[Refactor] Refactor dev scripts
2022-07-18 11:11:13 +08:00
1f2f0dae5e
[Feature] Add speed benchmark script.
2022-07-18 10:53:28 +08:00
93a27c8324
[Feature] Add `PackClsInputs` and use `LoadImageFromFile`, `Resize` & `RandomFlip` in MMCV.
2022-07-18 10:53:28 +08:00
dc456a0c2c
[Feature] Support ConvNeXt ( #670 )
...
* Support ConvNeXt
* Add configs of ConvNeXt
* Update dev scripts
* Update docs.
* Use new style README
* Add unit tests.
* Update README
* Imporve according to comments
* Modify refers to timm.
* Imporve according to comments
2022-01-28 10:36:45 +08:00
c7c5ab7a04
[Dev] Update benchmark regression tools ( #556 )
...
* Update benchmark tools
* Fix AccessDeniedError
* Support to calculate flops and params with benchmark_valid.py
* Fix typo
2021-12-14 17:19:32 +08:00
7977dc8e2d
[Improvement] Rename config files according to the config name standard. ( #508 )
...
* Update tnt config
* Rename config files
* Update docs
* Update metafile in dev_scripts
* Fix some files
* Remove fp16 metafile and README.
* Fix names in metafiles.
2021-11-19 14:20:35 +08:00
08bf04e5ee
[Fix] Fix bug in `1-benchmark_valid.py` if checkpoint_root is None. ( #489 )
2021-10-25 12:01:03 +08:00
63a2211315
[Enhance] Add benchmark regression tools ( #447 )
2021-10-13 17:01:37 +08:00
Yixiao Fang
fanqiNO1
Ma Zerun
QINGTIAN
aso538
szwlh-c
takuoko
Songyang Zhang
Ezra-Yu