6847d20d57
[Feature] Support multiple multi-modal algorithms and inferencers. ( #1561 )
...
* [Feat] Migrate blip caption to mmpretrain. (#50 )
* Migrate blip caption to mmpretrain
* minor fix
* support train
* [Feature] Support OFA caption task. (#51 )
* [Feature] Support OFA caption task.
* Remove duplicated files.
* [Feature] Support OFA vqa task. (#58 )
* [Feature] Support OFA vqa task.
* Fix lint.
* [Feat] Add BLIP retrieval to mmpretrain. (#55 )
* init
* minor fix for train
* fix according to comments
* refactor
* Update Blip retrieval. (#62 )
* [Feature] Support OFA visual grounding task. (#59 )
* [Feature] Support OFA visual grounding task.
* minor add TODO
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* [Feat] Add flamingos coco caption and vqa. (#60 )
* first init
* init flamingo coco
* add vqa
* minor fix
* remove unnecessary modules
* Update config
* Use `ApplyToList`.
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
* [Feature]: BLIP2 coco retrieval (#53 )
* [Feature]: Add blip2 retriever
* [Feature]: Add blip2 all modules
* [Feature]: Refine model
* [Feature]: x1
* [Feature]: Runnable coco ret
* [Feature]: Runnable version
* [Feature]: Fix lint
* [Fix]: Fix lint
* [Feature]: Use 364 img size
* [Feature]: Refactor blip2
* [Fix]: Fix lint
* refactor files
* minor fix
* minor fix
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* Remove
* fix blip caption inputs (#68 )
* [Feat] Add BLIP NLVR support. (#67 )
* first init
* init flamingo coco
* add vqa
* add nlvr
* refactor nlvr
* minor fix
* minor fix
* Update dataset
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
* [Feature]: BLIP2 Caption (#70 )
* [Feature]: Add language model
* [Feature]: blip2 caption forward
* [Feature]: Reproduce the results
* [Feature]: Refactor caption
* refine config
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* [Feat] Migrate BLIP VQA to mmpretrain (#69 )
* reformat
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* change
* refactor code
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* Update RefCOCO dataset
* [Fix] fix lint
* [Feature] Implement inference APIs for multi-modal tasks. (#65 )
* [Feature] Implement inference APIs for multi-modal tasks.
* [Project] Add gradio demo.
* [Improve] Update requirements
* Update flamingo
* Update blip
* Add NLVR inferencer
* Update flamingo
* Update hugging face model register
* Update ofa vqa
* Update BLIP-vqa (#71 )
* Update blip-vqa docstring (#72 )
* Refine flamingo docstring (#73 )
* [Feature]: BLIP2 VQA (#61 )
* [Feature]: VQA forward
* [Feature]: Reproduce accuracy
* [Fix]: Fix lint
* [Fix]: Add blank line
* minor fix
---------
Co-authored-by: yingfhu <yingfhu@gmail.com>
* [Feature]: BLIP2 docstring (#74 )
* [Feature]: Add caption docstring
* [Feature]: Add docstring to blip2 vqa
* [Feature]: Add docstring to retrieval
* Update BLIP-2 metafile and README (#75 )
* [Feature]: Add readme and docstring
* Update blip2 results
---------
Co-authored-by: mzr1996 <mzr1996@163.com>
* [Feature] BLIP Visual Grounding on MMPretrain Branch (#66 )
* blip grounding merge with mmpretrain
* remove commit
* blip grounding test and inference api
* refcoco dataset
* refcoco dataset refine config
* rebasing
* gitignore
* rebasing
* minor edit
* minor edit
* Update blip-vqa docstring (#72 )
* rebasing
* Revert "minor edit"
This reverts commit 639cec757c215e654625ed0979319e60f0be9044.
* blip grounding final
* precommit
* refine config
* refine config
* Update blip visual grounding
---------
Co-authored-by: Yiqin Wang 王逸钦 <wyq1217@outlook.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
* Update visual grounding metric
* Update OFA docstring, README and metafiles. (#76 )
* [Docs] Update installation docs and gradio demo docs. (#77 )
* Update OFA name
* Update Visual Grounding Visualizer
* Integrate accelerate support
* Fix imports.
* Fix timm backbone
* Update imports
* Update README
* Update circle ci
* Update flamingo config
* Add gradio demo README
* [Feature]: Add scienceqa (#1571 )
* [Feature]: Add scienceqa
* [Feature]: Change param name
* Update docs
* Update video
---------
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>
Co-authored-by: yingfhu <yingfhu@gmail.com>
Co-authored-by: Yuan Liu <30762564+YuanLiuuuuuu@users.noreply.github.com>
Co-authored-by: Yiqin Wang 王逸钦 <wyq1217@outlook.com>
Co-authored-by: Rongjie Li <limo97@163.com>
2023-05-19 16:50:04 +08:00
79ddc0f874
[Refactor] Update CI and issue template ( #1463 )
...
* Update CI
* update issue template
* update
* update collect_env function
2023-04-07 14:29:41 +08:00
3a25b13eb3
[Fix] Update CI ( #1454 )
...
* update ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* update window ci
* ignore tests/test_tools.py
2023-04-06 10:52:08 +08:00
b017670e1b
[Improve] Use PyTorch official `scaled_dot_product_attention` to accelerate `MultiheadAttention`. ( #1434 )
...
* [Improve] Use PyTorch official `scaled_dot_product_attention` to accelerate `MultiheadAttention`.
* Support `--local-rank` and `--amp` option for new version PyTorch.
* Fix imports and UT.
2023-03-29 15:50:44 +08:00
04e15ab347
Update circle-CI
2023-03-20 14:55:08 +08:00
4f5b38f225
[Refactor] Update almost tools and add unit tests for these tools. ( #1418 )
...
* [Refactor] Update almost tools and add unit tests for these tools.
* Fix Windows UT.
2023-03-17 10:50:51 +08:00
4016f1348e
Fix CI
2023-02-17 15:33:16 +08:00
97c4ae8805
[Improve] Update registries of mmcls. ( #1306 )
...
* [Improve] Update registries of mmcls.
* Update according to comments
2023-01-11 15:20:51 +08:00
46af7d3ed2
[CI] Update CI to test PyTorch 1.13.0. ( #1260 )
2022-12-14 13:47:32 +08:00
542143cb41
[Feature] Add TIMM and HuggingFace wrappers to build classifiers from them directly. ( #1102 )
...
* [Feature] Add TIMM and HuggingFace wrappers to build classifiers from them directly.
* Support `with_cp` and add docstring.
* Add unit tests.
* Update CI.
* Update docs.
2022-11-10 14:56:19 +08:00
b9bb21738b
[CI] Skip timm unit tests with the minimum version PyTorch.
2022-10-08 16:07:52 +08:00
61e9d890a6
[CI] Update circle-ci and github workflow. ( #1018 )
...
* Add deploy workflow.
* [CI] Update circle-ci and github workflow.
* Fix windows CI
* Update unit tests to save memory
2022-09-13 11:46:15 +08:00
20f9ace5c5
[CI] Add Circle CI for mmcls 1.x. ( #970 )
...
* [CI] Add Circle CI for mmcls 1.x
* Fix circle-ci config
* Use `torch.cat` instead of `torch.hstack` to compat with PyTorch 1.6
* Compat the behavior of LongTensor in PyTorch 1.6
* Avoid random behavior in the unit test of Lighting
* Fix cuda ci
* Remove github workflow temporarily.
2022-08-22 15:02:08 +08:00
00700d570f
[CI] Use CircleCI to do unit tests. ( #567 )
...
* Add .circleci/config.yml
* Use new markdown lint
2021-11-30 14:22:02 +08:00
Ma Zerun
Yixiao Fang
Ezra-Yu