Commit Graph

17 Commits (main)

Author SHA1 Message Date
Ezra-Yu 59c077746f
[Feat] Download dataset by using MIM&OpenDataLab (#1630)
* add dataset.index

* update preprocess shell

* update shell

* update docs

* update docs
2023-06-30 13:55:13 +08:00
Ma Zerun 6847d20d57
[Feature] Support multiple multi-modal algorithms and inferencers. (#1561)
* [Feat] Migrate blip caption to mmpretrain. (#50)

* Migrate blip caption to mmpretrain

* minor fix

* support train

* [Feature] Support OFA caption task. (#51)

* [Feature] Support OFA caption task.

* Remove duplicated files.

* [Feature] Support OFA vqa task. (#58)

* [Feature] Support OFA vqa task.

* Fix lint.

* [Feat] Add BLIP retrieval to mmpretrain. (#55)

* init

* minor fix for train

* fix according to comments

* refactor

* Update Blip retrieval. (#62)

* [Feature] Support OFA visual grounding task. (#59)

* [Feature] Support OFA visual grounding task.

* minor add TODO

---------

Co-authored-by: yingfhu <yingfhu@gmail.com>

* [Feat] Add flamingos coco caption and vqa. (#60)

* first init

* init flamingo coco

* add vqa

* minor fix

* remove unnecessary modules

* Update config

* Use `ApplyToList`.

---------

Co-authored-by: mzr1996 <mzr1996@163.com>

* [Feature]: BLIP2 coco retrieval  (#53)

* [Feature]: Add blip2 retriever

* [Feature]: Add blip2 all modules

* [Feature]: Refine model

* [Feature]: x1

* [Feature]: Runnable coco ret

* [Feature]: Runnable version

* [Feature]: Fix lint

* [Fix]: Fix lint

* [Feature]: Use 364 img size

* [Feature]: Refactor blip2

* [Fix]: Fix lint

* refactor files

* minor fix

* minor fix

---------

Co-authored-by: yingfhu <yingfhu@gmail.com>

* Remove

* fix blip caption inputs (#68)

* [Feat] Add BLIP NLVR support. (#67)

* first init

* init flamingo coco

* add vqa

* add nlvr

* refactor nlvr

* minor fix

* minor fix

* Update dataset

---------

Co-authored-by: mzr1996 <mzr1996@163.com>

* [Feature]: BLIP2 Caption (#70)

* [Feature]: Add language model

* [Feature]: blip2 caption forward

* [Feature]: Reproduce the results

* [Feature]: Refactor caption

* refine config

---------

Co-authored-by: yingfhu <yingfhu@gmail.com>

* [Feat] Migrate BLIP VQA to mmpretrain (#69)

* reformat

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* change

* refactor code

---------

Co-authored-by: yingfhu <yingfhu@gmail.com>

* Update RefCOCO dataset

* [Fix] fix lint

* [Feature] Implement inference APIs for multi-modal tasks. (#65)

* [Feature] Implement inference APIs for multi-modal tasks.

* [Project] Add gradio demo.

* [Improve] Update requirements

* Update flamingo

* Update blip

* Add NLVR inferencer

* Update flamingo

* Update hugging face model register

* Update ofa vqa

* Update BLIP-vqa (#71)

* Update blip-vqa docstring (#72)

* Refine flamingo docstring (#73)

* [Feature]: BLIP2 VQA (#61)

* [Feature]: VQA forward

* [Feature]: Reproduce accuracy

* [Fix]: Fix lint

* [Fix]: Add blank line

* minor fix

---------

Co-authored-by: yingfhu <yingfhu@gmail.com>

* [Feature]: BLIP2 docstring (#74)

* [Feature]: Add caption docstring

* [Feature]: Add docstring to blip2 vqa

* [Feature]: Add docstring to retrieval

* Update BLIP-2 metafile and README (#75)

* [Feature]: Add readme and docstring

* Update blip2 results

---------

Co-authored-by: mzr1996 <mzr1996@163.com>

* [Feature] BLIP Visual Grounding on MMPretrain Branch (#66)

* blip grounding merge with mmpretrain

* remove commit

* blip grounding test and inference api

* refcoco dataset

* refcoco dataset refine config

* rebasing

* gitignore

* rebasing

* minor edit

* minor edit

* Update blip-vqa docstring (#72)

* rebasing

* Revert "minor edit"

This reverts commit 639cec757c215e654625ed0979319e60f0be9044.

* blip grounding final

* precommit

* refine config

* refine config

* Update blip visual grounding

---------

Co-authored-by: Yiqin Wang 王逸钦 <wyq1217@outlook.com>
Co-authored-by: mzr1996 <mzr1996@163.com>

* Update visual grounding metric

* Update OFA docstring, README and metafiles. (#76)

* [Docs] Update installation docs and gradio demo docs. (#77)

* Update OFA name

* Update Visual Grounding Visualizer

* Integrate accelerate support

* Fix imports.

* Fix timm backbone

* Update imports

* Update README

* Update circle ci

* Update flamingo config

* Add gradio demo README

* [Feature]: Add scienceqa (#1571)

* [Feature]: Add scienceqa

* [Feature]: Change param name

* Update docs

* Update video

---------

Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>
Co-authored-by: yingfhu <yingfhu@gmail.com>
Co-authored-by: Yuan Liu <30762564+YuanLiuuuuuu@users.noreply.github.com>
Co-authored-by: Yiqin Wang 王逸钦 <wyq1217@outlook.com>
Co-authored-by: Rongjie Li <limo97@163.com>
2023-05-19 16:50:04 +08:00
Ma Zerun 414ba80274
[Refactor] Refactor APIs, add `ImageRetrievalInferencer` and `FeatureExtractor`. (#1380)
* [Refactor] Refactor APIs, add `ImageRetrievalInferencer` and `FeatureExtractor'.

* Update image retrieval

* Update FeatureExtractor

* Fix UT
2023-02-28 16:31:42 +08:00
mzr1996 0979e78573 Rename the package name to `mmpretrain`. 2023-02-17 15:20:55 +08:00
Ma Zerun 97c4ae8805
[Improve] Update registries of mmcls. (#1306)
* [Improve] Update registries of mmcls.

* Update according to comments
2023-01-11 15:20:51 +08:00
Ma Zerun d2e5054150
[Fix] Add mim to extras_require in setup.py. (#872) 2022-06-15 20:54:52 +08:00
Ma Zerun 28e3bc8fd9
[CI] Add Windows CI. (#708)
* Update workflow to add Windows CI

* Add some optional requirements to requirements/optional.txt

* Update setup.py

* Update PyTorch version in Windows CI

* Update CI and requirement

* Replace `tempfile.NamedTemporaryFile` to avoid unit test error on
Windows

* Update tests

* Update CI

* Add OpenCV installation

* Update CI
2022-02-28 10:06:08 +08:00
Ma Zerun a865d64208
[Refactor] Deprecate the support for "python setup.py test" (#646)
* Deprecate the support for "python setup.py test"

* Update requirements
2022-01-25 12:15:12 +08:00
Ma Zerun abd7001bd9
[Fix] Try to create a symbolic link, otherwise copy. (#580) 2021-12-08 18:08:14 +08:00
Ma Zerun 729c6c1192
[Docs] Add `CITATION.cff` (#428)
* Add CITATION.cff

* Fix typo in setup.py

* Change author in setup.py
2021-09-01 17:07:27 +08:00
Ma Zerun 5aa132a91c
[CI] Add PyTorch 1.9 and Python 3.9 build workflow, and remove some CI. (#422)
* Add PyTorch 1.9 build workflow, and remove some CI.

* Add Python 3.9 CI

* Show Python 3.9 support.
2021-09-01 11:06:00 +08:00
Ma Zerun 0f4cae4d3f
[Feature] Support mim (#376)
* Support mim extention

* Fix lint.

* Remove extra `demo` setting in mim related files.
2021-07-27 17:58:04 +08:00
LXXXXR 761c95925d
support mmcli (#232) 2021-05-01 22:24:16 +08:00
Y. Xiong f7a916f309
fix pypi release error (#64) 2020-10-11 00:26:34 +08:00
Y. Xiong d369645e23
bump version to 0.6.0 (#62)
* fix lint

* fix version path type

* del short_version

* setup: del ops; add python3.8

* del useless requirements

* setup: remove extra_requirements

* setup: totally remove build_requests

* setup: change to valid email
2020-10-11 00:12:04 +08:00
yl-1993 71e3b86ed3 add github action (manually squash) 2020-07-12 00:07:05 +08:00
chenkai a99e6eb10d init commit 2020-05-21 21:21:43 +08:00