Commit Graph

936 Commits (fa53174fd9a2bad710e4049fe59ae90b26fe24a9)
 

Author SHA1 Message Date
Yuan Liu fa53174fd9
[Feature]: Add MFF ()
* [Feature]: Add MFF

* [Feature]: Add mff linear prob

* [Feature]: Add ft

* [Fix]: Update docstring

* [Feature]: Update out_indices

* [Feature]: Add prefix to ft

* [Feature]: Add README

* [Feature]: Update readme

* [Feature]: Update README

* [Feature]: Add metafile

* [Feature]: Update README

* [Fix]: Fix lint

* [Feature]: Add UT

* [Feature]: Update paper link
2023-08-08 16:01:07 +08:00
Zeyuan 2fb52eefdc
[CodeCamp2023-339] New Version of `config` Adapting Vision Transformer Algorithm ()
* add old config

* add old config

* add old config

* renew vit-base-p16_64xb64_in1k.py

* rename

* finish vit_base_p16_64xb64_in1k_384px.py

* finish vit_base_p32_64xb64_in1k.py and 384px

* finish 4 vit_large*.py

* finish vit_base_p16_32xb128_mae_in1k.py

* add vit_base_p16_4xb544_ipu_in1k.py

* modify data_root

* using  to modify cfg

* pre-commit check

* ignore ipu

* keep other files no change

* remove redefinition

* only keep vit_base_p16.py

* move init_cfg into model.update
2023-08-02 10:06:08 +08:00
Yike Yuan 340d187765
Support Infographic VQA dataset and ANLS metric. () 2023-08-01 16:22:34 +08:00
Yike Yuan 4f2f3752d9
Support IconQA dataset. () 2023-08-01 16:14:40 +08:00
Yixiao Fang 5c71eba13d
Bump version to 1.0.1 ()
* bump version to 1.0.1

* update changelog

* update readme

* Update changelog.md

* update requirements

---------

Co-authored-by: Ma Zerun <mzr1996@163.com>
2023-07-31 17:08:05 +08:00
fangyixiao18 58a2243d99 Merge branch 'main' into dev 2023-07-28 15:35:55 +08:00
Yixiao Fang 1f99279657
[Fix] Fix dict update in minigpt4. () 2023-07-28 15:30:30 +08:00
Yixiao Fang 0b96dcaa67
[Enhance] Add init_cfg with type='pretrained' to downstream tasks. () 2023-07-28 15:28:29 +08:00
Yixiao Fang b1cd05caf2
[Enhance] Set 'is_init' in some multimodal methods ()
* update is_init of multimodal

* Update minigpt4.py

---------

Co-authored-by: Ma Zerun <mzr1996@163.com>
2023-07-28 15:28:07 +08:00
marouane amzil e7fc25cf64
[Fix] Fix nested predict for multi-task prediction. ()
* fix: multi task predict

* change the loop

---------

Co-authored-by: Pierre Colle <piercus@gmail.com>
2023-07-28 13:44:12 +08:00
Yinlei Sun c5248b17b7
[Enhance] Adapt test cases on Ascend NPU. () 2023-07-28 13:39:38 +08:00
Nripesh Niketan 4d1dbafaa2
[Enhance] Add GPU Acceleration Apple silicon mac ()
* Add GPU Acceleration Apple silicon mac

* lint fix

* Update launch.py

* Use  to refactor the device selection.

* Update launch.py

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-07-26 17:51:00 +08:00
liyl 2b8d8eecb2
[Fix] Fix the issue "GaussianBlur doesn't work" ()
* Fix issue 1711. GaussianBlur.

* Fix UT

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-07-25 11:25:32 +08:00
fanqiNO1 64c446d507
[Feature] Support LoRA. ()
* [Feature] Support LoRA

* [Feature] Support LoRA

* [Fix] Fix bugs

* [Refactor] Add copyright

* [Fix] Fix bugs

* [Enhancement] Add

* [Fix] Fix bugs

* [Fix] Fix bugs

* [Fix] Fix bugs

* [Fix] Fix bugs

* [Fix] Fix bugs

* [Docs] Update docstring

* [Docs] Update docstring

* [Refactor] Reformat with yapf

* [Docs] Update docstring

* [Refactor] Docformat

* [Refactor] Fix double-quote-string

* [Fix] fix pytorch version

* [Fix] isort

* [Fix] isort

* [Enhancement] Extend forward

* [Enhancement] Extend test

* [Fix] Fix targets

* [Enhancement] Extend LoRA to frozen models

* [Fix] Fix spelling

* [Fix] Override __getattr__

* [Fix] Add init_cfg

* [Enhancement] Add example config

* [Fix] Fix init_cfg

* [Enhancement] Add merging script

* [Fix] Remove init_cfg

* [Fix] Change lora key

* [Fix] Fix merge scripts

* [Fix] Fix merge scripts

* [Docs] Add docs

* [Fix] fix
2023-07-24 11:30:57 +08:00
mzr1996 60d780f99e Fix docs 2023-07-20 10:21:15 +08:00
BBC 569324b180
Just to correct a typo of 'target' () 2023-07-14 16:16:35 +08:00
Fabien Merceron PRL db395d35b1
fix_freeze_without_cls_token_vit () 2023-07-14 15:43:19 +08:00
fanqiNO1 465b6bdeec
[Refactor] Fix spelling () 2023-07-13 15:38:58 +08:00
fanqiNO1 5c43d3ef42
[Refactor] BEiT refactor ()
* [Refactor] BEiT refactor

* [Fix] Fix arch zoo

* [Fix] Fix arch zoo

* [Fix] Fix freeze stages

* [Fix] Fix freeze ln2

* [Fix] Fix freezing vit ln2
2023-07-11 15:49:41 +08:00
Ezra-Yu 78d0ddc852
[Fix] Fix RandomCrop bug () 2023-07-11 10:18:08 +08:00
Yixiao Fang ae7a7b7560
Bump version to 1.0.0 ()
* bump version to 1.0.0

* update

* update

* fix lint

* update

* update

* update changelog

* update
2023-07-05 11:51:12 +08:00
liweiwp 0d80ab4650
[Docs] fix doc typos ()
* fix doc typos

* fix link

---------

Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>
2023-07-05 11:25:55 +08:00
Minato 8eaf8090e6
docs(advances_guides.modules): Correcting a typo ()
"涵盖了模型直接绝大多数的差异" -> "涵盖了模型之间绝大多数的差异"

English edition:
"backbone: usually a feature extraction network that records the major differences between models, e.g., ResNet, MobileNet."
2023-07-05 11:14:46 +08:00
Lamply 130751185c
[DOC] Fix typo in docs/*/migration.md ()
* Update migration.md

* Update migration.md
2023-07-05 11:12:25 +08:00
fanqiNO1 7cbfb36c14
[Refactor] Fix spelling ()
* [Refactor] Fix spelling

* [Refactor] Fix spelling

* [Refactor] Fix spelling

* [Refactor] Fix spelling
2023-07-05 11:07:43 +08:00
Wang Xiang feb0814b2f
[Feature] Transfer shape-bias tool from mmselfsup ()
* Transfer shape-bias tool from mmselfsup

* run shape-bias successfully, add CN docs

* fix unit test bug

* add shape_bias to index.rst in docs

* modified mistakes in shape-bias docs
2023-07-03 11:39:23 +08:00
Peng Lu 00030e3f7d
[Fix] refactor _prepare_pos_embed in ViT to fix bug in loading old checkpoint () 2023-07-03 11:36:44 +08:00
Ezra-Yu 59c077746f
[Feat] Download dataset by using MIM&OpenDataLab ()
* add dataset.index

* update preprocess shell

* update shell

* update docs

* update docs
2023-06-30 13:55:13 +08:00
Mashiro 8afad77a35
[Enhance] Update fsdp vit-huge and vit-large config ()
* Update fsdp vit-huge and vit-large config

* Update fsdp vit-huge and vit-large config

* rename
2023-06-30 11:15:18 +08:00
fanqiNO1 658db80089
[Enhancement] Support deepspeed with flexible runner ()
* [Feature] Support deepspeed with flexible runner

* [Fix] Reformat with yapf

* [Refacor] Rename configs

* [Fix] Reformat with yapf

* [Refactor] Remove unused keys

* [Refactor] Change the _base_ path

* [Refactor] Reformat
2023-06-29 10:16:27 +08:00
Wangbo Zhao(黑色枷锁) 68758db7a8
[Fix] freeze pre norm in vision transformer. () 2023-06-28 17:00:27 +08:00
Yixiao Fang 10685fc81c
[Refactor] Replace if '_base_' with read_base(). () 2023-06-28 16:57:18 +08:00
Yixiao Fang 70ff2abbf7
[Refactor] Refactor _prepare_pos_embed in ViT ()
* deal with cls_token

* Update implement

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-06-20 17:37:08 +08:00
Yixiao Fang d4a6dfa00a
Add benchmark options ()
* update dev_scripts

* update metafile

* update multimodal floating range

* fix lint

* update

* update

* fix lint

* Update metric map

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-06-20 14:18:57 +08:00
Ma Zerun 7d850dfadd
[Improve] Update Otter and LLaVA docs and config. () 2023-06-19 20:16:13 +08:00
mzr1996 dbef2b41c6 [Fix] Align COCO dataset format. 2023-06-19 07:24:07 +00:00
Mashiro d6056af2b8
[Fix][New_config] Fix demo bug ()
* Fix demo

* Update implement

---------

Co-authored-by: mzr1996 <mzr1996@163.com>
2023-06-19 15:15:28 +08:00
Yiqin Wang 王逸钦 6d7fe91a98
[Feature] Support Flickr30k Retrieval dataset ()
* format

* remove abs path

* init add flickr30k caption

* remove abs dir

* update blip readme

* add convert sscripts

* minor

* minor
2023-06-19 15:15:03 +08:00
Yixiao Fang a1cfe888e2
[Feature] Support SparK. ()
* add spark configs

* fix configs

* remove repeat aug

* add module codes

* support lr layer decay of resnet

* update

* fix lint

* add metafile and readme

* fix lint

* add models and logs

* refactor codes

* fix lint

* update model rst

* update name

* add docstring

* add ut

* fix lint

---------

Co-authored-by: Ma Zerun <mzr1996@163.com>
2023-06-19 11:27:50 +08:00
Ma Zerun bfd49b0d52
[Feature] Support LLaVA () 2023-06-17 16:05:52 +08:00
Ma Zerun e69bace03f
[Feature] Support otter ()
* [Feature] Support Otter

* Update docs
2023-06-17 16:03:21 +08:00
Yixiao Fang 9d3fc43073
[Feature] Support MiniGPT-4 ()
* support inference of MiniGPT-4

* refine codes

* update metafile, readme and docs

* fix typo

* fix lint

* add ckpt load hook
2023-06-16 22:50:34 +08:00
Yike Yuan a673b048a5
[Feature] Add support for VizWiz dataset. ()
* add vizwiz

* update dataset

* [Fix] Build img_path in data_sample.

* Fix isort.

---------

Co-authored-by: ZhangYuanhan-AI <yuanhan002@ntu.edu.sg>
2023-06-16 17:16:17 +08:00
Yixiao Fang aac398a83f
[Feature] Support new configs. ()
* [Feature] Support new configs ()

* add new config of mae and simclr

* update

* update setup.cfg

* update eva

* update

* update new config

* Add new config

* remove __init__.py

* 1. remove ; 2. remove mmpretrain/configs/_base_/models/convnext

* remove model_wrapper_cfg and add out type

* Add comment for setting default_scope to NOne

* update if '_base_' order

* update

* revert changes

---------

Co-authored-by: fangyixiao18 <fangyx18@hotmail.com>

* Add warn at the head of new config files

---------

Co-authored-by: Mashiro <57566630+HAOCHENYE@users.noreply.github.com>
Co-authored-by: mzr1996 <mzr1996@163.com>
2023-06-16 16:54:45 +08:00
Ezra-Yu 93e0f107c4
[Fix] Fix bug loading IN1k dataset. () 2023-06-16 15:35:27 +08:00
Yike Yuan 7581b76233
[Feature] Add support for vsr dataset ()
* add VSR dataset

* [Fix] Modify example and load gt_answer as string.

---------

Co-authored-by: ZhangYuanhan-AI <yuanhan002@ntu.edu.sg>
2023-06-15 19:17:02 +08:00
zzc98 53648baca5
[Fix] fix sam bug () 2023-06-15 10:10:51 +08:00
zzc98 3eaf719a64
[Feature] Add InternImage Classification project ()
* [Feature] add internimage project

* [Feature] add internimage project

* update license

* [Feature] add internimage project

* [Feature] add internimage project

* [Feature] add internimage project

* [Feature] add internimage project

* [Feature] add internimage project

* [Feature] add internimage project

* update license

* [Feature] add internimage project

* [Feature] add internimage project

* [Feature] add internimage project

* [Feature] add internimage project

* update internimage configs

* support internimage project

* support internimage project

* support internimage project

* internimage
2023-06-13 19:11:54 +08:00
Hubert 8e9e880601
[Feat] Add download link for coco caption and retrieval annotations. ()
* [Feat] Add download link for coco caption and retrieval annotations.

* minor fix
2023-06-13 10:29:54 +08:00
Yiqin Wang 王逸钦 bb415b91be
[Feature] Support OCR-VQA dataset ()
* support ocrvqa dataset

* minor

* remove abs path

* refine README
2023-06-13 10:28:45 +08:00