13 Commits

Author SHA1 Message Date
LKJacky
595849b912
refine sparse gpt, support multiple gpus with fsdp (#520)
* add mmrazor large

* update readme

* add fsdp for opt

* update

* update

* rename

* update args

* support fsdp

* refine

* refine

* refine

* refine

* fix out of memorry bug

---------

Co-authored-by: liukai <your_email@abc.example>
Co-authored-by: Your Name <you@example.com>
2023-04-23 17:03:01 +08:00
LKJacky
7acc046678
Add GroupFisher pruning algorithm. (#459)
* init

* support expand dwconv

* add tools

* init

* add import

* add configs

* add ut and fix bug

* update

* update finetune config

* update impl imports

* add deploy configs and result

* add _train_step

* detla_type -> normalization_type

* change img link

* add prune to config

* add json dump when GroupFisherSubModel init

* update prune config

* update finetune config

* update deploy config

* update prune config

* update readme

* mutable_cfg -> fix_subnet

* update readme

* impl -> implementations

* update script.sh

* rm gen_fake_cfg

* add Implementation to readme

* update docstring

* add finetune_lr to config

* update readme

* fix error in config

* update links

* update configs

* refine

* fix spell error

* add test to readme

* update README

* update readme

* update readme

* update cite format

* fix for ci

* update to pass ci

* update readme

---------

Co-authored-by: liukai <your_email@abc.example>
Co-authored-by: Your Name <you@example.com>
2023-02-20 14:29:42 +08:00
Yang Gao
a27952dbb1
[Improvement] Update NasMutator to build search_space in NAS (#426)
* update space_mixin

* update NAS algorithms with SpaceMixin

* update pruning algorithms with SpaceMixin

* fix ut

* fix comments

* revert _load_fix_subnet_by_mutator

* fix dcff test

* add ut for registry

* update autoslim_greedy_search

* fix repeat-mutables bug

* fix slice_weight in export_fix_subnet

* Update NasMutator:
1. unify mutators for NAS algorithms as the NasMutator;
2. regard ChannelMutator as pruning-specified;
3. remove value_mutators & module_mutators;
4. set GroupMixin only for NAS;
5. revert all changes in ChannelMutator.

* update NAS algorithms using NasMutator

* update channel mutator

* update one_shot_channel_mutator

* fix comments

* update UT for NasMutator

* fix isort version

* fix comments

---------

Co-authored-by: gaoyang07 <1546308416@qq.com>
Co-authored-by: liukai <your_email@abc.example>
2023-02-01 22:51:38 +08:00
qiufeng
99e7993376 Refactor backbone 2022-07-15 23:04:13 +08:00
pppppM
dee5352f92 [CI] Add mypy and mdformat 2022-07-15 23:04:10 +08:00
pppppM
2efe63e9a4 [CI] Add Gitlab CI 2022-07-15 23:02:57 +08:00
whcao
9db5fe5547
[Docs] Fix mdformat version to support python3.6 (#181)
* fix mdformat version to support python3.6

* fix readme
2022-06-15 19:20:15 +08:00
pppppM
b8daedf544
[Docs] Replace markdownlint with mdformat (#163)
* markdonwlint -> mdformat

* update mmcv min and max version

* fix README_zh-CN links
2022-05-31 16:21:53 +08:00
pppppM
c5a097b150
Add a new pre-commit-hook to automatically add a copyright (#96)
* Add a new pre-commit-hook to automatically add a copyright

* add check-algo-readme

Co-authored-by: qiufeng <44188071+wutongshenqiu@users.noreply.github.com>

* fix alg-readme lints

Co-authored-by: qiufeng <44188071+wutongshenqiu@users.noreply.github.com>
2022-03-02 20:29:28 +08:00
humu789
b319c1f553
[CI] update pre-commit-config (#93) 2022-02-23 19:31:18 +08:00
whcao
4121e58fcc
Upgrade isort in pre-commit hook (#70) 2022-02-10 10:02:02 +08:00
pppppM
40e25c0cbe
Prepare for open source (#23)
* update MMRazor description

* update Github action

* add Mircosoft copyright

* update requirements

* fix  a bug

* fix a typo
2021-12-23 12:35:51 +08:00
pppppM
ff858d26de first commit 2021-12-23 02:48:00 +08:00