zengyi
c6e8dcd209
[Feature] Add BYOT Distillation ( #232 )
...
* byot connector & distiller
* fix config
* fix connector
* tmpsave
* add byot & kdsoftce loss
* update dev-1.x
* fx wsld
* Update README.md
* Update README.md
* fix md
* add ut & REQUIRE REVIEW part
* fix md
* add SelfDistillValLoop UT
* fix comments
* fix comments v2
* fix comments v3
* add connector_idx=None to ConfigurableDistiller.get_record()
Co-authored-by: zengyi.vendor <zengyi.vendor@sensetime.com>
2022-08-22 14:08:02 +08:00
spynccat
a1937fd5a6
[Feature] Add Decoupled KD Loss ( #222 )
...
* add DKDLoss, config
* linting
* linting
* reset default reduction
* dkd ut
* Update decoupled_kd.py
* Update decoupled_kd.py
* Update decoupled_kd.py
* fix commit
* fix readme
* fix comments
* linting comment
* rename loss params
* fix docstring
* Update decoupled_kd.py
* fix gt from config
* merge fix
* fix ut & wsld
* Update README.md
* Update README.md
* add Acknowledgement
* Update README.md
* Update README.md
* Update README.md
* Update README.md
* fix readme style
* fix md
Co-authored-by: zengyi.vendor <zengyi.vendor@sensetime.com>
2022-08-15 14:59:24 +08:00
zhongyu zhang
e88e92cac4
[Feature] Add Activation Boundaries Loss ( #214 )
...
* 1.Add ABLoss and its config, readme and pipeline image. 2.Merge all connectors in general_connector into convconnector.
* 1.Improve convconnector to convmoduleconnecotr which aligns with mmcv. 2.Revise UT of test_connector. 3.Revise config of fitnet and abloss. 4.Revise mmcls import of darts_subnet_head to align with the newest mmcls-dev-1.x.
* 1.Simplify ConvModuleConncetor by ConvModule.
Co-authored-by: zhangzhongyu.vendor < zhangzhongyu.vendor@sensetime.com>
2022-08-05 14:14:47 +08:00
wilxy
a94aaba986
[Feature] Add connector components and FitNet ( #212 )
...
* Fix spelling mistakes
* 1.Rename general connectors. 2.Replace nn.conv2 to build_conv_layer, replace nn.bn to build_norm_layer.
* 1. Rename function init_parameters to init_weights in SingleConvConnector to realize automatically invocation.
* 1. Add norm_cfg in config and general_connector
* 1.Move calculate_student_loss to distillation algorithm. 2.Move mmrazor.models.connector to mmrazor.models.architectures. 3.Merge stu_connectors and tea_connectors into connectors, and call connectors by their connector_name.
* 1.Replace connector_name to connector in record_info. 2.Add assert that each connector must be in connectors.
Co-authored-by: zhangzhongyu.vendor < zhangzhongyu.vendor@sensetime.com>
2022-07-28 19:17:42 +08:00
pppppM
49f1bee45b
Bump version to v0.3.0 ( #135 )
...
* [Feature] Add function to meet mmdeploy support (#102 )
* add init_model function for mmdeploy
* fix lint
* add unittest for init_xxx_model
* fix lint
* mv test_inference.py to test_apis directory
* [Feature] Add function to meet mmdeploy support (#102 )
* add init_model function for mmdeploy
* fix lint
* add unittest for init_xxx_model
* fix lint
* mv test_inference.py to test_apis directory
* [Refactor] Delete redundant `set_random_seed` function (#104 )
* refactor set_random_seed
* add unittests
* fix unittests error
* fix lint
* avoid bc breaking
* [Feature] Add diff seeds to diff ranks and set torch seed in worker_init_fn (#113 )
* add init_random_seed
* Set diff seed to diff workers
* [Feature] Add multi machine dist_train (#114 )
* support multi nodes
* update training doc
* fix lints
* remove fixed seed
* fix ddp wrapper registry (#128 )
* [Docs] Add brief installation steps in README(_zh-CN).md (#121 )
* Add brief installation
* add brief installtion ref to mmediting pr#816
Co-authored-by: caoweihan <caoweihan@sensetime.com>
* [BUG]Fix bugs in pruner (#126 )
* fix bugs in pruner when pruning models with shared modules
* pruner can trace models with dilation conv2d
* fix deploy_subnet
* fix add_pruning_attrs
* fix bugs in modify_forward
* fix lint
* fix StructurePruner
* test tracing models with shared modules
Co-authored-by: caoweihan <caoweihan@sensetime.com>
* [Docs]Add some more details to docs (#133 )
* add docs for dataset
* add cfg-options for distillation
* fix docs
Co-authored-by: caoweihan <caoweihan@sensetime.com>
* reset norm running status after prepare_from_supernet (#81 )
* [Improvement]Sync train api (#115 )
Co-authored-by: caoweihan <caoweihan@sensetime.com>
* [Feature]Support Relational Knowledge Distillation (#127 )
* add rkd
* add rkd pytest
* add rkd configs
* fix readme
* fix rkd
* split rkd loss to distance-wise and angle-wise losses
* rename rkd losses
* add rkd metaflie
* add rkd related links
* rename rkd metafile and add to model index
* delete cifar100
Co-authored-by: caoweihan <caoweihan@sensetime.com>
Co-authored-by: pppppM <gjf_mail@126.com>
Co-authored-by: qiufeng <44188071+wutongshenqiu@users.noreply.github.com>
Co-authored-by: wutongshenqiu <690364065@qq.com>
Co-authored-by: whcao <41630003+HIT-cwh@users.noreply.github.com>
Co-authored-by: caoweihan <caoweihan@sensetime.com>
2022-04-02 19:30:50 +08:00
qiufeng
b04c84664b
update docs ( #12 )
...
Co-authored-by: qiufeng <qiufeng3217@gmail.com>
2021-12-23 10:35:32 +08:00
qiufeng
6daeef4170
[Docs] Add Docs ( #6 )
...
* add docs
* fix known_third_party
Co-authored-by: qiufeng <qiufeng3217@gmail.com>
2021-12-23 09:51:48 +08:00
