2 Commits

Author SHA1 Message Date
takuoko
d510b8b174
[Feature] Support LayerScale in FFN (#2451)
* add layer scale

* add layer scale

* add layer scale

* Update mmcv/cnn/bricks/transformer.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmcv/cnn/bricks/transformer.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* add layer scale

* move LayerScale

* add layer_scale_init_value

* add typehint

* fix for tensor with any dim

* fix layer scale rule

* fix layer scale rule

* fix test

* add docs

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-12-11 17:58:19 +08:00
Zaida Zhou
264e170c23
[Docs] Refactor the api structures of docs (#2254)
* [Docs] Refactor the api structures of docs

* refine api structures of docs

* Update zh_cn

* update branch
2022-09-25 21:51:36 +08:00