mmcv/docs
takuoko d510b8b174
[Feature] Support LayerScale in FFN (#2451)
* add layer scale

* add layer scale

* add layer scale

* Update mmcv/cnn/bricks/transformer.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* Update mmcv/cnn/bricks/transformer.py

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* add layer scale

* move LayerScale

* add layer_scale_init_value

* add typehint

* fix for tensor with any dim

* fix layer scale rule

* fix layer scale rule

* fix test

* add docs

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
2022-12-11 17:58:19 +08:00
..
en [Feature] Support LayerScale in FFN (#2451) 2022-12-11 17:58:19 +08:00
zh_cn [Feature] Support LayerScale in FFN (#2451) 2022-12-11 17:58:19 +08:00