takuoko
|
d510b8b174
|
[Feature] Support LayerScale in FFN (#2451)
* add layer scale
* add layer scale
* add layer scale
* Update mmcv/cnn/bricks/transformer.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* Update mmcv/cnn/bricks/transformer.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
* add layer scale
* move LayerScale
* add layer_scale_init_value
* add typehint
* fix for tensor with any dim
* fix layer scale rule
* fix layer scale rule
* fix test
* add docs
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
|
2022-12-11 17:58:19 +08:00 |
|