mirrors
/
mmpretrain
mirror of https://github.com/open-mmlab/mmpretrain.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update schedule.md

pull/559/head
Ma Zerun 2021-11-22 14:17:26 +08:00 committed by GitHub
parent a55324c453
commit 23de5cccf9
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs/tutorials/schedule.md
View File

@ -172,8 +172,8 @@ We provide some examples here and more usages refer to [DefaultOptimizerConstruc
```python
paramwise_cfg = dict(
custom_keys={
'.backbone.cls_token': dict(decay_mult=0.0),
'.backbone.pos_embed': dict(decay_mult=0.0)
'backbone.cls_token': dict(decay_mult=0.0),
'backbone.pos_embed': dict(decay_mult=0.0)
})
optimizer = dict(
@ -192,7 +192,7 @@ We provide some examples here and more usages refer to [DefaultOptimizerConstruc
weight_decay=1e-4,
# 'lr' for backbone and 'weight_decay' are 0.1 * lr and 0.9 * weight_decay
paramwise_cfg=dict(
custom_keys={'.backbone': dict(lr_mult=0.1, decay_mult=0.9)}))
custom_keys={'backbone': dict(lr_mult=0.1, decay_mult=0.9)}))
```
## Gradient clipping and gradient accumulation