Ma Zerun 357b0dfb36

[WIP] continue PR #784 (#1221) ...

* Add gradient cumulative optimizer

fixes #190

* Update optimizer.py

* Update optimizer.py

* fix loss scale improperly in last equivalent_iter

* Add `GradientCumulativeOptimizerHook` in `__init__.py`.

* Add docstring of `GradientCumulativeOptimizerHook`.

* Add type check, BN warning and resume warning. And fix typo, lint the
code.

* Add unit test

* Update docstring example.

* Change GradientCumulativeOptimizerHook `__init__` arguments.

* Add GradientCumulativeOptimzierHook unit tests with IterBasedRunner.

* Add GradientCumulativeFp16OptimizerHook.

* Add unit tests of GradientCumulativeFp16OptimizerHook

* Use '!=' instead of '>' to determine resume

Co-authored-by: Zhiyuan Chen <this@zyc.ai>

2021-08-23 11:18:36 +08:00

..

data

Support deprecation info in Config (#1275)

2021-08-23 10:36:37 +08:00

test_cnn

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00

test_image

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00

test_ops

[Improvement] Improve digit_version & use it for version_checking (#1185)

2021-07-23 21:03:33 +08:00

test_runner

[WIP] continue PR #784 (#1221)

2021-08-23 11:18:36 +08:00

test_utils

Support deprecation info in Config (#1275)

2021-08-23 10:36:37 +08:00

test_video

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00

test_arraymisc.py

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00

test_fileclient.py

…

test_fileio.py

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00

test_load_model_zoo.py

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00

test_parallel.py

[Fix] Fix unittest in pt1.9 (#1146)

2021-07-03 20:47:22 +08:00

test_visualization.py

[Docs] Add header for files (#1181)

2021-08-08 22:10:55 +08:00