Commit Graph

3 Commits (3b4f5f4dfcabd3abc143d5859d54ce3ec8be5d10)

Author SHA1 Message Date
huangxu96 4e43ec6995 new usage of amp training. (#564)
* new usage of amp training.

* change the usage of amp and pure fp16 training.

* modified code as reviews
2021-02-26 09:25:54 +00:00
huangxu96 dc3020ab4a
support fp16 training (#435)
* support fp16 training

* Use compiled training program

* Change timing ips.

* Use dali

* add pure fp16 training

* fix a bug, which will not use fuse pass using pure fp16 training.

* modify code as review

* modify loss, so that it will use different loss when using pure fp16 training.

* remove some fluid API

* add static optimizer.
2020-12-11 11:04:51 +08:00
Tingquan Gao 2b77c71459
Support DALI (#442) 2020-12-02 22:06:23 +08:00