Commit Graph

28 Commits (307424b6f997beb2dc7f4951851896f14520831e)

Author SHA1 Message Date
zhangbo9674 558f03d684 refine code 2021-12-21 06:30:13 +00:00
zhangbo9674 28061f537c refine optimizer init logice 2021-12-21 06:28:13 +00:00
zhangbo9674 b54ee04491 Accelerate dynamic graph amp training 2021-12-20 06:36:56 +00:00
gaotingquan 7dcb2d4fd0 fix: raise exception
raise exception about using no_weight_decay of AdamW in static graph
2021-09-30 10:48:36 +00:00
gaotingquan c7aeec28e2 fix: support static graph 2021-09-30 06:57:17 +00:00
Tingquan Gao f91bc7ba0b
perf: add parameter validation (#1249)
When using warm up, the total epoch num must be greater than warm up epoch num. Otherwise,
there will be raising warning and warm up epoch num will be set to total epoch num.
2021-09-22 14:35:37 +08:00
cuicheng01 ba9b708acb
Merge pull request #1174 from TingquanGao/dev/add_adamw
feat: add AdamW
2021-09-17 18:53:18 +08:00
gaotingquan 94433634c0 fix: fix Linear & support warmup start lr & support Cosine eta_min
Support setting warmup start lr and eta_min in Cosine.
Fix bug that Linear can not decay to end_lr when setting warmup.
2021-09-17 18:41:55 +08:00
gaotingquan 079434dc5f feat: add AdamW 2021-09-01 08:07:48 +00:00
littletomatodonkey 0bc5b54d19
fix opt (#1048) 2021-07-15 15:19:41 +08:00
littletomatodonkey 9d9cd3719e
add static training (#1037)
* add static training

* fix typo

* add se fp16

* rm note

* fix loader

* fix cfg
2021-07-15 10:30:07 +08:00
littletomatodonkey 2e6dfa4433
fix logger (#840)
* fix logger
* fix trainer for int64 on windows
2021-06-15 14:11:50 +08:00
dongshuilong 452f532121 add CompCars train and fix bugs 2021-06-03 11:00:47 +08:00
littletomatodonkey 487c797230
fix optimizer builder (#751) 2021-05-28 10:39:51 +08:00
littletomatodonkey dd79f81fd7
[WIP]add arch init (#744)
* polish trainer
2021-05-27 18:41:44 +08:00
huangxu96 4e43ec6995 new usage of amp training. (#564)
* new usage of amp training.

* change the usage of amp and pure fp16 training.

* modified code as reviews
2021-02-26 09:25:54 +00:00
littletomatodonkey 6a5f4626d7
add static running in dygraph (#399)
* add static running in dygraph
2020-11-18 09:48:56 +08:00
littletomatodonkey 7ef474169d
polish api to Paddle2.0-rc (#346)
polish codes and docs to adapt Paddle2.0-rc
2020-10-30 00:20:48 +08:00
littletomatodonkey 4773a2177e fix opt 2020-09-17 13:24:33 +00:00
littletomatodonkey b8a7d186d7 fix optimizer and regularizer 2020-09-15 09:43:19 +00:00
littletomatodonkey a43aac3250 fix optimizer 2020-09-03 08:39:14 +00:00
littletomatodonkey 0a3825c5ea support warmup for cosine and expo decay 2020-08-30 14:34:39 +00:00
WuHaobo 5588734626
Merge branch 'dygraph' into dynamic 2020-06-09 08:19:20 +08:00
WuHaobo ed2f71ca68 dygraph optimizer 2020-06-07 15:39:26 +08:00
shippingwang bb622b24ed fix bugs 2020-06-04 04:07:38 +00:00
shippingwang 4ccfca291b add autoargument 2020-05-06 11:17:39 +00:00
WuHaobo fe7274bc35 be compatible with py3 2020-04-14 12:25:08 +08:00
WuHaobo 9f39da8859 Init PaddleClas 2020-04-09 02:16:30 +08:00