52 Commits

Author	SHA1	Message	Date
HydrogenSulfate	43410aa852	update config, add amp eval for retrieval	2022-06-21 23:03:56 +08:00
HydrogenSulfate	790815f430	refine code and docs	2022-05-05 22:14:07 +08:00
HydrogenSulfate	16f910b451	add m1 and baseline config	2022-05-05 19:55:08 +08:00
HydrogenSulfate	0b1481402b	merge devevelop	2022-05-05 14:42:06 +08:00
littletomatodonkey	bb13f3c4f5	fix single card dist (#1889) ... * fix single card logit * fix distillation yaml files	2022-05-05 09:48:56 +08:00
HydrogenSulfate	6149e719b3	refine code	2022-04-25 14:14:20 +08:00
HydrogenSulfate	674447f63e	refine code	2022-04-25 11:25:44 +08:00
HydrogenSulfate	bc6e7f5cf5	update code	2022-04-22 15:26:05 +08:00
HydrogenSulfate	9dde9376fb	update code	2022-04-22 15:25:11 +08:00
HydrogenSulfate	74b4574367	Support for multiple components when build optimizer	2022-04-22 13:15:49 +08:00
HydrogenSulfate	17fd1bc2c0	refine code	2022-04-22 12:00:03 +08:00
HydrogenSulfate	0146af28b0	fix code bug	2022-04-21 17:11:07 +08:00
HydrogenSulfate	aa26a8c1d8	fix bug for static graph	2022-04-21 16:31:28 +08:00
HydrogenSulfate	dfd7749828	refine hard code	2022-04-21 14:37:00 +08:00
HydrogenSulfate	41e1a86caf	add center loss	2022-04-21 00:17:54 +08:00
HydrogenSulfate	15242df170	refine optimizer/__init__.py	2022-04-20 13:10:31 +08:00
HydrogenSulfate	80b8ca3f23	fix optimizer/init.py	2022-04-20 12:16:40 +08:00
HydrogenSulfate	3f117428da	fix code	2022-04-20 11:08:42 +08:00
HydrogenSulfate	3a1276d315	train_loss_func only used in train mode	2022-04-19 19:54:48 +08:00
HydrogenSulfate	24abea151a	support for multi optimizer case	2022-04-19 14:26:42 +08:00
HydrogenSulfate	af90cd7c59	update center loss config and related code	2022-04-12 13:07:53 +08:00
lubin	509f4d77e3	modify the cifar10 dataset format	2022-02-28 11:47:42 +00:00
lubin	cef3cb25d9	update optimizer and some comment	2022-02-28 08:02:51 +00:00
lubin	2507be1a51	add deephash configs and dch algorithm	2022-02-23 11:50:39 +00:00
zhangbo9674	558f03d684	refine code	2021-12-21 06:30:13 +00:00
zhangbo9674	28061f537c	refine optimizer init logice	2021-12-21 06:28:13 +00:00
zhangbo9674	b54ee04491	Accelerate dynamic graph amp training	2021-12-20 06:36:56 +00:00
gaotingquan	7dcb2d4fd0	fix: raise exception ... raise exception about using no_weight_decay of AdamW in static graph	2021-09-30 10:48:36 +00:00
gaotingquan	c7aeec28e2	fix: support static graph	2021-09-30 06:57:17 +00:00
Tingquan Gao	f91bc7ba0b	perf: add parameter validation (#1249) ... When using warm up, the total epoch num must be greater than warm up epoch num. Otherwise, there will be raising warning and warm up epoch num will be set to total epoch num.	2021-09-22 14:35:37 +08:00
cuicheng01	ba9b708acb	Merge pull request #1174 from TingquanGao/dev/add_adamw ... feat: add AdamW	2021-09-17 18:53:18 +08:00
gaotingquan	94433634c0	fix: fix Linear & support warmup start lr & support Cosine eta_min ... Support setting warmup start lr and eta_min in Cosine. Fix bug that Linear can not decay to end_lr when setting warmup.	2021-09-17 18:41:55 +08:00
gaotingquan	079434dc5f	feat: add AdamW	2021-09-01 08:07:48 +00:00
littletomatodonkey	0bc5b54d19	fix opt (#1048)	2021-07-15 15:19:41 +08:00
littletomatodonkey	9d9cd3719e	add static training (#1037) ... * add static training * fix typo * add se fp16 * rm note * fix loader * fix cfg	2021-07-15 10:30:07 +08:00
littletomatodonkey	2e6dfa4433	fix logger (#840) ... * fix logger * fix trainer for int64 on windows	2021-06-15 14:11:50 +08:00
dongshuilong	452f532121	add CompCars train and fix bugs	2021-06-03 11:00:47 +08:00
littletomatodonkey	487c797230	fix optimizer builder (#751)	2021-05-28 10:39:51 +08:00
littletomatodonkey	dd79f81fd7	[WIP]add arch init (#744) ... * polish trainer	2021-05-27 18:41:44 +08:00
huangxu96	4e43ec6995	new usage of amp training. (#564) ... * new usage of amp training. * change the usage of amp and pure fp16 training. * modified code as reviews	2021-02-26 09:25:54 +00:00
littletomatodonkey	6a5f4626d7	add static running in dygraph (#399) ... * add static running in dygraph	2020-11-18 09:48:56 +08:00
littletomatodonkey	7ef474169d	polish api to Paddle2.0-rc (#346) ... polish codes and docs to adapt Paddle2.0-rc	2020-10-30 00:20:48 +08:00
littletomatodonkey	4773a2177e	fix opt	2020-09-17 13:24:33 +00:00
littletomatodonkey	b8a7d186d7	fix optimizer and regularizer	2020-09-15 09:43:19 +00:00
littletomatodonkey	a43aac3250	fix optimizer	2020-09-03 08:39:14 +00:00
littletomatodonkey	0a3825c5ea	support warmup for cosine and expo decay	2020-08-30 14:34:39 +00:00
WuHaobo	5588734626	Merge branch 'dygraph' into dynamic	2020-06-09 08:19:20 +08:00
WuHaobo	ed2f71ca68	dygraph optimizer	2020-06-07 15:39:26 +08:00
shippingwang	bb622b24ed	fix bugs	2020-06-04 04:07:38 +00:00
shippingwang	4ccfca291b	add autoargument	2020-05-06 11:17:39 +00:00