Commit Graph

298 Commits (0a387231962cb947c886c192da8b4ce71d37dba5)

Author SHA1 Message Date
gaotingquan 983d512a45 tipc: fix the keyword of ShiTu model
In benchmark_train mode, the config name is benchmark.txt. So the keyword of ShiTu should be model_name instead of the config name.
2022-09-19 14:30:54 +08:00
HydrogenSulfate 42758f5463 fix benchmark train's config for GeneralRecognitionV2, and polish TIPC docs 2022-09-14 08:54:22 +00:00
gaotingquan dafcb5cddf tipc: fix log path for GeneralRecognition 2022-09-14 10:44:29 +08:00
qili93 b1c2350a26 [TIPC] add more scripts change, test=develop 2022-09-13 15:03:14 +08:00
cuicheng01 ec21470a35
Merge pull request #2258 from TingquanGao/dev/tipc_fix_log_path
tipc: fix log path
2022-09-10 00:06:54 +08:00
gaotingquan 7e239952a8 tipc: set num_workers to 4
The benchmark requires threads num to be set 4 when DALI is used for best performance.
And the param num_workers is not worked before commit 80c10bb995.
2022-09-09 10:10:18 +00:00
qili93 0d9ddc0812 [TIPC] add scripts for npu and xpu, test=develop 2022-09-09 02:39:48 +08:00
gaotingquan 0cea550455 tipc: fix log path 2022-09-08 10:57:03 +00:00
gaotingquan 2700beea82 tipc: fix log path 2022-09-08 08:15:33 +00:00
gaotingquan fb669a05b8 tipc: fix log path 2022-09-06 13:25:09 +00:00
gaotingquan b3d26a987d tipc: fix log path 2022-09-05 15:57:49 +00:00
gaotingquan 44b55fb67c tipc: paddle2onnx --enable_dev_version=False 2022-09-05 19:04:20 +08:00
HydrogenSulfate 4ee9dd49e0 fix small bug in prepare.sh 2022-09-04 14:22:44 +00:00
HydrogenSulfate c449ba3420 add fleet chain and update inference_rec.yaml and corresponding output for feature_extraction.md 2022-09-04 14:20:07 +00:00
HydrogenSulfate 4620cfb9bc fix typo in config files 2022-09-04 13:52:58 +00:00
HydrogenSulfate 94b48ac568 add cpp serving & cpp infer chain, update TIPC docs 2022-09-04 13:42:53 +00:00
HydrogenSulfate 38e78b0c81 add paddle2onnx_infer chain 2022-09-01 03:12:11 +00:00
HydrogenSulfate a8278e84c4 add pact chain 2022-09-01 03:01:51 +00:00
HydrogenSulfate 6adee2720f add ptq infer 2022-09-01 02:52:24 +00:00
HydrogenSulfate d2ffc5e408 add lite_train_lite_infer chain 2022-08-31 17:28:48 +00:00
gaotingquan 2f5c0c71da fix: replace ResNet50.yaml with ResNet50_amp_O2_ultra.yaml when AMPO2
It is needed that use dali, NHWC and 4 channels when training ResNet50 with AMPO2
2022-08-26 10:59:16 +08:00
gaotingquan ea66adbec1 fix: need install paddleclas whl 2022-08-26 10:59:16 +08:00
root 5810695672 tipc: set num_wokers=12 2022-08-05 14:34:14 +08:00
root b77a431451 tipc: set num workers=12 iff fp16 2022-08-05 14:34:14 +08:00
root 81b42f627b tipc: rm useless bs 2022-08-05 14:34:14 +08:00
root 430fbd5df9 tipc: support fp32/fp16 training benchmark of PP-Shitu 2022-08-05 14:34:14 +08:00
root a7f124042b mv 2022-08-05 14:34:14 +08:00
root 483c0383e5 tipc: set bs=256 to avoid oom 2022-08-05 14:34:14 +08:00
root b9de09e547 tipc: set num_wokers=12 2022-08-05 14:34:14 +08:00
gaotingquan 7990fe5767 tipc: set num_wokers=8 2022-08-05 14:34:14 +08:00
gaotingquan 3d1fb324a3 tipc: support AMP O2 2022-08-05 14:34:14 +08:00
gaotingquan 595a6c5bcf format code style 2022-08-05 14:34:14 +08:00
gaotingquan ac1c206d4a tipc: support benchmark with fp32/fp16 training 2022-08-05 14:34:14 +08:00
cuicheng01 b1f0d6d083
Merge pull request #1908 from flytocc/PeleeNet_PR
add PeleeNet
2022-07-14 17:50:54 +08:00
Walter c5b5b34306
Merge pull request #2151 from RainFrost1/develop
修复benchmark中bs过大时导致log过少的问题
2022-07-14 14:21:40 +08:00
dongshuilong 46532c446b fix train list bug for benchmark 2022-07-14 03:35:50 +00:00
cuicheng01 1fccb35be7
Merge branch 'develop' into PeleeNet_PR 2022-07-14 10:47:06 +08:00
cuicheng01 1bbe4b5ed1
Merge pull request #1885 from flytocc/ConvNeXt
ConvNext & EMA & gradient accumulation
2022-07-14 10:45:25 +08:00
HydrogenSulfate 3dfc42bed0 set eval_during_train=False and save_interval=2 to reduce checkpoint storage 2022-07-13 19:36:32 +08:00
HydrogenSulfate e66447b3a8 skip python inference when test for mainbody_det 2022-07-13 18:07:50 +08:00
HydrogenSulfate 56e8313fe4 update mainbody_det 2022-07-13 17:55:10 +08:00
HydrogenSulfate 4cf52bcc16 refine docs 2022-07-11 13:41:03 +08:00
HydrogenSulfate fc0abc8765 refine docs 2022-07-11 13:39:20 +08:00
HydrogenSulfate 1ad1268958 refine docs 2022-07-11 13:35:56 +08:00
HydrogenSulfate b7c771640f add 12 model multi machine multi card training config in TIPC 2022-07-11 13:26:38 +08:00
Yang Nie 436f64ad84 Merge branch 'develop' into ConvNeXt 2022-07-09 21:50:31 +08:00
HydrogenSulfate 74cc8b808c add gpu0 2022-07-06 20:53:50 +08:00
HydrogenSulfate ad7ad5c1ad reduce GoogleNet's lr in normal and amp TIPC config to avoid inf output 2022-07-06 20:48:11 +08:00
HydrogenSulfate 1da2e2d36a
Merge branch 'PaddlePaddle:develop' into fix_amp_train 2022-07-06 15:44:13 +08:00
HydrogenSulfate 5f1c265a69 add train_amp doc 2022-07-06 15:41:57 +08:00
Walter d4e286c3f3
Merge pull request #2132 from RainFrost1/develop
add ResNet50 log number in benchmark
2022-07-06 15:40:31 +08:00
dongshuilong f538a55bf2 add ResNet50 log number in benchmark 2022-07-06 07:06:07 +00:00
HydrogenSulfate 7494441082 remove existed symbolic link before ln -s 2022-07-06 14:26:09 +08:00
HydrogenSulfate fa65357777 fix amp O2 train infer config 2022-07-05 22:49:20 +08:00
HydrogenSulfate 4f79d00c62 rename config -> configs 2022-07-04 15:26:28 +08:00
HydrogenSulfate 10cf8736cc fix paddle2onnx for GeneralRecognition model 2022-07-04 15:10:46 +08:00
HydrogenSulfate ad707bde4a slim fleet_train config and fix paddle2onnx for GeneralRecognition model 2022-07-04 15:03:36 +08:00
HydrogenSulfate 2e56bec7d6 slim fleet_train config and fix paddle2onnx for GeneralRecognition model 2022-07-04 15:01:48 +08:00
HydrogenSulfate 3148f15dc0 remove ResNet59_vd and MobileNetV3_large_x1_0 configs' redundant pathes in config file, fix test_inference_cpp.sh 2022-07-02 13:30:59 +08:00
HydrogenSulfate 7b961b5950 remove MobileNetV3_large_x1_0 config redundant pathes in config file 2022-07-01 23:09:26 +08:00
HydrogenSulfate fab572881f reduce number of eval images to only one 2022-07-01 13:43:47 +08:00
HydrogenSulfate 68f636d735 simplify train_infer_python.txt configs 2022-07-01 13:23:00 +08:00
HydrogenSulfate 4b0dd292e3 debug 2022-06-28 06:54:50 +00:00
HydrogenSulfate de1e9cab74 update pact chain 2022-06-28 04:06:54 +00:00
HydrogenSulfate 27dd1bc73c merge develop and solve conflicts 2022-06-27 15:48:36 +08:00
HydrogenSulfate 5cc6c50ce6
Merge pull request #2104 from HydrogenSulfate/add_ampO2_train
Add amp O2 train
2022-06-27 15:45:30 +08:00
HydrogenSulfate 3ec0edc311
Merge pull request #2098 from HydrogenSulfate/add_main_KL
Add main model's KL chain
2022-06-27 15:45:12 +08:00
HydrogenSulfate d59d68f2ed debug 2022-06-24 15:49:15 +00:00
HydrogenSulfate 7990a12e22 Merge branch 'develop' into add_pact_chain 2022-06-24 22:24:45 +08:00
HydrogenSulfate 1e281f8c48 add PACT inference chain 2022-06-24 22:24:27 +08:00
HydrogenSulfate e866a217bf update configs 2022-06-24 18:37:01 +08:00
HydrogenSulfate 8cb2ec8d9c
Merge branch 'PaddlePaddle:develop' into add_ampO2_train 2022-06-24 16:11:14 +08:00
HydrogenSulfate e7d9ba5874 update config and script 2022-06-24 04:25:56 +00:00
HydrogenSulfate cf1e7747de suppporting for custom PADDLEInfer download link 2022-06-23 20:06:01 +08:00
HydrogenSulfate 6ecaaba9fb delete useless script 2022-06-23 07:51:12 +00:00
HydrogenSulfate e6cea06326 format test_train_inference_python.sh 2022-06-23 07:48:17 +00:00
HydrogenSulfate baab34788f debug 2022-06-23 07:36:34 +00:00
HydrogenSulfate 4400aa2747 debug 2022-06-23 06:50:46 +00:00
HydrogenSulfate 480e40eb73 add main model KL transformation chain 2022-06-23 06:46:12 +00:00
HydrogenSulfate 2b758dec3f add pact chain configs and refine related scripts 2022-06-22 17:45:58 +00:00
HydrogenSulfate e77ba41e99 fix GPUID setting and LOG_PATH 2022-06-22 18:21:30 +08:00
HydrogenSulfate 9f1ec3a537 fix GPUID settting and correct LOG_PATH 2022-06-22 16:09:50 +08:00
HydrogenSulfate 43410aa852 update config, add amp eval for retrieval 2022-06-21 23:03:56 +08:00
HydrogenSulfate f55172394b fix 2022-06-21 12:41:54 +00:00
HydrogenSulfate 223872ae10 fix General_rec KL config 2022-06-21 12:05:50 +00:00
HydrogenSulfate b2606a60fc fix General_rec KL config 2022-06-21 12:02:53 +00:00
HydrogenSulfate c0e100a3e0 merge develop 2022-06-21 11:16:45 +00:00
HydrogenSulfate dfd0a0d076 add 5 more KL models 2022-06-21 05:57:06 +00:00
HydrogenSulfate 35d7b1f5f2 restore faiss installtion 2022-06-20 20:22:15 +08:00
HydrogenSulfate 31a736f7e7 move faiss installtion to prepare.sh 2022-06-17 20:02:24 +08:00
HydrogenSulfate b56bb7fd41 fix prepare.sh 2022-06-17 16:37:34 +08:00
HydrogenSulfate 280174a647 debug 2022-06-16 19:55:12 +08:00
HydrogenSulfate 767433c681 debug 2022-06-16 16:39:33 +08:00
HydrogenSulfate 1143a4f217 fix 2022-06-16 15:45:38 +08:00
HydrogenSulfate 2702802427
Merge branch 'PaddlePaddle:develop' into add_kl_quant 2022-06-16 15:36:56 +08:00
HydrogenSulfate ab8ff4d3d1 debug 2022-06-16 15:34:14 +08:00
Walter 1c3212876c
Merge pull request #2071 from RainFrost1/dynamic_benchmark
add r50 dynamic fp16 train for benchmark
2022-06-16 13:59:47 +08:00
Walter dcd17d9437
Merge pull request #2067 from HydrogenSulfate/polish_prepare
polish prepare.sh and docs
2022-06-16 13:54:43 +08:00
HydrogenSulfate bdcda20c30 Merge branch 'polish_prepare' into add_kl_quant 2022-06-16 13:33:23 +08:00
HydrogenSulfate 725c0da267 add kl_quant chain and polish prepare.sh 2022-06-16 12:21:54 +08:00