mmdeploy/tests/regression
HinGwenWoong aabab46d8a
[Enhancement] Improve MMDeploy Regression test (#425)
* make regression test as a module under project

* using `--codebase` instead of  `--deploy-yml`

* Improve doc for `--codebase`

* Add shorter arg  `-p` for `--performance`

* make `checopoint-dir` as an arg for the script

* Gen error log when convert fail.

* Improve res code for testing

* Doc add sdk test detail

* Doc add env setup

* Fix lint

* Fix doc lint

* Improve model path in report

* Improve report title

* Improve report checkpoint path

* Fix lint

* move test yaml under `tests/regression`

* Improve the test yaml path

* Fix lint

* Improve doc

* make func `update_report` code better

* move doc to new location

* Fix arg

* Update arg details

* Use cpu when openvino and onnxruntime cpu package

* Fix word

* Fix func of openpyxl 3.0.9

* Add some info

* Fix lint

* Fix filename

* Fix doc link

* Fix dir name with space when is not sdk

* Add args `--models` for test specific model(s)

* not saving report when no model in codebase when using `--models`

* Fix doc

* Fix lint

* Add table for metric in doc

* Improve table for doc

* Using `None` install of `['all']`

* Improce doc

* set device type properly

* Increate popen bufsize

* Add `precision_type` in `work-dir`

* Fix popen stuck

* Fix lint

* Fix lint

* Fix popen stuck by using file handler

* Make metric dataset as a list

* Update mmseg.yml

* Remove 'FPS' in the report

* Update do_regression_test.md

* Improve log

* Fix codespell

* Fix doc

* ncnn only save `xxx.param` as checkpoint name in the report

Co-authored-by: maningsheng <mnsheng@yeah.net>
2022-05-27 17:08:32 +08:00
..
mmcls.yml [Enhancement] Improve MMDeploy Regression test (#425) 2022-05-27 17:08:32 +08:00
mmdet.yml [Enhancement] Improve MMDeploy Regression test (#425) 2022-05-27 17:08:32 +08:00
mmedit.yml [Enhancement] Improve MMDeploy Regression test (#425) 2022-05-27 17:08:32 +08:00
mmocr.yml [Enhancement] Improve MMDeploy Regression test (#425) 2022-05-27 17:08:32 +08:00
mmpose.yml [Enhancement] Improve MMDeploy Regression test (#425) 2022-05-27 17:08:32 +08:00
mmseg.yml [Enhancement] Improve MMDeploy Regression test (#425) 2022-05-27 17:08:32 +08:00