d8e4a78636
[Improvement] Better unit test. ( #1619 )
...
* update test for mmcls and mmdet
* update det3d mmedit mmocr mmpose mmrotate
* update mmseg
* bug fixing
* refactor ops
* rename variable
* remove comment
2023-02-08 11:30:59 +08:00
d113a5f1c7
[Refactor] refactor is_available, check_env ( #1540 )
...
* refactor is available
* remove try catch in apis
* fix trt check env
* fix ops_info
* update default value
* remove backend list
* optimial pycuda
* update requirement, check env for rknn
2022-12-23 12:06:32 +08:00
7cb4b9b18a
[Enhancement] Support tvm ( #1216 )
...
* finish framework
* add autotvm and auto-scheduler tuner
* add python deploy api
* add SDK net(WIP
* add sdk support
* support det, support vm
* fix vm sdk
* support two stage detector
* add instance seg support
* add docstring
* update docs and ut
* add quantize
* update doc
* update docs
* synchronize stream
* support dlpack
* remove submodule
* fix stride
* add alignment
* support dlpack
* remove submodule
* replace exclusive_scan
* add backend check
* add build script
* fix comment
* add ci
* fix ci
* ci fix2
* update build script
* update ci
* add pytest
* update sed command
* update sed again
* add xgboost
* remove tvm ut
* update ansor runner
* add stream sync
* fix topk
* sync default stream
* fix tvm net
* fix window
2022-12-12 21:19:40 +08:00
124635ec5f
Add RKNN support. ( #865 )
...
* save codes
* support resnet and yolov3
* support yolox
* fix lint
* add mmseg support and a doc
* add UT
* update supported model list
* fix ci
* refine docstring
* resolve comments
* remote output_tensor_type
* resolve comments
* update readme
2022-09-06 11:48:39 +08:00
792c27b054
[Feature] Ascend backend ( #747 )
...
* add acl backend
* support dynamic batch size and dynamic image size
* add preliminary ascend backend
* support dtypes other than float
* support dynamic_dims in SDK
* fix dynamic batch size
* better error handling
* remove debug info
* [WIP] dynamic shape support
* fix static shape
* fix dynamic batch size
* add retinanet support
* fix dynamic image size
* fix dynamic image size
* fix dynamic dims
* fix dynamic dims
* simplify config files
* fix yolox support
* fix negative index
* support faster rcnn
* add seg config
* update benchmark
* fix onnx2ascend dynamic shape
* update docstring and benchmark
* add unit test, update documents
* fix wrapper
* fix ut
* fix for vit
* error handling
* context handling & multi-device support
* build with stub libraries
* add ci
* fix lint
* fix lint
* update doc ref
* fix typo
* down with `target_link_directories`
* setup python
* makedir
* fix ci
* fix ci
* remove verbose logs
* fix UBs
* export Error
* fix lint
* update checkenv
Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
670a504502
fix adaptive_avg_pool exporting to onnx ( #857 )
...
* fix adaptive_avg_pool exporting to onnx
* remove debug codes
* fix ci
* resolve comment
2022-08-12 09:38:46 +08:00
5b31d7a60d
[Enhancement] Install Optimizer by setuptools ( #690 )
...
* Add fuse select assign pass
* move code to csrc
* add config flag
* Add fuse select assign pass
* Add CSE for ONNX
* remove useless code
* Install optimizer by setup tools
* fix comment
2022-07-25 13:04:27 +08:00
4842823fd0
[Enhancement] Add CSE ONNX pass ( #647 )
...
* Add fuse select assign pass
* move code to csrc
* add config flag
* Add fuse select assign pass
* Add CSE for ONNX
* remove useless code
2022-07-19 14:46:14 +08:00
58584888ee
[Enhancement] Add fuse select assign pass ( #589 )
...
* Add fuse select assign pass
* move code to csrc
* add config flag
* remove bool cast
2022-06-29 14:43:01 +08:00
74243dc98b
[Enhancement] Add ONNX passes support ( #390 )
...
* add merge_shape_concate
* add some peephole optimization
* bug fixing
* fix for torch1.9
* add flatten cls head
* add subgraph matcher with attribute
* add ut
* fix lint
* remove onnx2ncnn
* add opset version
* axis name
* fix peephole
* fix symbol compare
* add docs
2022-06-06 21:30:31 +08:00
b32fc41bed
[Refactor][API2.0] Api refactor2.0 ( #529 )
...
* [refactor][API2.0] Add onnx export and jit trace (#419 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add kwargs
* remove comment
* better pipeline manager
* remove print
* [Refactor][API2.0] Api partition calibration (#433 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add partition
* move calibration
* Better create_calib_table
* better deploy
* add kwargs
* remove comment
* better pipeline manager
* rename api, remove reduant variable, and misc
* [Refactor][API2.0] Api ncnn openvino (#435 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add ncnn api
* finish ncnn api
* add openvino support
* add kwargs
* remove comment
* better pipeline manager
* merge fix
* merge util and onnx2ncnn
* fix docstring
* [Refactor][API2.0] API for TensorRT (#519 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add partition
* move calibration
* Better create_calib_table
* better deploy
* add kwargs
* remove comment
* Add tensorrt API
* better pipeline manager
* add tensorrt new api
* remove print
* rename api, remove reduant variable, and misc
* add docstring
* [Refactor][API2.0] Api ppl other (#528 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add kwargs
* Add new APIS for pplnn sdk and misc
* remove comment
* better pipeline manager
* merge fix
* update tools/onnx2pplnn.py
* rename function
2022-05-31 09:18:18 +08:00
9306bcec80
Dev v0.4.0 ( #301 )
...
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* remove roi_align plugin for ORT (#258 )
* remove roi_align plugin
* remove ut
* skip single_roi_extractor UT for ORT in CI
* move align to symbolic and update docs
* recover UT
* resolve comments
* [Enhancement]: Support fcn_unet deployment with dynamic shape (#251 )
* support mmseg fcn+unet dynamic shape
* add test
* fix ci
* fix units
* resolve comments
* [Enhancement] fix-cmake-relocatable (#223 )
* require user to specify xxx_dir
* fix line ending
* fix end-of-file-fixer
* try to fix ld cudart cublas
* add ENV var search
* fix CMAKE_CUDA_COMPILER
* cpu, cuda should all work well
* remove commented code
* fix ncnn example find ncnn package (#282 )
* table format is wrong (#283 )
* update pre-commit (#284 )
* update pre-commit
* fix clang-format
* fix mmseg config (#281 )
* fix mmseg config
* fix mmpose evaluate outputs
* fix lint
* update pre-commit config
* fix lint
* Revert "update pre-commit config"
This reverts commit c3fd71611f#296 )
* refactor cmake build (#295 )
* add-mmpose-sdk (#259 )
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add-mmpose-codebase
* fix ci
* fix img_shape after TopDownAffine
* rename TopDown module -> XheadDecode & implement regression decode
* align keypoints_from_heatmap
* remove hardcode keypoint_head, need refactor, current only support topdown config
* add mmpose python api
* update mmpose-python code
* can't clip fake box
* fix rebase error
* fix rebase error
* link mspn decoder to base decoder
* fix ci
* compile with gcc7.5
* remove no use code
* fix
* fix prompt
* remove unnecessary cv::parallel_for_
* rewrite TopdownHeatmapMultiStageHead.inference_model
* add comment
* add more detail docstring why use _cs2xyxy in sdk backend
* fix Registry name
* remove no use param & add comment of output result
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
* update faq about WinError 1455 (#297 )
* update faq about WinError 1455
* Update faq.md
* Update faq.md
* fix ci
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
* [Feature]Support centerpoint (#252 )
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* support for centerpoint
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* add docstring and dcn model support
* add centerpoint ut and docs
* add config and fix input rank
* fix merge error
* fix a bug
* fix comment
* [Doc] update benchmark add supported-model-list (#286 )
* update benchmark add supported-model-list
* fix lint
* fix lint
* loc mmocr maximum version
* fix ut
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
2022-04-01 18:14:23 +08:00
f0c110e6e6
Add a new pre-commit-hook to automatically add a copyright ( #166 )
...
* Add a new pre-commit-hook to automatically add copyright
* Add a new pre-commit-hook to automatically add copyright
* append 'demo' and 'tools' directories to .pre-commit-config.yaml
2022-02-23 11:38:40 +08:00
3fd17ab6ff
[Refactoring]: Add get_dynamic_axes. ( #36 )
...
* [Fix] fix bugs for mmcls performance test (#269 )
* fix bugs for mmcls performance test
* fix yapf
* add comments of CLASSES attribute
* Fix input name
* support all codebases and update dump info
* fix docstring
* Added random names.
* onnx_config -> ir_config
* fix test
* fix test
* add a TODO
* use self.output_names
* Fixes
* Rewrite test_torch2onnx.
* Add get_dynamic_axes.
* Fix TestGetDynamicAxes
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: AllentDan <AllentDan@yeah.net>
Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-01-06 11:21:48 +08:00
8cdb4abcc9
[Fix] Fix input names ( #12 )
...
* [Fix] fix bugs for mmcls performance test (#269 )
* fix bugs for mmcls performance test
* fix yapf
* add comments of CLASSES attribute
* Fix input name
* support all codebases and update dump info
* fix docstring
* Added random names.
* onnx_config -> ir_config
* fix test
* fix test
* add a TODO
* use self.output_names
* Fixes
* Rewrite test_torch2onnx.
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: AllentDan <AllentDan@yeah.net>
Co-authored-by: grimoire <yaoqian@sensetime.com>
2021-12-30 19:56:03 +08:00
0f9f0a60e4
[Enhancement]: Update configs for OpenVINO ( #306 )
...
* Update config for OpenVINO
* Update test
* Update better test
* Update instance-seg config of OpenVINO
2021-12-20 17:56:25 +08:00
0b23c744fc
remove trt in config ( #280 )
2021-12-13 19:57:15 +08:00
bb9b0a98de
[Enhancement]: Added static config and CI tests for OpenVINO. ( #218 )
...
* Add openvino_static.
* Add openvino-dev.
* Fix skipping ORT tests in test_mmocr_models.
* Updated docs.
* Fix print.
* Fix
* Fix
* Fix other backends
* Fix is_available
* fix ncnn
* Add constrict for get rewrite output
* add not
* Fix
* fix
* Fix
* Fix
* Improve tests
* Remove rebundant `cuda`
* Prevent None object and rename variable
* Fix multi-line string
* rename get_backend_checker
* Add Troubleshooting to doc.
* Fix postprocessing_masks with empty masks.
* Fix tests
* lint
* Update docs.
Co-authored-by: SingleZombie <singlezombie@163.com>
2021-12-01 14:03:48 +08:00
4fc0e79b4e
[Enhancement]: Refine backend environment check and fix online unit test ( #239 )
...
* Fix
* Fix other backends
* Fix is_available
* fix ncnn
* Add constrict for get rewrite output
* add not
* Fix
* fix
* Fix
* Fix
* Improve tests
* Remove rebundant `cuda`
* Prevent None object and rename variable
* Fix multi-line string
* rename get_backend_checker
* Fix tests
* lint
* docstring
2021-12-01 10:19:11 +08:00
a8abc75065
Add licence head to code ( #236 )
2021-11-30 15:00:37 +08:00
d0bb497b0c
[Fix] fix ncnn apis, add onnx2ncnn unit tests, and rename test_mmseg/test_utils.py to avoid conflicts ( #233 )
...
* refactor ncnn convert
* refine docstring
* add onnx2ncnn test
* resolve comments and rename test_utils.py in test_mmseg
Co-authored-by: maningsheng <mnsheng@yeah.net>
2021-11-26 11:43:27 +08:00
8a3e5e0464
【Fix】Fix apis unit test ( #231 )
...
* fix apis unit test
* remove tmp file
* delete test/test_mmedit and tests/test_mmseg
Please enter the commit message for your changes. Lines starting
* fix device to cpu
2021-11-25 18:48:52 +08:00
a4dceb4bb4
[Enhancement] Enhance ppl for all codebases ( #177 )
...
* enhance ppl for all codebases
* fix dump info
* fix md and use not None
* remove redundant codes
* safe convert empty ppl tensor
* add examples and remove useless lines
2021-11-16 19:16:46 +08:00
c5a87fb1bc
[Enhancement]: OpenVINO deployment support for some models ( #117 )
...
* Fix include and lib paths for onnxruntime.
* Fixes for SSD export test
* Add onnx2openvino and OpenVINODetector. Test models: ssd, retinanet, fcos, fsaf.
* Add support for two-stage models: faster_rcnn, cascade_rcnn
* Add doc
* Add strip_doc_string for openvino.
* Fix openvino preprocess.
* Add OpenVINO to test_wrapper.py.
* Fix
* Add openvino_execute.
* Removed preprocessing.
* Fix onnxruntime cmake.
* Rewrote postprocessing and forward, added docstrings and fixes.
* Added device type change to OpenVINOWrapper.
* Update forward_of_single_roi_extractor_dynamic_openvino and fix doc.
* Update docs.
* Add OpenVINODetector and onn2openvino tests.
* Add input_info to onnx2openvino.
* Add TestOpenVINOExporter and test_single_roi_extractor.
* Moved get_input_shape_from_cfg to openvino_utils.py and added test.
* Added test_cascade_roi_head.
* Add backend.check_env() to tests.
* Add OpenVINO to get_rewrite_outputs and to some tests in test_mmdet_models.
* Moved test_single_roi_extractor to test_mmdet_models.
* Removed TestOpenVINOExporter.
2021-10-21 16:07:35 +08:00
10c4ef4203
[Unittest]: MMEdit unittest ( #124 )
...
* add mmedit test
* Solve unittest bug
* lint
* Remove debug code
* add data
* Refine code
* Fix ci
* Fix ci
* follow changes in mmdet test
* try to remove pytest skip
* remove redundant code
* rename
* Fix type hint
* Fix lint
* Refine SwitchBackendWrapper. Fix type hint
* update docstring
2021-10-15 10:25:48 +08:00
f8a70f1d33
[Unittest]: Complement remaining tests in apis/core/utils ( #110 )
...
* Add remaining tests
* Use another method to import
* try to fix ppl import error
* try to fix pyppl import bug 2
* try to fix pyppl import error 3
* try to fix pyppl import error 4
* Use test class
* remove ()
* lint
* add else branch
2021-10-09 14:05:48 +08:00
2073f3327e
[Fix] Fix test_calibration ( #101 )
...
* fix test calibration
* Modify cuda to cpu
2021-09-27 19:51:07 +08:00
6ba1d45e81
[Fix]: fix ignoring test_ops ( #102 )
...
* show message from pytest skip
* skip utility class
Co-authored-by: SingleZombie <singlezombie@163.com>
2021-09-27 19:10:18 +08:00
f9b2cab3fa
[Feature]: Update github CI ( #100 )
...
* align mmedit static cfg
* add for test
* update requirments
* add dependencies from mmlab
* change name
* lower thresh for interrogate at first
* update test
* update to skip
* Move import tensorrt
* Move import statement
Co-authored-by: SingleZombie <singlezombie@163.com>
2021-09-27 17:43:41 +08:00
4de5bbb461
[Unittest]: Add demos for core/apis/utils ( #91 )
...
* add unittests
* lint
* modify .gitignore, remove useless files
* remove emtpy.py and generate it when use
* Update according to comments
1. Use tempfile
2. Delete inference test (which will be tested in each codebase)
3. Refine calibration test
* update annotation
* Add export_info
* Reduce data scale, fix assert
* update json blank line
* add backend check
2021-09-27 16:10:47 +08:00
2b98040b26
[Feature] Refactor v1 ( #56 )
...
* [Refactor] add enum class and use functions to get configuration (#40 )
* add task and codebase enum class
* use funcitons to get config
* Refactor wrappers of mmcls and mmseg (#41 )
* move wrappers of cls & det to apis
* remove get_classes_from_config
* rename onnx_helper to onnx_utils
* move import to outside of class
* refactor ortwrappers
* Refactor build dataset and dataloader for mmseg (#44 )
* refactor build_dataset and build_dataloader for mmcls and mmseg
* remove repeated classes
* set build_dataloader with shuffle=False
* [Refactor] pplwrapper and mmocr refactor (#46 )
* add
* add pplwrapper and refactor mmocr
* fix lint
* remove unused arguments
* apply dict input for pplwrapper and ortwrapper
* add condition before import ppl and ort stuff
* update ppl (#51 )
* Refactor return value and extract_model (#54 )
* remove ret_value
* refactor extract_model
* fix typo
* resolve comments
* [Refactor] Refactor model inference pipeline (#52 )
* move attribute_to_dict to extract_model
* simplify the inference and visualization
* remove unused import
* [Feature] Support SRCNN in mmedit with ONNXRuntime and TensorRT (#45 )
* finish mmedit-ort
* edit __init__ files
* add noqa
* add tensorrt support
* 1. Rename "base.py"
2. Move srcnn.py to correct directory
* fix bugs
* remove figures
* align to refactor-v1
* update comment in srcnn
* fix lint
* newfunc -> new_func
* Add visualize.py
split visualize() in each codebase
* fix lint
* fix lint
* remove unnecessary code in ORTRestorer
* remove .api
* edit super(), remove dataset
* [Refactor]: Change name of split to partition (#57 )
* refactor mmcls configs
* refactor mmdet configs and split params
* rename rest split to partition from master
* remove base.py
* fix init of inference class
* fix mmocr init, add show_result alias
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: RunningLeon <maningsheng@sensetime.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
2021-09-01 15:43:49 +08:00
9f0e2d4339
changed codebase structure ( #10 )
...
* add delta2bbox rewriter
* rename onnx2trt
* add rewriter: anchor_generator_single_level_grid_priors
* Revert "add rewriter: anchor_generator_single_level_grid_priors"
This reverts commit ac7cf272942c4787bf143c0d67e414b0d2603b75.
* update comments
* remove clamp rewriter
* remove unused func
* reconstruct codes
* remomve mark
* create export package for codebases
* remove grid_sampler symbolic
* reorganize nms parts
* fix conflicts
* update unittest
2021-07-12 16:26:44 +08:00
66a099faf9
[Feature] Apis unit test ( #7 )
...
* add apis test
* split torch2onnx impl, prepare for codebase test
* add is_available to backend
* lint
2021-07-05 12:51:43 +08:00
q.yao
q.yao
AllentDan
Li Zhang
RunningLeon
lvhan028
Zaida Zhou
Semyon Bevzyuk
Yifan Zhou
RunningLeon
VVsssssk