85b7b967ee
[Feature] Support probability output for segmentation ( #1379 )
...
* add do_argmax flag
* sdk support
* update doc
* replace do_argmax with with_argmax
* add todo
2022-12-26 15:48:07 +08:00
7cb4b9b18a
[Enhancement] Support tvm ( #1216 )
...
* finish framework
* add autotvm and auto-scheduler tuner
* add python deploy api
* add SDK net(WIP
* add sdk support
* support det, support vm
* fix vm sdk
* support two stage detector
* add instance seg support
* add docstring
* update docs and ut
* add quantize
* update doc
* update docs
* synchronize stream
* support dlpack
* remove submodule
* fix stride
* add alignment
* support dlpack
* remove submodule
* replace exclusive_scan
* add backend check
* add build script
* fix comment
* add ci
* fix ci
* ci fix2
* update build script
* update ci
* add pytest
* update sed command
* update sed again
* add xgboost
* remove tvm ut
* update ansor runner
* add stream sync
* fix topk
* sync default stream
* fix tvm net
* fix window
2022-12-12 21:19:40 +08:00
4dd4d4851b
Add rv1126 yolov3 support to sdk ( #1280 )
...
* add yolov3 head to SDK
* add yolov5 head to SDK
* fix export-info and lint, add reverse check
* fix lint
* fix export info for yolo heads
* add output_names to partition_config
* fix typo
* config
* normalize config
* fix
* refactor config
* fix lint and doc
* c++ form
* resolve comments
* fix CI
* fix CI
* fix CI
* float strides anchors
* refine pipeline of rknn-int8
* config
* rename func
* refactor
* rknn wrapper dict and fix typo
* rknn wrapper output update, mmcls use end2end type
* fix typo
2022-11-22 20:16:22 +08:00
c4d428fd7d
Add model conversion support to rv1126 ( #1203 )
...
* WIP
* fix interpolate
* support yolov3 and retinanet
* support seg
* support ssd
* supports both partition types for retinanet and ssd
* mean std doc
* update doc, add UT
* support FSAF
* rename configs
* update dump info
* update
* python package installation doc
* update doc
* update doc
* doc
2022-11-02 11:04:22 +08:00
b6f8c1c50d
Add mmseg configs for compatibility with Fast-SCNN model in ncnn backend ( #1094 )
...
* mmdeploy summer camp
* fix lint
* add note
* add note
* add a comment in interpolate.py
Co-authored-by: root <root@LAPTOP-A20M40H8.localdomain>
2022-10-27 10:36:26 +08:00
124635ec5f
Add RKNN support. ( #865 )
...
* save codes
* support resnet and yolov3
* support yolox
* fix lint
* add mmseg support and a doc
* add UT
* update supported model list
* fix ci
* refine docstring
* resolve comments
* remote output_tensor_type
* resolve comments
* update readme
2022-09-06 11:48:39 +08:00
a0fb3be0df
support coreml ( #760 )
...
* sdk inference
* fix typo
* fix typo
* add convert things
* fix missling name
* add cls support
* add more pytorch rewriter
* add det support
* support det wip
* make Model export model_path
* fix nms
* add output back
* add docstring
* fix lint
* add coreml build action
* add zh docs
* add coreml backend check
* update ci
* update
* update
* update
* update
* update
* fix lint
* update configs
* add return value when error occured
* update docs
* update docs
* update docs
* fix lint
* udpate docs
* udpate docs
* update
Co-authored-by: grimoire <streetyao@live.com>
2022-09-05 19:55:47 +08:00
792c27b054
[Feature] Ascend backend ( #747 )
...
* add acl backend
* support dynamic batch size and dynamic image size
* add preliminary ascend backend
* support dtypes other than float
* support dynamic_dims in SDK
* fix dynamic batch size
* better error handling
* remove debug info
* [WIP] dynamic shape support
* fix static shape
* fix dynamic batch size
* add retinanet support
* fix dynamic image size
* fix dynamic image size
* fix dynamic dims
* fix dynamic dims
* simplify config files
* fix yolox support
* fix negative index
* support faster rcnn
* add seg config
* update benchmark
* fix onnx2ascend dynamic shape
* update docstring and benchmark
* add unit test, update documents
* fix wrapper
* fix ut
* fix for vit
* error handling
* context handling & multi-device support
* build with stub libraries
* add ci
* fix lint
* fix lint
* update doc ref
* fix typo
* down with `target_link_directories`
* setup python
* makedir
* fix ci
* fix ci
* remove verbose logs
* fix UBs
* export Error
* fix lint
* update checkenv
Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
2968a18d80
feat(tools/deploy.py): support snpe ( #789 )
...
* fix(tools/deploy.py): support snpe
* improvement(backend/snpe): review advices
* docs(backend/snpe): update build
* docs(backend/snpe): server support specify port
* docs(backend/snpe): update path
* fix(backend/snpe): time counter missing argument
* docs(backend/snpe): add missing argument
* docs(backend/snpe): update download and using
* improvement(snpe_net.cpp): load model with modeldata
2022-08-01 11:08:55 +08:00
9306bcec80
Dev v0.4.0 ( #301 )
...
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* remove roi_align plugin for ORT (#258 )
* remove roi_align plugin
* remove ut
* skip single_roi_extractor UT for ORT in CI
* move align to symbolic and update docs
* recover UT
* resolve comments
* [Enhancement]: Support fcn_unet deployment with dynamic shape (#251 )
* support mmseg fcn+unet dynamic shape
* add test
* fix ci
* fix units
* resolve comments
* [Enhancement] fix-cmake-relocatable (#223 )
* require user to specify xxx_dir
* fix line ending
* fix end-of-file-fixer
* try to fix ld cudart cublas
* add ENV var search
* fix CMAKE_CUDA_COMPILER
* cpu, cuda should all work well
* remove commented code
* fix ncnn example find ncnn package (#282 )
* table format is wrong (#283 )
* update pre-commit (#284 )
* update pre-commit
* fix clang-format
* fix mmseg config (#281 )
* fix mmseg config
* fix mmpose evaluate outputs
* fix lint
* update pre-commit config
* fix lint
* Revert "update pre-commit config"
This reverts commit c3fd71611f#296 )
* refactor cmake build (#295 )
* add-mmpose-sdk (#259 )
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add-mmpose-codebase
* fix ci
* fix img_shape after TopDownAffine
* rename TopDown module -> XheadDecode & implement regression decode
* align keypoints_from_heatmap
* remove hardcode keypoint_head, need refactor, current only support topdown config
* add mmpose python api
* update mmpose-python code
* can't clip fake box
* fix rebase error
* fix rebase error
* link mspn decoder to base decoder
* fix ci
* compile with gcc7.5
* remove no use code
* fix
* fix prompt
* remove unnecessary cv::parallel_for_
* rewrite TopdownHeatmapMultiStageHead.inference_model
* add comment
* add more detail docstring why use _cs2xyxy in sdk backend
* fix Registry name
* remove no use param & add comment of output result
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
* update faq about WinError 1455 (#297 )
* update faq about WinError 1455
* Update faq.md
* Update faq.md
* fix ci
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
* [Feature]Support centerpoint (#252 )
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* support for centerpoint
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* add docstring and dcn model support
* add centerpoint ut and docs
* add config and fix input rank
* fix merge error
* fix a bug
* fix comment
* [Doc] update benchmark add supported-model-list (#286 )
* update benchmark add supported-model-list
* fix lint
* fix lint
* loc mmocr maximum version
* fix ut
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
2022-04-01 18:14:23 +08:00
0556feec79
Replace convert_syncbatchnorm in mmseg ( #93 )
...
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
2022-01-26 11:07:28 +08:00
bb655af629
Add Python wrapper for SDK ( #27 )
...
* add python API for detector
* integrate detection
* add python segmentor
* add segmentation support
* add classifier, text-detector, text-recognizer and restorer
* integrate classifier
* integrate textdet, textrecog and restorer
* simplify
* add inst-seg
* fix inst-seg
* integrate inst-seg
* Moidfy _build_wrapper
* better pipeline substitution
* use registry for backend model creation
* build Python module according to C API targets
* minor fix
* move sdk data pipeline to backend_config
* remove debugging lines
* add docstring for SDKEnd2EndModel
* fix type hint
* fix lint
* fix lint
* insert build/lib to sys.path
Co-authored-by: SingleZombie <singlezombie@163.com>
2022-01-13 11:31:51 +08:00
0f9f0a60e4
[Enhancement]: Update configs for OpenVINO ( #306 )
...
* Update config for OpenVINO
* Update test
* Update better test
* Update instance-seg config of OpenVINO
2021-12-20 17:56:25 +08:00
0dea300714
[Fix] Reanme ppl to pplnn for all cases ( #273 )
...
* add speed benchmark for pplnn and replace all ppl in docs with pplnn
* replace ppl with pplnn for all codes
* docs zh
* fix crnn config path
* update docstring
* rename
* update ppl to pplnn in readme_zh
Co-authored-by: maningsheng <mnsheng@yeah.net>
2021-12-14 15:04:39 +08:00
499d06d844
Add mmseg performance ( #254 )
...
* update doc and config
* test with ncnn
* update docs
* rename config
* update test result with openvino
* merge master
* resolve comments
* update dbnet
2021-12-09 20:17:00 +08:00
bca8cc0897
[fix] align the names of configs ( #256 )
...
* align names of configs
* set input_shape to None for all ppl
2021-12-07 21:06:44 +08:00
a4dceb4bb4
[Enhancement] Enhance ppl for all codebases ( #177 )
...
* enhance ppl for all codebases
* fix dump info
* fix md and use not None
* remove redundant codes
* safe convert empty ppl tensor
* add examples and remove useless lines
2021-11-16 19:16:46 +08:00
5fdd75fba1
Add tensorrt int8 and fp16 configs for all the rest codebases ( #152 )
...
* add configs for all codebases except mmocr and fixed some bugs
* add ocr det
* add fp16 and int8 config for text recog
2021-10-27 15:59:02 +08:00
4c0b36b7ff
[Refactor] Refactor config v1 ( #80 )
...
* [Refactor] Refactor configs according to new standard (#67 )
* modify cfg and cfg_util
* modify tensorrt config
* fix bug
* lint
* Fix
1. Delete print
2. Modify the return value from "False, None" to "None" and related code
3. Rename 2 get functions
* modify apply_marks
* [Feature] Refactor ocr config (#71 )
* add text detection config refactor
* add text recognition refactor
* add static exporting for mmocr
* fix lint
* set max space in child config
* use Sequence[int] instead
* add assert input_shape
* fix static bug and add ppl ort and trt static (#77 )
* [Feature] Refine setup.py (#61 )
* add setup.py and related files
* lint
* Edit requirements
* modify onnx version
* modify according to comments
* [Refactor] Refactor mmseg configs (#73 )
* refactor mmseg config
* change create_input
* fix lint
* fix lint
* fix lint
* fix yapf
* fix yapf
* update export
* remove Segmentation
* remove tast assert
* add onnx_config
* remove hardcode
* Inherit with static
* Remove blank line
* Add segmentation task enum
* add assert task
* mmocr version 0.3.0 (#79 )
* add dump_info
* [Feature]: Refactor config in mmdet (#75 )
* support onnxruntime
* add two stage
* test two-stage ort and ppl
* update fcos post_params
* fix calib
* test ok with maskrcnn dynamic
* add empty line
* add static into config filename
* add input_shape to create_input in mmdet
* add static to some configs
* remove todo codes
* remove partition config in base
* refactor create_input
* rename task name in mmdet
* return None if input_shape is None
* add size info into mmdet configs filenames
* reorganize mmdet configs
* add object detection task for mmdet
* rename get_mmdet_params
* keep naming style consistent
* update post_params for fcos
* fix typo in ncnn config
* [Refactor] Refactor mmedit static config (#78 )
* add static cfg
* update create_input
* [Refactor]: Refactor mmcls configs (#74 )
* refactor mmcls2.0
* fix classify_tensorrt_dynamic.py
* fix classify_tensorrt_dynmic.py
* classify_tensorrt_dynamic_int8.py
* fix file name
* fix ncnn ppl
* updata prepare_input.py
* update utils.py
* updata constant.py
* add
* fix prepare_input.py
* fix prepare_input.py
* add static config file
* add blank lines
* fix prepare_input.py(wait test)
* fix input_shape(wait test)
* Update prepare_input.py
* fix classification_tensorrt_dynamic(wait test)
* fix classification_tensorrt_dynamic_int8(wait test)
* fix classification_tensorrt_static_int8(wait test)
* Rename classification_tensorrt_dynamic.py to classification_tensorrt_dynamic-224x224-224x224.py
* Rename classification_tensorrt_dynamic_int8.py to classification_tensorrt_dynamic_int8-224x224-224x224.py
* Rename classification_tensorrt_dynamic_int8-224x224-224x224.py to classification_tensorrt_int8_dynamic_224x224-224x224.py
* Rename classification_tensorrt_dynamic-224x224-224x224.py to classification_tensorrt_dynamic_224x224-224x224.py
* Rename classification_tensorrt_static.py to classification_tensorrt_static_224x224.py
* Rename classification_tensorrt_static_int8.py to classification_tensorrt_int8_static_224x224.py
* Update prepare_input.py
* Rename classification_tensorrt_dynamic_224x224-224x224.py to classification_tensorrt_dynamic-224x224-224x224.py
* Rename classification_tensorrt_int8_dynamic_224x224-224x224.py to classification_tensorrt_int8-dynamic_224x224-224x224.py
* Rename classification_tensorrt_int8-dynamic_224x224-224x224.py to classification_tensorrt_int8_dynamic-224x224-224x224.py
* Rename classification_tensorrt_int8_static_224x224.py to classification_tensorrt_int8_static-224x224.py
* Rename classification_tensorrt_static_224x224.py to classification_tensorrt_static-224x224.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* Update prepare_input.py
* change logging msg
Co-authored-by: maningsheng <mnsheng@yeah.net>
* fix
* fix else branch
* fix bug for trt in mmseg
* enable dump trt info
* fix trt static for mmdet
* remove two-stage_partition_tensorrt_static-800x1344 config
* fix wrong backend in ppl config
* fix partition calibration
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: RunningLeon <maningsheng@sensetime.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: AllentDan <AllentDan@yeah.net>
2021-09-16 10:26:09 +08:00
3975d491d5
[Feature] Add ppl backend for ocr edit and seg ( #58 )
...
* add ppl for ocr edit and seg
* remove random crop after update mmedit
2021-09-07 15:40:43 +08:00
56bc1242b2
[Feature] Add NCNN on MMSegmentation ( #55 )
...
* fix custom ops support, fix multiple mark bug, add name mapping
* check if the value_info need to be added
* remove unnecessary print
* add nms implement
* two stage split wip
* add two stage split
* add split retinanet visualize
* add two stage split (wip)
* finish two stage split
* fix lint
* move parse string to mmdeploy.utils
* add calib data generator
* create calib dataset
* finish end2end int8
* add split two stage tensorrt visualize
* first
* fix0
* fix1
* dirty work
* wip
* add allocator
* finally done!
* lint
* fix lint
* better gather
* better onnx2ncnn
* fix tensorslice bugs
* fix lint
* fix clang-format
* remove comments
* fix expand
* int param
* fix lint
* [Fix] NCNN TensorSlice op bugs (#42 )
* fix custom ops support, fix multiple mark bug, add name mapping
* check if the value_info need to be added
* remove unnecessary print
* add nms implement
* two stage split wip
* add two stage split
* add split retinanet visualize
* add two stage split (wip)
* finish two stage split
* fix lint
* move parse string to mmdeploy.utils
* add calib data generator
* create calib dataset
* finish end2end int8
* add split two stage tensorrt visualize
* fix tensorslice bugs
* fix lint
* fix clang-format
* remove comments
* int param
* fix lint
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add two stage ncnn support
* remove unused ops
* git unused config
* remove no_grad, should add in refactor
* add ncnn wrapper
* fix lint
* size return tuple
* Resolve grammar error
* Fix lint
* Trim Trailing Whitespace
* fix trim
* add argmax to topk
* add ArgMax parse
* add ncnn mmseg deploy cfg
* utils add ncnn mmseg
* add ncnn
* fix lint
* fix yapf
* fix clang-format-9
* remove debugging code
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
2021-09-03 15:19:54 +08:00
e5dc959276
[Feature]: Support PSPNet with static shape in ORT and TRT ( #39 )
...
* support pspnet with static shape
* set default as None to --test-img
2021-08-20 13:39:03 +08:00
7dbc12d23f
[Feature]: Support FCN,DeeepLabV3, DeepLabV3Plus in mmseg with ONNXRuntime and TensorRT ( #31 )
...
* fix mask empty result
* support fcn exporting to ONNX for ort and trt in whole mode
* resolve comments
* remove unnecessary code
* update prepare_input
* rewrite psp_head & aspp_head
* test fcn deeplabv3 deeplabv3plus with trt
2021-08-12 16:44:16 +08:00
AllentDan
q.yao
lansfair
Chen Xin
Li Zhang
tpoisonooo
lvhan028
RunningLeon
Yifan Zhou
RunningLeon
q.yao
hanrui1sensetime