7cb4b9b18a
[Enhancement] Support tvm ( #1216 )
...
* finish framework
* add autotvm and auto-scheduler tuner
* add python deploy api
* add SDK net(WIP
* add sdk support
* support det, support vm
* fix vm sdk
* support two stage detector
* add instance seg support
* add docstring
* update docs and ut
* add quantize
* update doc
* update docs
* synchronize stream
* support dlpack
* remove submodule
* fix stride
* add alignment
* support dlpack
* remove submodule
* replace exclusive_scan
* add backend check
* add build script
* fix comment
* add ci
* fix ci
* ci fix2
* update build script
* update ci
* add pytest
* update sed command
* update sed again
* add xgboost
* remove tvm ut
* update ansor runner
* add stream sync
* fix topk
* sync default stream
* fix tvm net
* fix window
2022-12-12 21:19:40 +08:00
625593d6f3
[Feature] Support rv1126 in sdk ( #1238 )
...
* tmp
* refine
* update ssd-lite
* tmp
* tmp
* 0.1
* 0.1.1
* rename to base_dense_head
* remove debug code
* wait stream
* update cmakelists
* add some comments
* fix lint
* fix ci error
* fix according reviewer comments
* update params
* fix
* support normalize with to_float being false
* fix lint
* support rv1126 build ci
* support rv1126 build ci
* change debug level
* fix ci
* update
* update doc
* fix circleci error
* update normalize
* update
* check in build script
* change name
2022-11-07 11:13:47 +08:00
c5be297a67
Add nvcc flags for cc62 ( #1273 )
2022-10-31 15:44:41 +08:00
3eb60ea584
[Feature] Add RKNN support to SDK ( #1145 )
...
* add rknn_net [WIP]
* add cmake
* enable mmcls
* remove toTensor in SDK pipeline
* update doc
* translate to Chinese
* update doc and add tool-chain cmake
* use ::framework
* fix lint
* doc and print log
* data map
* refine install doc
* add rknpu2 workflow
* update gcc yaml
* better cmake file
* update doc link
* use vector instead of array
* better env variable
* use soft link
* release ctx
* name rule
2022-10-18 17:52:31 +08:00
ace44ae9d9
improvement(scripts): cross build aarch64 ( #1126 )
...
* udpate
* update
* CI(scripts): add auto cross build aarch64
* docs(scripts): add zh_cn doc
* docs(scripts): update
* docs(scripts): update
* fix(tools): update
* docs(zh_cn): update
* fix(scripts): remove gcc-7
* docs(scripts): update result
* udpate
* fix(tools): remove useless option
* docs(en): typo
* Update cross_build_aarch64.md
* Update cross_build_aarch64.md
* fix(tools/scripts): review advices
* fix(tools/scripts): update
* fix(cmake): remove useless option
* Update aarch64-linux-gnu.cmake
2022-10-17 11:15:29 +08:00
8c164ab3e5
[Fix] Detect filesystem library in CMake ( #1190 )
...
* detect filesystem library in CMake
* add filesystem.cmake
2022-10-14 12:52:16 +08:00
bf887cc8bc
[Enhancement] Refactor SDK pipeline ( #938 )
...
* unify C API naming
* fix demo and move apis/c/* -> apis/c/mmdeploy/*
* fix lint
* WIP refactor pipeline
* backward compatibility
* working pipeline demo
* add text det-recog demo
* add det-pose demo
* fix build
* fix demo
* add environment interface
* add environment to pass scheduler & model info at runtime
* update demos
* add pipeline API for Python
* fix `FromPyObject`
* fix for opencv-4.2
* environment -> context, improve pipeline
* python model interface
* fix cmake
* fix python & cmake
* context & C++ pipeline API
* minor fix
* improve API
* fix shared libs
* refresh C/Python API
* propagate context
* fix python demo
* fix
* add namespace
* fix namespace
* fix mis-changed strings
* fix
* fix python api
* rename
* clean-up
* fix pose detector
* clean-up
* clean-up
* clean-up
* fix python API build
* fix CI
* fix lint
* fix lint
* fix lint & demo
* install pipeline.hpp
* fix MSVC shared library build
* fix sample
* fix MSVC monolithic build
* minor fix
2022-09-26 16:11:14 +08:00
6c2dde1cf8
[Feature] TorchScript SDK backend ( #890 )
...
* WIP SDK torchscript support
* support detection task
* make torchvision optional
* force link torchvision if enabled
* support torch-1.12
* fix export & sync cuda stream
* hide internal classes
* handle error
* set `MMDEPLOY_USE_CUDA` when CUDA is enabled
2022-08-29 18:01:18 +08:00
c04dcd2c62
Support risc-v platform ( #910 )
...
* add ppl.nn riscv engine
* update ppl.nn riscv engine
* udpate riscv service (ncnn backend)
* update _build_wrapper for ncnn
* fix build
* fix lint
* update default uri
* update file structure & add cn doc
* remove copy input data
* update docs
* remove ncnn server
* fix docs
* update zh doc
* update toolchain
* remove unused
* update doc
* update doc
* update doc
* rename cross build dirname
* add riscv.md to build_from_source.md
* update cls model
* test ci
* test ci
* test ci
* test ci
* test ci
* update ci
* update ci
2022-08-26 13:54:40 +08:00
a15365e93f
[Enhancement] build sdk python api in standard-alone manner ( #810 )
...
* build sdk python api in standard-alone manner
* enable MMDEPLOY_BUILD_SDK_MONOLITHIC and MMDEPLOY_BUILD_EXAMPLES in prebuild config
* link mmdeploy to python target when monolithic option is on
* checkin README to describe precompiled package build procedure
* use packaging.version.parse(python_version) instead of list(python_version)
* fix according to review results
* rebase master
* rollback cmake.in and apis/python/CMakeLists.txt
* reorganize files in install/example
* let cmake detect visual studio instead of specifying 2019
* rename whl name of precompiled package
* fix according to review results
2022-08-02 10:23:48 +08:00
f54854ec1c
[Feature] Add C++ API for SDK ( #831 )
...
* add C++ API
* unify result type & add examples
* minor fix
* install cxx API headers
* fix Mat, add more examples
* fix monolithic build & fix lint
* install examples correctly
* fix lint
2022-07-29 14:36:25 +08:00
b6b22a1b6f
[Feature] support build single sdk library ( #806 )
...
* build single lib for c api
* update csharp doc & project
* update test build
* fix test build
* fix
2022-07-28 14:07:48 +08:00
bfd46c1c68
[Fix] Support macOS build ( #762 )
...
* fix macOS build
* fix missing
2022-07-26 21:54:49 +08:00
a822ba7330
add `MMDEPLOY_TASKS` & simplify demo cmake ( #606 )
...
* add `MMDEPLOY_TASKS` & simply cmake
* remove debug log
2022-06-17 13:56:45 +08:00
6c7859510d
Support compute capability 87 archs such as Orin ( #601 )
2022-06-15 19:01:36 +08:00
567ec62296
[Fix] Fix recent build problems ( #544 )
...
* simplify deps management
* skip visibility flags for MSVC
* simplify cuda deps
* naming
* workaround for cmake<3.17
* add spdlog dependency
* move the enablement of CUDA to top level CMakeLists.txt
* fix MSVC build
* fix lint
* fix build for backend ops only
* remove comment
* allow to use apis/python as a standalone project
* remove redundant cmake code
* control shared or static lib using `MMDEPLOY_SHARED_LIBS` instead of `BUILD_SHARED_LIBS`
* fix MSVC build
* update docs
2022-06-06 11:19:34 +08:00
46bfe0ac87
[Feature] New pipeline & executor for SDK ( #497 )
...
* executor prototype
* add split/when_all
* fix GCC build
* WIP let_value
* fix let_value
* WIP ensure_started
* ensure_started & start_detached
* fix let_value + when_all combo on MSVC 142
* fix static thread pool
* generic just, then, let_value, sync_wait
* minor
* generic split and when_all
* fully generic sender adapters
* when_all: workaround for GCC7
* support legacy spdlog
* fix memleak
* bulk
* static detector
* fix bulk & first pipeline
* bulk for static thread pools
* fix on MSVC
* WIP async batch submission
* WIP collation
* async batch
* fix detector
* fix async detector
* fix
* fix
* debug
* fix cuda allocator
* WIP type erased executor
* better type erasure
* simplify C API impl
* Expand & type erase TC
* deduction guide for type erased senders
* fix GCC build
* when_all for arrays of Value senders
* WIP pipeline v2
* WIP pipeline parser
* WIP timed batch operation
* add registry
* experiment
* fix pipeline
* naming
* fix mem-leak
* fix deferred batch operation
* WIP
* WIP configurable scheduler
* WIP configurable scheduler
* add comment
* parse scheduler config
* force link schedulers
* WIP pipeable sender
* WIP CPO
* ADL isolation and dismantle headers
* type erase single thread context
* fix MSVC build
* CPO
* replace decay_t with remove_cvref_t
* structure adjustment
* structure adjustment
* apply CPOs & C API rework
* refine C API
* detector async C API
* adjust detector async C API
* # Conflicts:
# csrc/apis/c/detector.cpp
* fix when_all for type erased senders
* support void return for Then
* async detector
* fix some CPOs
* minor
* WIP rework capture mechanism for type erased types
* minor fix
* fix MSVC build
* move expand.h to execution
* make `Expand` pipeable
* fix type erased
* un-templatize `_TypeErasedOperation`
* re-work C API
* remove async_detector C API
* fix pipeline
* add flatten & unflatten
* fix flatten & unflatten
* add aync OCR demo
* config executor for nodes & better executor API
* working async OCR example
* minor
* dynamic batch via scheduler
* dynamic batch on `Value`
* fix MSVC build
* type erase dynamic batch scheduler
* sender as Python Awaitable
* naming
* naming
* add docs
* minor
* merge tmp branch
* unify C APIs
* fix ocr
* unify APIs
* fix typo
* update async OCR demo
* add v3 API text recognizer
* fix v3 API
* fix lint
* add license info & reformat
* add demo async_ocr_v2
* revert files
* revert files
* resolve link issues
* fix scheduler linkage for shared libs
* fix license header
* add docs for `mmdeploy_executor_split`
* add missing `mmdeploy_executor_transfer_just` and `mmdeploy_executor_execute`
* make `TimedSingleThreadContext` header only
* fix lint
* simplify type-erased sender
2022-06-01 14:10:43 +08:00
0ce7c83c63
mmrotate sdk module ( #450 )
...
* support mmrotate
* fix name
* windows default link to cudart_static.lib, which is not compatible with static build && python_api
* python api
* fix ci
* fix type & remove unused meta info
* fix doxygen, add [out] to @param
* fix mmrotate-c-api
* refactor naming
* refactor naming
* fix lint
* fix lint
* move replace_RResize -> get_preprocess
* Update cuda.cmake
On windows, make static lib and python api build success.
* fix ptr
* Use unique ptr to prevent memory leaks
* move unique_ptr
* remove deleter
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
Co-authored-by: cx <cx@ubuntu20.04>
2022-05-17 23:37:32 +08:00
9306bcec80
Dev v0.4.0 ( #301 )
...
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* remove roi_align plugin for ORT (#258 )
* remove roi_align plugin
* remove ut
* skip single_roi_extractor UT for ORT in CI
* move align to symbolic and update docs
* recover UT
* resolve comments
* [Enhancement]: Support fcn_unet deployment with dynamic shape (#251 )
* support mmseg fcn+unet dynamic shape
* add test
* fix ci
* fix units
* resolve comments
* [Enhancement] fix-cmake-relocatable (#223 )
* require user to specify xxx_dir
* fix line ending
* fix end-of-file-fixer
* try to fix ld cudart cublas
* add ENV var search
* fix CMAKE_CUDA_COMPILER
* cpu, cuda should all work well
* remove commented code
* fix ncnn example find ncnn package (#282 )
* table format is wrong (#283 )
* update pre-commit (#284 )
* update pre-commit
* fix clang-format
* fix mmseg config (#281 )
* fix mmseg config
* fix mmpose evaluate outputs
* fix lint
* update pre-commit config
* fix lint
* Revert "update pre-commit config"
This reverts commit c3fd71611f#296 )
* refactor cmake build (#295 )
* add-mmpose-sdk (#259 )
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add-mmpose-codebase
* fix ci
* fix img_shape after TopDownAffine
* rename TopDown module -> XheadDecode & implement regression decode
* align keypoints_from_heatmap
* remove hardcode keypoint_head, need refactor, current only support topdown config
* add mmpose python api
* update mmpose-python code
* can't clip fake box
* fix rebase error
* fix rebase error
* link mspn decoder to base decoder
* fix ci
* compile with gcc7.5
* remove no use code
* fix
* fix prompt
* remove unnecessary cv::parallel_for_
* rewrite TopdownHeatmapMultiStageHead.inference_model
* add comment
* add more detail docstring why use _cs2xyxy in sdk backend
* fix Registry name
* remove no use param & add comment of output result
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
* update faq about WinError 1455 (#297 )
* update faq about WinError 1455
* Update faq.md
* Update faq.md
* fix ci
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
* [Feature]Support centerpoint (#252 )
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* support for centerpoint
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* add docstring and dcn model support
* add centerpoint ut and docs
* add config and fix input rank
* fix merge error
* fix a bug
* fix comment
* [Doc] update benchmark add supported-model-list (#286 )
* update benchmark add supported-model-list
* fix lint
* fix lint
* loc mmocr maximum version
* fix ut
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
2022-04-01 18:14:23 +08:00
640aa03538
Support Windows ( #106 )
...
* minor changes
* support windows
* fix GCC build
* fix lint
* reformat
* fix Windows build
* fix GCC build
* search backend ops for onnxruntime
* fix lint
* fix lint
* code clean-up
* code clean-up
* fix clang build
* fix trt support
* fix cmake for ncnn
* fix cmake for openvino
* fix SDK Python API
* handle ops for other backends (ncnn, trt)
* handle SDK Python API library location
* robustify linkage
* fix cuda
* minor fix for openvino & ncnn
* use CMAKE_CUDA_ARCHITECTURES if set
* fix cuda preprocessor
* fix misc
* fix pplnn & pplcv, drop support for pplcv<0.6.0
* robustify cmake
* update build.md (#2 )
* build dynamic modules as module library & fix demo (partially)
* fix candidate path for mmdeploy_python
* move "enable CUDA" to cmake config for demo
* refine demo cmake
* add comment
* fix ubuntu build
* revert docs/en/build.md
* fix C API
* fix lint
* Windows build doc (#3 )
* check in docs related to mmdeploy build on windows
* update build guide on windows platform
* update build guide on windows platform
* make path of thirdparty libraries consistent
* make path consistency
* correct build command for custom ops
* correct build command for sdk
* update sdk build instructions
* update doc
* correct build command
* fix lint
* correct build command and fix lint
Co-authored-by: lvhan <lvhan@pjlab.org>
* trailing whitespace (#4 )
* minor fix
* fix sr sdk model
* fix type deduction
* fix cudaFree after driver shutting down
* update ppl.cv installation warning (#5 )
* fix device allocator threshold & fix lint
* update doc (#6 )
* update ppl.cv installation warning
* missing 'git clone'
Co-authored-by: chenxin <chenxin2@sensetime.com>
Co-authored-by: zhangli <zhangli@sensetime.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: lvhan <lvhan@pjlab.org>
2022-02-24 20:08:44 +08:00
e10a1b7c9e
Add more demos ( #305 )
...
* add more examples
* change to restore's output image to BGR
* use BUILD_SHARED_LIBS
* update graph module's cmake
* add condition for spdlog package
* change cmakelists
* update cmakelists
* add device_name in each demo
* remove duplicate cmake function
* use palette to draw segmentation's result
* no need to find_package(pplnn) when use MMDeploy's static libs
* remove MMDeploy_LIBS' dependency on spdlog
* #include <opencv2/imgproc/imgproc.hpp>
* change from mmdeploy_core to mmdeploy::core
2021-12-21 21:32:39 +08:00
36124f6205
Merge sdk ( #251 )
...
* check in cmake
* move backend_ops to csrc/backend_ops
* check in preprocess, model, some codebase and their c-apis
* check in CMakeLists.txt
* check in parts of test_csrc
* commit everything else
* add readme
* update core's BUILD_INTERFACE directory
* skip codespell on third_party
* update trt_net and ort_net's CMakeLists
* ignore clion's build directory
* check in pybind11
* add onnx.proto. Remove MMDeploy's dependency on ncnn's source code
* export MMDeployTargets only when MMDEPLOY_BUILD_SDK is ON
* remove useless message
* target include directory is wrong
* change target name from mmdeploy_ppl_net to mmdeploy_pplnn_net
* skip install directory
* update project's cmake
* remove useless code
* set CMAKE_BUILD_TYPE to Release by force if it isn't set by user
* update custom ops CMakeLists
* pass object target's source lists
* fix lint end-of-file
* fix lint: trailing whitespace
* fix codespell hook
* remove bicubic_interpolate to csrc/backend_ops/
* set MMDEPLOY_BUILD_SDK OFF
* change custom ops build command
* add spdlog installation command
* update docs on how to checkout pybind11
* move bicubic_interpolate to backend_ops/tensorrt directory
* remove useless code
* correct cmake
* fix typo
* fix typo
* fix install directory
* correct sdk's readme
* set cub dir when cuda version < 11.0
* change directory where clang-format will apply to
* fix build command
* add .clang-format
* change clang-format style from google to file
* reformat csrc/backend_ops
* format sdk's code
* turn off clang-format for some files
* add -Xcompiler=-fno-gnu-unique
* fix trt topk initialize
* check in config for sdk demo
* update cmake script and csrc's readme
* correct config's path
* add cuda include directory, otherwise compile failed in case of tensorrt8.2
* clang-format onnx2ncnn.cpp
Co-authored-by: zhangli <lzhang329@gmail.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
2021-12-07 10:57:55 +08:00
q.yao
lvhan028
AllentDan
tpoisonooo
Li Zhang
Chen Xin
Yosshi999