Chen Xin
908a69b7d0
compat mmpose v0.26 (sdk) ( #527 )
2022-06-07 17:10:16 +08:00
lzhangzz
d69280e82f
remove useless code ( #557 )
2022-06-07 14:05:06 +08:00
lvhan028
0d609701df
add sdk python demo ( #554 )
...
* check in python demos
* check in text detector python demo
* check in roatated object python demo
* check in pose python demo
* ignore the output class number when testing metrics with sdk as a backend
* fix object_detection
* rollback segmentation_model and python/segmentor.cpp
2022-06-07 12:16:09 +08:00
q.yao
74243dc98b
[Enhancement] Add ONNX passes support ( #390 )
...
* add merge_shape_concate
* add some peephole optimization
* bug fixing
* fix for torch1.9
* add flatten cls head
* add subgraph matcher with attribute
* add ut
* fix lint
* remove onnx2ncnn
* add opset version
* axis name
* fix peephole
* fix symbol compare
* add docs
2022-06-06 21:30:31 +08:00
tpoisonooo
456076c06b
fix(demo/csrc/CMakeLists.txt): build option ( #553 )
2022-06-06 14:25:18 +08:00
lzhangzz
567ec62296
[Fix] Fix recent build problems ( #544 )
...
* simplify deps management
* skip visibility flags for MSVC
* simplify cuda deps
* naming
* workaround for cmake<3.17
* add spdlog dependency
* move the enablement of CUDA to top level CMakeLists.txt
* fix MSVC build
* fix lint
* fix build for backend ops only
* remove comment
* allow to use apis/python as a standalone project
* remove redundant cmake code
* control shared or static lib using `MMDEPLOY_SHARED_LIBS` instead of `BUILD_SHARED_LIBS`
* fix MSVC build
* update docs
2022-06-06 11:19:34 +08:00
RunningLeon
51f630b22c
Fix test ncnn failure in regression test ( #551 )
...
* fix ncnn test in regression test
* update doc
* fix docstring
2022-06-06 10:00:02 +08:00
tpoisonooo
cd336eada1
improvement(ViT): use Crop to subtitude Gather ( #477 )
...
* improvement(ViT): use Crop to subtitude Gather
* fix(CI): code format
* fix(pytorch/ops/linear.py): bias maybe None
* fix(test/test_pytorch_ops.py): op_type error
* fix(test): pytest error
* fix(test): torch version 1.8
2022-06-02 19:39:15 +08:00
AllentDan
ee878b539b
change resolution and fix regression test for mmocr ( #534 )
2022-06-02 18:29:41 +08:00
tpoisonooo
f969d5a104
docs(do_regression_test): fix-typo ( #547 )
...
* docs(do_regression_test): fix-typo
* improvement(apis/__init__.py): add print
* fix(CI): lint
* revert(apis/__init__.py): remove logging
2022-06-02 17:07:53 +08:00
q.yao
07fe3e85e2
[RegressionTest] Add mmrotate regression test ( #542 )
...
* Add mmrotate regression test
* update regression test script
2022-06-02 14:28:33 +08:00
q.yao
9cbf9ecb18
[Prebuild] Add prebuilt TensorRT build number ( #545 )
...
* Add prebuilt TensorRT build number
* fix
2022-06-01 22:49:55 +08:00
q.yao
ea1122ce88
[Docs] Update doc for dependency ( #543 )
...
* Update doc for dependency
* update requirements
2022-06-01 15:39:34 +08:00
lzhangzz
46bfe0ac87
[Feature] New pipeline & executor for SDK ( #497 )
...
* executor prototype
* add split/when_all
* fix GCC build
* WIP let_value
* fix let_value
* WIP ensure_started
* ensure_started & start_detached
* fix let_value + when_all combo on MSVC 142
* fix static thread pool
* generic just, then, let_value, sync_wait
* minor
* generic split and when_all
* fully generic sender adapters
* when_all: workaround for GCC7
* support legacy spdlog
* fix memleak
* bulk
* static detector
* fix bulk & first pipeline
* bulk for static thread pools
* fix on MSVC
* WIP async batch submission
* WIP collation
* async batch
* fix detector
* fix async detector
* fix
* fix
* debug
* fix cuda allocator
* WIP type erased executor
* better type erasure
* simplify C API impl
* Expand & type erase TC
* deduction guide for type erased senders
* fix GCC build
* when_all for arrays of Value senders
* WIP pipeline v2
* WIP pipeline parser
* WIP timed batch operation
* add registry
* experiment
* fix pipeline
* naming
* fix mem-leak
* fix deferred batch operation
* WIP
* WIP configurable scheduler
* WIP configurable scheduler
* add comment
* parse scheduler config
* force link schedulers
* WIP pipeable sender
* WIP CPO
* ADL isolation and dismantle headers
* type erase single thread context
* fix MSVC build
* CPO
* replace decay_t with remove_cvref_t
* structure adjustment
* structure adjustment
* apply CPOs & C API rework
* refine C API
* detector async C API
* adjust detector async C API
* # Conflicts:
# csrc/apis/c/detector.cpp
* fix when_all for type erased senders
* support void return for Then
* async detector
* fix some CPOs
* minor
* WIP rework capture mechanism for type erased types
* minor fix
* fix MSVC build
* move expand.h to execution
* make `Expand` pipeable
* fix type erased
* un-templatize `_TypeErasedOperation`
* re-work C API
* remove async_detector C API
* fix pipeline
* add flatten & unflatten
* fix flatten & unflatten
* add aync OCR demo
* config executor for nodes & better executor API
* working async OCR example
* minor
* dynamic batch via scheduler
* dynamic batch on `Value`
* fix MSVC build
* type erase dynamic batch scheduler
* sender as Python Awaitable
* naming
* naming
* add docs
* minor
* merge tmp branch
* unify C APIs
* fix ocr
* unify APIs
* fix typo
* update async OCR demo
* add v3 API text recognizer
* fix v3 API
* fix lint
* add license info & reformat
* add demo async_ocr_v2
* revert files
* revert files
* resolve link issues
* fix scheduler linkage for shared libs
* fix license header
* add docs for `mmdeploy_executor_split`
* add missing `mmdeploy_executor_transfer_just` and `mmdeploy_executor_execute`
* make `TimedSingleThreadContext` header only
* fix lint
* simplify type-erased sender
2022-06-01 14:10:43 +08:00
q.yao
7d367d4575
update ppl __init__.py ( #540 )
2022-05-31 22:53:23 +08:00
lzhangzz
5e51739485
[Feature] Support DBNet, PANet and PSENet for SDK, with GPU aided post-processing ( #526 )
...
* add SDK support for PANet
* fix panet
* fix panet
* simplify panet
* add PSENet support
* fix-psenet
* add CUDA post-processing for DBNet
* fix dbnet
* fix dbnet
* add cpu support for PANet
* fix panet
* add CUDA support for PANet
* fix panet
* format
* add cpu impls for PSENet
* fix psenet
* add cuda impl for PSENet
* fix psenet
* add param parsing
* simplify impls
* simplify impls
* clean-up
* fix lint
* fix cuda-10 build
* fix cuda-10 build
2022-05-31 21:24:09 +08:00
Chen Xin
7ba543be95
fix C# API build option ( #535 )
...
* fix C# API build option
* move option up
Co-authored-by: ChenXin <chenxin2@sensetime.com>
2022-05-31 15:51:19 +08:00
q.yao
b32fc41bed
[Refactor][API2.0] Api refactor2.0 ( #529 )
...
* [refactor][API2.0] Add onnx export and jit trace (#419 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add kwargs
* remove comment
* better pipeline manager
* remove print
* [Refactor][API2.0] Api partition calibration (#433 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add partition
* move calibration
* Better create_calib_table
* better deploy
* add kwargs
* remove comment
* better pipeline manager
* rename api, remove reduant variable, and misc
* [Refactor][API2.0] Api ncnn openvino (#435 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add ncnn api
* finish ncnn api
* add openvino support
* add kwargs
* remove comment
* better pipeline manager
* merge fix
* merge util and onnx2ncnn
* fix docstring
* [Refactor][API2.0] API for TensorRT (#519 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add partition
* move calibration
* Better create_calib_table
* better deploy
* add kwargs
* remove comment
* Add tensorrt API
* better pipeline manager
* add tensorrt new api
* remove print
* rename api, remove reduant variable, and misc
* add docstring
* [Refactor][API2.0] Api ppl other (#528 )
* first commit
* add async call
* add new api onnx export and jit trace
* add decorator
* fix ci
* fix torchscript ci
* fix loader
* better pipemanager
* remove comment, better import
* add kwargs
* Add new APIS for pplnn sdk and misc
* remove comment
* better pipeline manager
* merge fix
* update tools/onnx2pplnn.py
* rename function
2022-05-31 09:18:18 +08:00
HinGwenWoong
aabab46d8a
[Enhancement] Improve MMDeploy Regression test ( #425 )
...
* make regression test as a module under project
* using `--codebase` instead of `--deploy-yml`
* Improve doc for `--codebase`
* Add shorter arg `-p` for `--performance`
* make `checopoint-dir` as an arg for the script
* Gen error log when convert fail.
* Improve res code for testing
* Doc add sdk test detail
* Doc add env setup
* Fix lint
* Fix doc lint
* Improve model path in report
* Improve report title
* Improve report checkpoint path
* Fix lint
* move test yaml under `tests/regression`
* Improve the test yaml path
* Fix lint
* Improve doc
* make func `update_report` code better
* move doc to new location
* Fix arg
* Update arg details
* Use cpu when openvino and onnxruntime cpu package
* Fix word
* Fix func of openpyxl 3.0.9
* Add some info
* Fix lint
* Fix filename
* Fix doc link
* Fix dir name with space when is not sdk
* Add args `--models` for test specific model(s)
* not saving report when no model in codebase when using `--models`
* Fix doc
* Fix lint
* Add table for metric in doc
* Improve table for doc
* Using `None` install of `['all']`
* Improce doc
* set device type properly
* Increate popen bufsize
* Add `precision_type` in `work-dir`
* Fix popen stuck
* Fix lint
* Fix lint
* Fix popen stuck by using file handler
* Make metric dataset as a list
* Update mmseg.yml
* Remove 'FPS' in the report
* Update do_regression_test.md
* Improve log
* Fix codespell
* Fix doc
* ncnn only save `xxx.param` as checkpoint name in the report
Co-authored-by: maningsheng <mnsheng@yeah.net>
2022-05-27 17:08:32 +08:00
Chen Xin
9e6a3c8ec5
add csharp support ( #388 )
...
* add csharp support, init commit
* export MMDeploySharpExtern.dll when build sdk
* refactor code
* multi frameworks
* move csharp demo to demo folder
* try to fix lint
* try to fix lint
* update csharp demo Readme
* rename MMDeploySharp -> MMDeploy
* add comment why build MMDeployExtern.dll
* squeeze MMDeploy project
* remove Mm
* print error code
* update c# api build README.md
* fix exception
* fix exception
* update demo
* update README.md
* fix typo
* fix ci
* fix ci
* fix formatresult
* add options whether build MMDeployExtern.dll
* update CMakeListst.txt
* change MMDEPLOY_BUILD_CSHARP_EXTERN -> MMDEPLOY_BUILD_SDK_CSHARP_API
* c# api -> C# API
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
2022-05-27 16:02:29 +08:00
q.yao
b7bdd2172b
[Enhancement] Add TensorRT fp16 support for MDCN ( #503 )
...
* Add TensorRT support for MDCN
* add define check
2022-05-27 13:02:27 +08:00
tpoisonooo
ea0a9e5d43
feat(tools/deploy.py): support ncnn quantization ( #476 )
...
* feat(tools): add onnx2ncnn_quant_table
* feat(tools): add quantization image dataset
* feat(tools): add image dataset
* feat(tools/deploy.py): support quant
* fix(CI): lint
* fix(CI): format
* docs(zh_cn): add quantization usage
* docs(zh_cn): add benchmark
* feat(tools): add onnx2ncnn_quant_table
* docs(zh_cn): add more test result
* CI(github): add quant script
* CI(.github/scripts): add test quant
* fix(CI): remove pushd and popd
* feat(CI): debug
* fix(CI): path error
* fix(CI): fix path
* fix(CI): install wget
* fix(CI): review advices
* improvement(mmdeploy): review advice
* fix(tools): rename to onnx2ncnn_quant_table.py
* improvement(tools): rename file
* improvement(test): remove useless
* fix(tools/quant_image_dataset): remove loadFile in test.pipeline
* docs(quantization.md): update description
* fix(CI): protobuf version
* fix(CI): pip install
* docs(quantization): review advice
* fix(CI): revert mmcv version
* fix(CI): udpate pb version
* fix(CI): update
2022-05-26 19:53:56 +08:00
Johannes L
651eec239b
MMdeploy build & install script + prerequisites ( #399 )
...
* Initial commit of build script
* Fixed lint
* * Set prefix depending on install arch
* Auto detect installed version of cmake, gcc. Update if necessary
* Prompt to reinstall venv if exists
* Disable .tar packing
* Enable MMDEPLOY SDK Python
* Misc cleanup
* Fixed lint
* Renamed script
* * Set env variables without restarting script.
* OpenCV install optional.
* Fix numpy OPENBLAS_CORETYPE on numpy >1.19.4.
* Remove specific build files.
* Fix prebuild output .tar.gz.
* Comments added. exec bash when closing script
* * Use root dir as MMDeploy dir.
* Use pip3.
* Remove explicit MMDeploy checkout version.
* Use MMDEPLOY_DIR for examples path
* Make PyTorch, torchvision, mmcv install optional
* * Do not deactivate python venv.
* Make prebuild archive optional.
* Add venv* to gitignore
* * Add support for unattended, interactive install. * Cleanup misc. comments.
* Check input arguments before continuing.
* Added additional log messages, comments added
* Added default option when pressing [ENTER]
* * Rearranged cmake, gcc build/install order.
* Mention default option when reinstalling venv
* sudo make install instead of cmake --install
* Moved script to tools/scripts
* Fixed relative path when generating WORKING_DIR
2022-05-25 17:13:24 +08:00
Yue Zhou
89204d16ce
[Feature] Support two stage rotated detector in MMRotate ( #473 )
...
* upload
* add fake_multiclass_nms_rotated
* delete unused code
* align with pytorch
* Update delta_midpointoffset_rbbox_coder.py
* rewrite atan2
* Update bbox_nms.py
2022-05-25 13:41:16 +08:00
q.yao
e3a8baac4c
[Enhancement] Support RotatedRetinaNet TensorRT ( #422 )
...
* add rotated nms trt plugin
* fix ops output shape
* rebase
* fix lint
* add fp16, benchmark
* format docs
* remove unused definition, add ut
* add docs
* update docs
* add doc
2022-05-24 10:34:22 +08:00
q.yao
4710ab910d
[Refactor][tools] Add prebuild tools. ( #347 )
...
* move to lib
* optional import pytorch rewriter
* reduce torch dependancy of tensorrt export
* remove more mmcv support
* fix pytest
* remove mmcv logge
* Add `mmdeploy.utils.logging`
* Improve the common of the `get_logger`
* Fix lint
* onnxruntim add try catch to import wrapper if pytorch is available
* Using `mmcv.utils.logging` in all files under `mmdeploy/codebase`
* add __init__
* add prebuild tools
* support windows
* for comment
* exit if failed
* add exist
* decouple
* add tags
* remove .mmdeploy_python
* read python version from system
* update windows config
* update linux config
* remote many
* better build name
* rename python tag
* fix pyhon-tag
* update window config
* add env search
* update tag
* fix build without CUDA_TOOLKIT_ROOT_DIR
Co-authored-by: HinGwenWoong <peterhuang0323@outlook.com>
2022-05-23 17:15:09 +08:00
AllentDan
9eee75b98f
More ocr models ( #446 )
...
* rewrite sync batchnorm
* export panet and psenet
* resolution
* align fp16 for panet
* refine codes
* enable satrn for trt
* refine docs
* docstring
* docstring
* add ut and refine codes
* fix ut
* resolve comments and move panet-fp16 to doc
* remove ut
* refine ut
* resolve comments
* use size instead of img_scale
* use size of MultiScaleAug
Co-authored-by: dongchunyu.vendor <dongchunyu@pjlab.org.cn>
2022-05-20 21:52:36 +08:00
q.yao
a4b7bced55
[Feature] Support reppoints TensorRT ( #457 )
...
* Support reppoints tensorrt
* add ut and docs
* update zh_cn documents
* update document
2022-05-18 11:54:45 +08:00
Chen Xin
0ce7c83c63
mmrotate sdk module ( #450 )
...
* support mmrotate
* fix name
* windows default link to cudart_static.lib, which is not compatible with static build && python_api
* python api
* fix ci
* fix type & remove unused meta info
* fix doxygen, add [out] to @param
* fix mmrotate-c-api
* refactor naming
* refactor naming
* fix lint
* fix lint
* move replace_RResize -> get_preprocess
* Update cuda.cmake
On windows, make static lib and python api build success.
* fix ptr
* Use unique ptr to prevent memory leaks
* move unique_ptr
* remove deleter
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
Co-authored-by: cx <cx@ubuntu20.04>
2022-05-17 23:37:32 +08:00
q.yao
1a8d7aceaf
[Enhancement] Support DeformConv TensorRT fp16 ( #468 )
...
* add DCN TensorRT fp16 support
* fix getOutputDimensions
2022-05-17 19:58:33 +08:00
RunningLeon
843d3c9519
Rewrite mmcls gap ( #478 )
...
* rewrite mmcls gap to replace view with flatten
* add test
* update
2022-05-17 19:57:38 +08:00
tpoisonooo
d04c8dc9c0
refactor(onnx2ncnn): add test case and simplify code ( #436 )
...
* refactor(onnx2ncnn.cpp): split it to shape_inference, pass and utils
* refactor(onnx2ncnn.cpp): split it to shape_inference, pass and utils
* refactor(onnx2ncnn.cpp): split code
* refactor(net_module.cpp): fix build error
* ci(test_onnx2ncnn.py): add generate model adn run
* ci(onnx2ncnn): add ncnn backend
* ci(test_onnx2ncnn): add converted onnx model`
* ci(onnx2ncnn): fix ncnn tar
* ci(backed-ncnn): simplify dependency install
* ci(onnx2ncnn): fix apt install
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* Update backend-ncnn.yml
* fix(ci): add include algorithm
* Update build.yml
* parent aa85760531
author q.yao <streetyao@live.com> 1651287879 +0800
committer tpoisonooo <khj.application@aliyun.com> 1652169959 +0800
[Fix] Fix ci (#426 )
* fix ci
* add nvidia key
* remote torch
* recover pytorch
refactor(onnx2ncnn.cpp): split it to shape_inference, pass and utils
* fix(onnx2ncnn): review
* fix(onnx2ncnn): build error
Co-authored-by: q.yao <streetyao@live.com>
2022-05-16 10:36:25 +08:00
RunningLeon
6eb83a9daa
fix import mmrazor error in mmcls test ( #467 )
2022-05-13 14:15:39 +08:00
tpoisonooo
9a4028bd49
fix(zh_CN): doc link ( #447 )
...
* docs(zh_CN): fix link missing
* docs(benchmark.md): fix pytorch typo
2022-05-12 12:22:50 +08:00
q.yao
3e4547d17b
fix-windows-ci ( #462 )
2022-05-11 20:39:31 +08:00
tpoisonooo
5f59b4464f
docs(docs/zh_cn): update doc and link checker ( #418 )
...
* docs(docs/zh_cn): add doc and link checker
* docs(REAME): update
* docs(docs/zh_cn): update
* docs(benchmark): update table
* docs(zh_cn/benchmark): update link
* CI(docs): update link check
* ci(doc): update checker
* docs(zh_cn): update
* style(ci): remove useless para
* style(ci): update
* docs(zh_cn): update
* docs(benchmark.md): fix mobilnet link error
* docs(docs/zh_cn): add doc and link checker
* docs(REAME): update
* docs(docs/zh_cn): update
* docs(benchmark): update table
* docs(zh_cn/benchmark): update link
* CI(docs): update link check
* ci(doc): update checker
* docs(zh_cn): update
* style(ci): remove useless para
* style(ci): update
* docs(zh_cn): update
* docs(benchmark.md): fix mobilnet link error
* docs(zh_cn/do_regression_test.md): rebase
* docs(docs/zh_cn): add doc and link checker
* Update README_zh-CN.md
* Update README_zh-CN.md
* Update index.rst
* Update check-doc-link.yml
* [Fix] Fix ci (#426 )
* fix ci
* add nvidia key
* remote torch
* recover pytorch
* ci(codecov): ignore ci
* docs(zh_cn): add get_started.md
* docs(zh_cn): fix review advice
* docs(readthedocs): update
* docs(zh_CN): update
* docs(zh_CN): revert
* fix(docs): review advices
* fix(docs): review advices
* fix(docs): review
Co-authored-by: q.yao <streetyao@live.com>
2022-05-09 10:18:10 +08:00
q.yao
81a9719dd3
Limit mmpose requirement ( #440 )
2022-05-07 19:30:12 +08:00
Yue Zhou
42dc5bc316
Support single stage rotated detector in MMRotate ( #428 )
...
* fix lint
* fix lint
* add mmrotate part
* update
* update
* fix
* remove init_detector
* success run with bs=1
* nms_rotated support batch
* support [batch_id, class_id, box_id]
* fix
* fix
* Create test_mmrotate_core.py
* add ut
* add ut
* Update nms_rotated.py
* fix
* Revert "fix"
This reverts commit f792387fb4
.
* add mmrotate into requirements
* add ut
* update doc
* update
* skip test because mmcv version < 1.4.6
* update
* Update rotated-detection_static.py
* Update rotated-detection_static.py
* Update rotated-detection_static.py
* fix bug of memory leak.
* Update rotated_detection_model.py
2022-05-07 16:11:43 +08:00
HinGwenWoong
76f6e253bb
[Fix] ncnn [-Wreturn-type] and improve mutex `if` ( #431 )
...
* Fix make ncnn [-Wreturn-type]
* Fix lint
2022-05-07 10:35:22 +08:00
q.yao
59453dc0f6
[Fix] Fix ci ( #426 )
...
* fix ci
* add nvidia key
* remote torch
* recover pytorch
2022-04-30 11:04:39 +08:00
hanrui1sensetime
aa85760531
[Enhancement] Support litehrnet for ncnn ( #316 )
...
* support for litehrnet
* support ncnn vulkan
* update supported models
* add docstring
* add one ut and fix wrapper
* add test_shuffleunit
* add test_stem_forward
* add last ut
* fix flake8
* fix yapf
* fix lint
* fix yapf
* fix comments
* unified chunk
* mv adaptive_avg_pool
* fix lint
* move adaptive_avg_pool_ncnn
* fix lint
* symbolic rewriter of adaptive_avg_pool2d
* fix lint
* fix yapf
* fix ci
2022-04-29 16:46:19 +08:00
q.yao
5cbb06567b
remove expand from mmdet rewriter ( #371 )
2022-04-29 13:54:08 +08:00
HinGwenWoong
22652175bc
[Feature] Regression test for mmdeploy ( #302 )
...
* Add regression test script
* Add doc
* Add test yaml for mmdet
* evaluate_outputs Add return result
(cherry picked from commit c8c9cd75df
)
* object_detection return metric after eval
(cherry picked from commit 1b8dcaa39e
)
* move `deploy_config_dir` to `global_info` in test yaml
* fix path error
* Improve test yaml structure
* Add test env for saving regression report
* Fix SDK test report will crash
* Get SDK FPS
* Add mmcls regression test yaml
* Using CMD to test the backend result
* Get metric from log file
* Imporve coding
* Imporve coding
* restructure test yaml
* resturcture the test yaml and coding, using pipeline style
* Fixed wont saving into report when cant find `backend_test` and `sdk_config`
* set `metric_info` in test yaml
* improve test yaml
* Fixed will get black checkpoint file name
* Fix lint
* Fix yaml
* Add common in test yaml
* Resturcture mmcla test yaml
* Resturcture mmcla test yaml
* Improve mmcls test yaml
* mmcls test success
* Improve tes yaml field
* Add `--test-img` only when `test_img_path` is not None
* Add `precision_type` in report
* Not saving pkl result file any more
* Add 'x' install of '-' when script crash
* Fix some field in mmcls test yaml
* Add mmseg test yaml
* Add unknown backend final file name
* Improve backend file dict
* Add mmseg success
* unify the checkpoint path to relate path
* unify the checkpoint path to relate path
* Add mmpose, need to test
* Support backend file list to `--model` when test the backend
* Fix lint
* Add some common
* FPS get from log always get 1:10 line
* Add dataset in report when test backend
* Get dataset type from model config file
* Replace pipeline.json topk
* SDK report add backend name
* Add txt report, it will save each test
* update mmcls config
* Add `calib-dataset-cfg` in cmd when it exist in tset yaml
* make model path shorter by cutting the work_dir_root
* Add `task_name` in test yaml
* Add `task_name` in report
* Improve test yaml
* Add mmocr test yaml
* Get mmocr fps metric success
* Add `dataset` feild in test yaml
* Report will skip when the dataset name not in test yaml
* Add dbnet in mmocr test yaml and success get metric
* Add mmedit test yaml
* Improve some common
* Add mmedit success
* Fix lint
* Fix isort lint
* Fix yapf lint
* Undo some changes in `evaluate_outputs`
* Undo some changes in `evaluate_outputs`
* Improve test requirement.txt
* Undo some changes in `evaluate_outputs`
* Improve doc
* Improve mmedit test yaml
* Using `--divice`
* Fix lint
* Using `--performance` replace `--test-type`
* Fix lint
* Fix page link
* Fix backend name
* Using `logger` instead of `print`
* Fix lint
* Add TorchScript in the doc
* Add type hint for all the funcs
* Fix docformatter lint
* Fix path in report have the root of work dir
* mmdet add other backend in tast yaml
* mmdet add other backend in tast yaml
* mmocr add other backend in tast yaml
* mmedit add other backend in tast yaml
* mmpose add other backend in tast yaml
* Delete filed `codebase_model_config_dir` in test yaml
* Using `Config` in metafile.yml instal of `Name` from allmodel config files.
* Fix yapf lint
* update mmpose mmseg config
* Fix lint
* Imporve mmcls test yaml
* Imporve mmedit test yaml
* Imporve mmedit test yaml
* Imporve mmseg test yaml
* update mmdet yml
* Not using pth when conver sucess when in only convert mode
* Using metafile dataset when can not get `model_cfg.dataset_type`
* Fixed `model_name` incorrect in some codebase
* Improve mmcls test yaml image
* Improve mmedit test yaml image
* Improve mmocr test yaml image
* Improve mmseg test yaml image
* Fix test yaml bug
* Support overwirte `metric_tolerance`
* Add `metric_tolerance` in mmcls
* Fixed yaml bug
* mmcls add all models, which had already supported, in test yaml
* Fix report will not replace to ${WORK_DIR}
* Add metric tolerance in mmcls test yaml
* Modefied mmcls global metric tolreance
* remove `metric_tolerance` in each pipeline
* Improve mmcls test yaml
* mmcls add TODO
* imporve test yaml `pp`l -> `pplnn`
* mmdet add all models, which had already supported, in test yaml
* mmedit add all models, which had already supported, in test yaml
* mmocr add all models, which had already supported, in test yaml
* mmpose add all models, which had already supported, in test yaml
* Replace `sdk_xxx_fp32` to `sdk_xxx`
* mmseg add all models, which had already supported, in test yaml
* Import the backend order of test yaml
* Fix mmseg test yaml pplnn static config
* Add notes for Windows user in the doc
* Fix get metric from different metric name but correct dataset name.
* Fix mmedit dataset incorrect
* Fix test yaml of mmedit
* Fix lint
* Fix mmpose can't find metric
* Improve mmseg trt testing config
* Add dataset in mmdet test yaml
* Add logs when continue in the code
* Fix mmpose get metric log error
* Fix mmdet can not get metric
* Add merge report into one
* Fix lint
* Add version in the report
* log2file for each backend
* Fix lint
* Improve report merge
* update mmseg yml to shape 1024x2048
* Fix dependences for merging report
* Imporve mmcls yaml, add `ShuffleNetV1` and `ShuffleNetV2`
* Fix name of model in test yaml with a space will crash when convert
* Add commons for test yaml metric tolerance
* Add mmdet seg detail config in test yaml
* Improve mmdet test yaml
* Fix mmdet mskrcnn metric
Co-authored-by: maningsheng <mnsheng@yeah.net>
2022-04-28 08:03:59 +08:00
tpoisonooo
2c2d1e5ad9
feat(codebase/cls): support vision_transformer ( #403 )
...
* feat(codebase/cls): support vision_transformer
* style(onnx2ncnn): format cpp code, upgrade mmcls version
* fix(CI): upgrade mmcv to 1.4.2
* fix(onnx2ncnn): offset out of range during fuse conv reshape
* docs(vision_transformer.py): update VisionTransformer desc
* docs(onnx2ncnn.cpp): add more comment
* feat(onnx2ncnn.cpp): revert fuse weight
* docs(onnx2ncnn.cpp): add more comment
* test(vision_transformer): add test case
* refactor(vision_transformer.py): use symbol rewrite layer_norm
* refactor(vision_transformer): fix review
* fix(attention): add missing files
2022-04-26 18:00:38 +08:00
Yue Zhou
01a44c00c9
Add roi_align_rotated op for onnxruntime ( #277 )
...
* init
* add doc
* add
* Update test_ops.py
* fix bug
* fix pose demo and windows build (#307 )
* add postprocessing_masks gpu version (#276 )
* add postprocessing_masks gpu version
* default device cpu
* pre-commit fix
Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>
* fixed a bug causes text-recognizer to fail when (non-NULL) empty bboxes list is passed (#310 )
* [Fix] include missing <type_traits> for formatter.h (#313 )
* fix formatter
* relax GCC version requirement
* fix lint
* Update onnxruntime.md
* fix lint
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: Shengxi Li <982783556@qq.com>
Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
2022-04-26 17:46:28 +08:00
qiufeng
aa536ec2fd
[Feature] Add mmrazor support ( #220 )
...
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* remove roi_align plugin for ORT (#258 )
* remove roi_align plugin
* remove ut
* skip single_roi_extractor UT for ORT in CI
* move align to symbolic and update docs
* recover UT
* resolve comments
* add mmcls example
* add mmcls/mmdet/mmseg and their corresponding tests
* add test data
* simplify test data
* add requirement in optional.txt
* fix setup problem when adding mmrazor requirement
* use get_codebase_config
* change mmrazor requirement
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
2022-04-19 11:31:56 +08:00
Yue Zhou
9411fe0466
Add nms_rotated ort op ( #312 )
...
* fix pose demo and windows build (#307 )
* init
* Update nms_rotated.cpp
* add postprocessing_masks gpu version (#276 )
* add postprocessing_masks gpu version
* default device cpu
* pre-commit fix
Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>
* fixed a bug causes text-recognizer to fail when (non-NULL) empty bboxes list is passed (#310 )
* [Fix] include missing <type_traits> for formatter.h (#313 )
* fix formatter
* relax GCC version requirement
* fix
* fix lint
* fix lint
* [Fix] MMEditing cannot save results when testing (#336 )
* fix show
* lint
* remove redundant codes
* resolve comment
* type hint
* docs(build): fix typo (#352 )
* docs(build): add missing build option
* docs(build): add onnx install
* style(doc): trim whitespace
* docs(build): revert install onnx
* docs(build): add ncnn LD_LIBRARY_PATH
* docs(build): fix path error
* fix openvino export tmp model, add binary flag (#353 )
* init circleci (#348 )
* fix wrong input mat type (#362 )
* fix wrong input mat type
* fix lint
* fix(docs): remove redundant doc tree (#360 )
* fix missing ncnn_DIR & InferenceEngine_DIR (#364 )
* update doc
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: Shengxi Li <982783556@qq.com>
Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: tpoisonooo <khj.application@aliyun.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
2022-04-18 17:14:47 +08:00
hanrui1sensetime
c54d574a10
[Enhancement] Support ncnn vulkan ( #318 )
...
* support ncnn_vulkan
* fix some comments
* avoid bc breaking
* add default value of config
2022-04-14 22:12:17 +08:00
maningsheng
e96077feea
bump to v0.5.0
2022-04-02 11:49:52 +08:00
lvhan028
9306bcec80
Dev v0.4.0 ( #301 )
...
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* remove roi_align plugin for ORT (#258 )
* remove roi_align plugin
* remove ut
* skip single_roi_extractor UT for ORT in CI
* move align to symbolic and update docs
* recover UT
* resolve comments
* [Enhancement]: Support fcn_unet deployment with dynamic shape (#251 )
* support mmseg fcn+unet dynamic shape
* add test
* fix ci
* fix units
* resolve comments
* [Enhancement] fix-cmake-relocatable (#223 )
* require user to specify xxx_dir
* fix line ending
* fix end-of-file-fixer
* try to fix ld cudart cublas
* add ENV var search
* fix CMAKE_CUDA_COMPILER
* cpu, cuda should all work well
* remove commented code
* fix ncnn example find ncnn package (#282 )
* table format is wrong (#283 )
* update pre-commit (#284 )
* update pre-commit
* fix clang-format
* fix mmseg config (#281 )
* fix mmseg config
* fix mmpose evaluate outputs
* fix lint
* update pre-commit config
* fix lint
* Revert "update pre-commit config"
This reverts commit c3fd71611f
.
* miss code symbol (#296 )
* refactor cmake build (#295 )
* add-mmpose-sdk (#259 )
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* add-mmpose-codebase
* fix ci
* fix img_shape after TopDownAffine
* rename TopDown module -> XheadDecode & implement regression decode
* align keypoints_from_heatmap
* remove hardcode keypoint_head, need refactor, current only support topdown config
* add mmpose python api
* update mmpose-python code
* can't clip fake box
* fix rebase error
* fix rebase error
* link mspn decoder to base decoder
* fix ci
* compile with gcc7.5
* remove no use code
* fix
* fix prompt
* remove unnecessary cv::parallel_for_
* rewrite TopdownHeatmapMultiStageHead.inference_model
* add comment
* add more detail docstring why use _cs2xyxy in sdk backend
* fix Registry name
* remove no use param & add comment of output result
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
* update faq about WinError 1455 (#297 )
* update faq about WinError 1455
* Update faq.md
* Update faq.md
* fix ci
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
* [Feature]Support centerpoint (#252 )
* bump version to v0.4.0
* [Enhancement] Make rewriter more powerful (#150 )
* Finish function tests
* lint
* resolve comments
* Fix tests
* docstring & fix
* Complement informations
* lint
* Add example
* Fix version
* Remove todo
Co-authored-by: RunningLeon <mnsheng@yeah.net>
* Torchscript support (#159 )
* support torchscript
* add nms
* add torchscript configs and update deploy process and dump-info
* typescript -> torchscript
* add torchscript custom extension support
* add ts custom ops again
* support mmseg unet
* [WIP] add optimizer for torchscript (#119 )
* add passes
* add python api
* Torchscript optimizer python api (#121 )
* add passes
* add python api
* use python api instead of executable
* Merge Master, update optimizer (#151 )
* [Feature] add yolox ncnn (#29 )
* add yolox ncnn
* add ncnn android performance of yolox
* add ut
* fix lint
* fix None bugs for ncnn
* test codecov
* test codecov
* add device
* fix yapf
* remove if-else for img shape
* use channelshuffle optimize
* change benchmark after channelshuffle
* fix yapf
* fix yapf
* fuse continuous reshape
* fix static shape deploy
* fix code
* drop pad
* only static shape
* fix static
* fix docstring
* Added mask overlay to output image, changed fprintf info messages to … (#55 )
* Added mask overlay to output image, changed fprintf info messages to stdout
* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds
* clang-format
* Support UNet in mmseg (#77 )
* Repeatdataset in train has no CLASSES & PALETTE
* update result for unet
* update docstring for mmdet
* remove ppl for unet in docs
* fix ort wrap about input type (#81 )
* Fix memleak (#86 )
* delete []
* fix build error when enble MMDEPLOY_ACTIVE_LEVEL
* fix lint
* [Doc] Nano benchmark and tutorial (#71 )
* add cls benchmark
* add nano zh-cn benchmark and en tutorial
* add device row
* add doc path to index.rst
* fix typo
* [Fix] fix missing deploy_core (#80 )
* fix missing deploy_core
* mv flag to demo
* target link
* [Docs] Fix links in Chinese doc (#84 )
* Fix docs in Chinese link
* Fix links
* Delete symbolic link and add links to html
* delete files
* Fix link
* [Feature] Add docker files (#67 )
* add gpu and cpu dockerfile
* fix lint
* fix cpu docker and remove redundant
* use pip instead
* add build arg and readme
* fix grammar
* update readme
* add chinese doc for dockerfile and add docker build to build.md
* grammar
* refine dockerfiles
* add FAQs
* update Dpplcv_DIR for SDK building
* remove mmcls
* add sdk demos
* fix typo and lint
* update FAQs
* [Fix]fix check_env (#101 )
* fix check_env
* update
* Replace convert_syncbatchnorm in mmseg (#93 )
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv
* change logger
* [Doc] Update FAQ for TensorRT (#96 )
* update FAQ
* comment
* [Docs]: Update doc for openvino installation (#102 )
* fix docs
* fix docs
* fix docs
* fix mmcv version
* fix docs
* rm blank line
* simplify non batch nms (#99 )
* [Enhacement] Allow test.py to save evaluation results (#108 )
* Add log file
* Delete debug code
* Rename logger
* resolve comments
* [Enhancement] Support mmocr v0.4+ (#115 )
* support mmocr v0.4+
* 0.4.0 -> 0.4.1
* fix onnxruntime wrapper for gpu inference (#123 )
* fix ncnn wrapper for ort-gpu
* resolve comment
* fix lint
* Fix typo (#132 )
* lock mmcls version (#131 )
* [Enhancement] upgrade isort in pre-commit config (#141 )
* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87
* fix lint
* remove .isort.cfg and put its known_third_party to setup.cfg
* Fix ci for mmocr (#144 )
* fix mmocr unittests
* remove useless
* lock mmdet maximum version to 2.20
* pip install -U numpy
* Fix capture_output (#125 )
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* configs for all tasks
* use torchvision roi align
* remote unnecessary code
* fix ut
* fix ut
* export
* det dynamic
* det dynamic
* add ut
* fix ut
* add ut and docs
* fix ut
* skip torchscript ut if no ops available
* add torchscript option to build.md
* update benchmark and resolve comments
* resolve conflicts
* rename configs
* fix mrcnn cuda test
* remove useless
* add version requirements to docs and comments to codes
* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN
* rebase
* update example for torchscript.md
* update FAQs for torchscript.md
* resolve comments
* only use torchvision roi_align for torchscript
* fix ut
* use torchvision roi align when pool model is avg
* resolve comments
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
* Update supported mmseg models (#181 )
* fix ocrnet cascade decoder
* update mmseg support models
* update mmseg configs
* support emanet and icnet
* set max K of TopK for tensorrt
* update supported models for mmseg in docs
* add test for emamodule
* add configs and update docs
* Update docs
* update benchmark
* [Features]Support mmdet3d (#103 )
* add mmdet3d code
* add code
* update code
* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model
* add tensorrt config
* fix config
* update
* support for tensorrt
* add config
* fix config`
* fix apis about torch2onnx
* update
* mmdet3d deploy version1.0
* map is ok
* fix code
* version1.0
* fix code
* fix visual
* fix bug
* tensorrt support success
* add docstring
* add docs
* fix docs
* fix comments
* fix comment
* fix comment
* fix openvino wrapper
* add unit test
* fix device about cpu
* fix comment
* fix show_result
* fix lint
* fix requirments
* remove ci about det3d
* fix ut
* add ut data
* support for new version pointpillars
* fix comment
* fix support_list
* fix comments
* fix config name
* [Enhancement] Update pad logic in detection heads (#168 )
* pad with register
* fix lint
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178 )
* Add mo args.
* [Docs]: update docs and argument descriptions (#196 )
* bump version to v0.4.0
* update docs and argument descriptions
* revert version change
* fix unnecessary change of config for dynamic exportation (#199 )
* fix mmcls get classes (#215 )
* fix mmcls get classes
* resolve comment
* resolve comment
* Add ModelOptimizerOptions.
* Fix merge bugs.
* Update mmpose.md (#224 )
* [Dostring]add example in apis docstring (#214 )
* add example in apis docstring
* add backend example in docstring
* rm blank line
* Fixed get_mo_options_from_cfg args
* fix l2norm test
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
* [Enhancement] Switch to statically typed Value::Any (#209 )
* replace std::any with StaticAny
* fix __compare_typeid
* remove fallback id support
* constraint on traits::TypeId<T>::value
* fix includes
* support for centerpoint
* [Enhancement] TensorRT DCN support (#205 )
* add tensorrt dcn support
* fix lint
* add docstring and dcn model support
* add centerpoint ut and docs
* add config and fix input rank
* fix merge error
* fix a bug
* fix comment
* [Doc] update benchmark add supported-model-list (#286 )
* update benchmark add supported-model-list
* fix lint
* fix lint
* loc mmocr maximum version
* fix ut
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
2022-04-01 18:14:23 +08:00