mirror of
https://github.com/open-mmlab/mmdeploy.git
synced 2025-01-14 08:09:43 +08:00
e05521c933
* add * change VulkanSDK to 1.2.176.1 * add ncnn cmakelist * add ncnn source code as third party * add all ncnn * ncnn compile passed * onnx2ncnn correctly * fix code style * merge_as_grimoire_design, only backend_ops, manually register. * remove data and test sh * remove build example * remove config ncnn * remove onnx2ncnn intermediate files * remove other files auto-generated * remove vulkan tools * remove Vulkan, gitignore new rules, __init__ new lines * rollback __init__ to grimoire * remove pytorch version pending * grimoire comments reply 1, 3, 4 * reply comment 5,6,7 * add auto definer, add python register * fix lint * add ncnn deploy support * add model_wrapper, fix a typo bug, and add code comment for onnx2ncnn(WIP) * add model wrapper ncnn * fix lint * fix pep8 * fix pre-commit-config.yaml paths * fix import * fix lint * remove sys.path.append * remove sys * isort fix * fix double quoted * fix trailing space * try fix isort * fix clang-format-9 * fix requests * fix all comments * Fix typo * test code for grimoire * fix ops register * new definere * fix visualization of mmcls * remove temp * fix flake8 * fix seed-isort-config * fix thirdparty * fix thirdparty * fix yapf * fix third_party_sort * fix third party * fix clang-format * try fix clang-format * try to fix clang format 9 customreshape * try fix clang-format-9 * try fix clang-format-9 * try fix clang-format-9 * try fix ext * fix onnx2ncnn * Fix comments * Fix Comments * Fix Comments * Fix Comments * Fix conflict * Fix flake8 * Update .isort.cfg * Update ncnn_ext.cpp * Update ncnn_ext.cpp * fix missing ncnn backend code * delete out of date comments of gather.cpp * add DeployBaseClassifier * add return -100 error * clear out-of-date to do comments Co-authored-by: 韩睿 <SENSETIME\hanrui1@cn0614008774l.domain.sensetime.com> Co-authored-by: grimoire <yaoqian@sensetime.com> Co-authored-by: grimoire <streetyao@live.com>
MMDeployment
Installation
-
Build backend ops
-
update submodule
git submodule update --init -
Build with onnxruntime support
mkdir build cd build cmake -DBUILD_ONNXRUNTIME_OPS=ON -DONNXRUNTIME_DIR=${PATH_TO_ONNXRUNTIME} .. make -j10 -
Build with tensorrt support
mkdir build cd build cmake -DBUILD_TENSORRT_OPS=ON -DTENSORRT_DIR=${PATH_TO_TENSORRT} .. make -j10 -
Or you can add multiple flags to build multiple backend ops.
-
-
Setup project
python setup.py develop
Usage
python ./tools/deploy.py \
${DEPLOY_CFG_PATH} \
${MODEL_CFG_PATH} \
${MODEL_CHECKPOINT_PATH} \
${INPUT_IMG} \
--work-dir ${WORK_DIR} \
--device ${DEVICE} \
--log-level INFO