mirror of https://github.com/open-mmlab/mmdeploy.git synced 2025-01-14 08:09:43 +08:00

Go to file

[Unittest]: Add ncnn test exporter and topk test (#84 )

* add ncnn test exporter in test_ops.py

* add ncnn test exporter in utils.py

* fix ncnn unittest

* fix lint

* fix lint

* fix lint isort

* remove ncnn roi_align pytest

* add ncnn topk unittest

* update to new api

* fix lint

* add comments

* skip class

* skip ncnn

Co-authored-by: hanrui1sensetime <hanrui1@sensetime.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>

2021-09-28 14:20:04 +08:00

.github/workflows

[Fix]: fix ignoring test_ops (#102 )

2021-09-27 19:10:18 +08:00

backend_ops

fix void pointer arithmetic (#98 )

2021-09-27 10:52:26 +08:00

configs

[Feature] Add tensorrt single stage partition (#88 )

2021-09-23 15:49:36 +08:00

docs

[Feature] Refactor v1 (#56 )

2021-09-01 15:43:49 +08:00

mmdeploy

[Feature]: Update github CI (#100 )

2021-09-27 17:43:41 +08:00

requirements

[Feature]: Update github CI (#100 )

2021-09-27 17:43:41 +08:00

tests

[Unittest]: Add ncnn test exporter and topk test (#84 )

2021-09-28 14:20:04 +08:00

third_party

[Feature] Add TensorRT batched NMS support (#3 )

2021-06-25 19:31:16 +08:00

tools

[Enhance]: Logging trace info for debugging in deploy tool (#93 )

2021-09-24 19:09:39 +08:00

.gitignore

…

.gitmodules

[Feature] Add TensorRT batched NMS support (#3 )

2021-06-25 19:31:16 +08:00

.isort.cfg

[Feature] Refactor v1 (#56 )

2021-09-01 15:43:49 +08:00

.pre-commit-config.yaml

…

.pylintrc

add pylintrc (#81 )

2021-09-16 11:04:56 +08:00

CMakeLists.txt

[Feature] Merge NCNN deployment to grimoire based on mmcls - revert [#25 ](https://github.com/grimoire/deploy_prototype/pull/25 ) (#30 )

2021-08-05 14:06:47 +08:00

LICENSE

…

MANIFEST.in

[Refactor] Refactor config v1 (#80 )

2021-09-16 10:26:09 +08:00

README.md

[Docs] Add docs of ncnn deployment (#33 )

2021-08-10 17:04:58 +08:00

requirements.txt

[Refactor] Refactor config v1 (#80 )

2021-09-16 10:26:09 +08:00

setup.cfg

add type annotation

2021-06-16 15:36:58 +08:00

setup.py

[Refactor] Refactor config v1 (#80 )

2021-09-16 10:26:09 +08:00

README.md

MMDeployment

Installation

Build backend ops

update submodule
```
git submodule update --init
```

Build with onnxruntime support

mkdir build
cd build
cmake -DBUILD_ONNXRUNTIME_OPS=ON -DONNXRUNTIME_DIR=${PATH_TO_ONNXRUNTIME} ..
make -j10

Build with tensorrt support

mkdir build
cd build
cmake -DBUILD_TENSORRT_OPS=ON -DTENSORRT_DIR=${PATH_TO_TENSORRT} ..
make -j10

Build with ncnn support

mkdir build
cd build
cmake -DBUILD_NCNN_OPS=ON -DNCNN_DIR=${PATH_TO_NCNN} ..
make -j10

Or you can add multiple flags to build multiple backend ops.

Setup project
```
python setup.py develop
```

Usage

python ./tools/deploy.py \
    ${DEPLOY_CFG_PATH} \
    ${MODEL_CFG_PATH} \
    ${MODEL_CHECKPOINT_PATH} \
    ${INPUT_IMG} \
    --work-dir ${WORK_DIR} \
    --device ${DEVICE} \
    --log-level INFO

Languages

Python 46.6%

C++ 41.3%

Cuda 4.4%

CMake 2%

C# 1.9%

Other 3.8%