Commit Graph

32 Commits (3ca452f7ef9fdd533e6d6bcb1c0536035e9b7042)

Author SHA1 Message Date
lzhangzz 5c596e1fd4
fix ncnn (#187) 2022-02-28 15:32:51 +08:00
lzhangzz 640aa03538
Support Windows (#106)
* minor changes

* support windows

* fix GCC build

* fix lint

* reformat

* fix Windows build

* fix GCC build

* search backend ops for onnxruntime

* fix lint

* fix lint

* code clean-up

* code clean-up

* fix clang build

* fix trt support

* fix cmake for ncnn

* fix cmake for openvino

* fix SDK Python API

* handle ops for other backends (ncnn, trt)

* handle SDK Python API library location

* robustify linkage

* fix cuda

* minor fix for openvino & ncnn

* use CMAKE_CUDA_ARCHITECTURES if set

* fix cuda preprocessor

* fix misc

* fix pplnn & pplcv, drop support for pplcv<0.6.0

* robustify cmake

* update build.md (#2)

* build dynamic modules as module library & fix demo (partially)

* fix candidate path for mmdeploy_python

* move "enable CUDA" to cmake config for demo

* refine demo cmake

* add comment

* fix ubuntu build

* revert docs/en/build.md

* fix C API

* fix lint

* Windows build doc (#3)

* check in docs related to mmdeploy build on windows

* update build guide on windows platform

* update build guide on windows platform

* make path of thirdparty libraries consistent

* make path consistency

* correct build command for custom ops

* correct build command for sdk

* update sdk build instructions

* update doc

* correct build command

* fix lint

* correct build command and fix lint

Co-authored-by: lvhan <lvhan@pjlab.org>

* trailing whitespace (#4)

* minor fix

* fix sr sdk model

* fix type deduction

* fix cudaFree after driver shutting down

* update ppl.cv installation warning (#5)

* fix device allocator threshold & fix lint

* update doc (#6)

* update ppl.cv installation warning

* missing 'git clone'

Co-authored-by: chenxin <chenxin2@sensetime.com>
Co-authored-by: zhangli <zhangli@sensetime.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: lvhan <lvhan@pjlab.org>
2022-02-24 20:08:44 +08:00
lvhan028 c74c41bec9
Fix memleak (#86)
* delete []

* fix build error when enble MMDEPLOY_ACTIVE_LEVEL

* fix lint
2022-01-20 15:21:19 +08:00
lzhangzz bb655af629
Add Python wrapper for SDK (#27)
* add python API for detector

* integrate detection

* add python segmentor

* add segmentation support

* add classifier, text-detector, text-recognizer and restorer

* integrate classifier

* integrate textdet, textrecog and restorer

* simplify

* add inst-seg

* fix inst-seg

* integrate inst-seg

* Moidfy _build_wrapper

* better pipeline substitution

* use registry for backend model creation

* build Python module according to C API targets

* minor fix

* move sdk data pipeline to backend_config

* remove debugging lines

* add docstring for SDKEnd2EndModel

* fix type hint

* fix lint

* fix lint

* insert build/lib to sys.path

Co-authored-by: SingleZombie <singlezombie@163.com>
2022-01-13 11:31:51 +08:00
lzhangzz 03ae26c91c
Refactor cuda resize (#45)
* refactor cuda resize

* add warning for ppl.cv < 0.6

* fix code style
2022-01-06 15:19:06 +08:00
Johannes L c6fccd0121
Fixed build using latest ppl.cv master (#40)
* Fixed build on latest ppl.cv master

* clang-format fix
2022-01-05 14:30:57 +08:00
lzhangzz 454d7fdc46
remove csrc/README.md (#8) 2021-12-27 11:35:25 +08:00
lvhan028 d8d3c354c3
correct url. (#4)
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>

Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
2021-12-24 22:16:23 +08:00
lvhan028 d79413fa32
update c-api's comments by following doxygen's guide (#336)
* update c-api's comments by following doxygen's guide

* fix according to review comments
2021-12-24 18:43:26 +08:00
lvhan028 98da5e8ba4
use wrong core's directory when install c++ header files (#330) 2021-12-23 14:31:17 +08:00
q.yao 7bfe1ad886
fix instance-norm tensorrt plugin (#321) 2021-12-22 10:46:03 +08:00
lvhan028 e10a1b7c9e
Add more demos (#305)
* add more examples

* change to restore's output image to BGR

* use BUILD_SHARED_LIBS

* update graph module's cmake

* add condition for spdlog package

* change cmakelists

* update cmakelists

* add device_name in each demo

* remove duplicate cmake function

* use palette to draw segmentation's result

* no need to find_package(pplnn) when use MMDeploy's static libs

* remove MMDeploy_LIBS' dependency on spdlog

* #include <opencv2/imgproc/imgproc.hpp>

* change from mmdeploy_core to mmdeploy::core
2021-12-21 21:32:39 +08:00
lzhangzz 56e32fdf63
improve shape checking (#315) 2021-12-21 20:16:40 +08:00
lzhangzz 43e6714f47
[SDK] Fix asan errors (#308)
* fix several heap-use-after-free bugs

* rebase master

* add option for sanitizers

* rebase master

* fix conflicts
2021-12-21 10:47:21 +08:00
AllentDan 547a160770
Fix cub (#312)
* fix cub path

* use cmake source dir instead
2021-12-20 21:01:32 +08:00
q.yao 270d98a8a2
[Fix] Support ncnn fcos end2end export (#303)
* wtf

* Support fcos ncnn end2end
2021-12-20 12:12:02 +08:00
lvhan028 3be1779e66
Refactor tests (#283)
* fix sdk model's pipeline.json

* resize INT64 mask

* refactor unit tests

* fix api in model.h

* remove 'customs' from meta info

* fix zip model

* fix clang-format issue

* put tc on each backend into a SECTION

* change SECTION title

* add DYNAMIC_SECTION for capi unit test

* change 'devices' to 'device_names'

* change trt to tensorrt

* remove uncessary check

* add color_type 'color_ignore_orientation' which is used in ocr

* 'min_width', 'max_width' and 'backend' might be null in pipeline config

* fix clang-format issue

* remove useless code
2021-12-17 19:57:37 +08:00
q.yao 75a9ffa611
fix ncnn linear (#299)
* fix ncnn linear

* lstm rewriter

* fix lint

* add comment
2021-12-17 14:12:37 +08:00
q.yao e54d607f24
[SDK] Add OpenVINO SDK support (#257)
* Add OpenVINO SDK support

* fix reshape

* remove resize input
2021-12-17 13:45:32 +08:00
hanrui1sensetime 3e8237d8bb
[Feature] Support end2end mmdet2.19 retina mobilessd (#286)
* support end2end mmdet2.19 retina mobilessd

* fix yapf

* add end2end fsaf

* fix lint

* fix comments

* fix lint

* add static configs

* fix docformatter

* move ssdhead

* add rewrite for l2norm

* fix ncnn ssd

* fix isort

* rename config

* add ssd_head_ut

* fix string

* align ssd

* remove unused bbox rewriter

Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: maningsheng <mnsheng@yeah.net>
2021-12-17 10:46:54 +08:00
lvhan028 f807346592
[SDK] update ppl.cv to latest version and use it's cmake package (#294) 2021-12-16 16:33:14 +08:00
lzhangzz a494a6f6ff
[SDK] sync changes according to performance benchmarks (#297)
* sync SDK changes according to performance benchmarks

* fix end-of-file lint

* fix clang-format issue

* fix clang-format by adding 'clang-format off'

* remove useless casts

* remove 'data' argument of 'operator()'

* change 'Tensor2Img' to 'TensorToImg' according to spec

* correct tensor's name according spec

Co-authored-by: lvhan028 <lvhan_028@163.com>
2021-12-16 13:51:22 +08:00
lvhan028 75b5939471
add ncnn custom ops to sdk (#284) 2021-12-15 21:34:32 +08:00
q.yao bd2867178d
Disable scatternd in TRT8+ (#277) 2021-12-13 16:43:22 +08:00
lvhan028 25a5838080
change trt to tensorrt and ort to onnxruntime according to sdk model spec (#282)
* change trt to tensorrt and ort to onnxruntime according to sdk model spec

* change ort to onnxruntime in config files
2021-12-13 14:58:01 +08:00
lvhan028 1948af6d06
eliminate inline template when build using release mode (#268) 2021-12-09 17:35:41 +08:00
q.yao 0897139744
[Fix] Fix onnx multiple domain registry (#270)
* Fix onnx multiple domain registry

* recover test args

* remove wrong status

* replace map with unordered_map

* add symbolic rewriter
2021-12-09 17:35:28 +08:00
AllentDan d5c3be9739
[Fix] Apply kernel loop for bicubic interpolate (#271) 2021-12-09 12:56:32 +08:00
hanrui1sensetime 30af457b5e
[Feature] Support mobilenetv2ssdlite ncnn end2end deployment. (#259)
* support ssdlitemobilenetv2

* fix yapf

* fix ut try

* fix ut try

* try to fix ut

* fix ut general 320->128

* move onnx ops to mmcv

* fix lint

* fix docformatter

* increase doc coverage

* refact self defined ops

* fix yapf

* add description

* fix isort

* fix comments

* fix comments

* fix lint

* sigmoid after concat
2021-12-09 11:55:38 +08:00
RunningLeon d96ee9e9f3
Change op domain (#262)
* change domain to mmdeploy

* update tests

* resolve comments
2021-12-08 15:06:41 +08:00
q.yao 8f769e2355
Fix ncnn_ext build error (#258) 2021-12-07 17:00:39 +08:00
lvhan028 36124f6205
Merge sdk (#251)
* check in cmake

* move backend_ops to csrc/backend_ops

* check in preprocess, model, some codebase and their c-apis

* check in CMakeLists.txt

* check in parts of test_csrc

* commit everything else

* add readme

* update core's BUILD_INTERFACE directory

* skip codespell on third_party

* update trt_net and ort_net's CMakeLists

* ignore clion's build directory

* check in pybind11

* add onnx.proto. Remove MMDeploy's dependency on ncnn's source code

* export MMDeployTargets only when MMDEPLOY_BUILD_SDK is ON

* remove useless message

* target include directory is wrong

* change target name from mmdeploy_ppl_net to mmdeploy_pplnn_net

* skip install directory

* update project's cmake

* remove useless code

* set CMAKE_BUILD_TYPE to Release by force if it isn't set by user

* update custom ops CMakeLists

* pass object target's source lists

* fix lint end-of-file

* fix lint: trailing whitespace

* fix codespell hook

* remove bicubic_interpolate to csrc/backend_ops/

* set MMDEPLOY_BUILD_SDK OFF

* change custom ops build command

* add spdlog installation command

* update docs on how to checkout pybind11

* move bicubic_interpolate to backend_ops/tensorrt directory

* remove useless code

* correct cmake

* fix typo

* fix typo

* fix install directory

* correct sdk's readme

* set cub dir when cuda version < 11.0

* change directory where clang-format will apply to

* fix build command

* add .clang-format

* change clang-format style from google to file

* reformat csrc/backend_ops

* format sdk's code

* turn off clang-format for some files

* add -Xcompiler=-fno-gnu-unique

* fix trt topk initialize

* check in config for sdk demo

* update cmake script and csrc's readme

* correct config's path

* add cuda include directory, otherwise compile failed in case of tensorrt8.2

* clang-format onnx2ncnn.cpp

Co-authored-by: zhangli <lzhang329@gmail.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
2021-12-07 10:57:55 +08:00