Li Zhang
f2be2abeb5
[Feature] Add Cond node and pose tracker demo ( #1186 )
...
* add Cond node
* WIP PoseTracker
* fix pose tracker
* minor fix
* simplify design
* add timing
* sync
* visualize
* remove file check
2022-10-27 14:52:04 +08:00
lvhan028
f051a31e0f
make onnxruntime(gpu) available in SDK ( #1253 )
2022-10-26 19:23:42 +08:00
AllentDan
3eb60ea584
[Feature] Add RKNN support to SDK ( #1145 )
...
* add rknn_net [WIP]
* add cmake
* enable mmcls
* remove toTensor in SDK pipeline
* update doc
* translate to Chinese
* update doc and add tool-chain cmake
* use ::framework
* fix lint
* doc and print log
* data map
* refine install doc
* add rknpu2 workflow
* update gcc yaml
* better cmake file
* update doc link
* use vector instead of array
* better env variable
* use soft link
* release ctx
* name rule
2022-10-18 17:52:31 +08:00
Jiahao Sun
8e634059a1
[Feat] Support Monocular 3D Detection and FCOS3D Deployment ( #1047 )
...
* add monodet task
* format monodet
* format monodet
* sort test_monocular_detection_model.py import
* add fcos3d deploy
* change doc support model & fcos3d UT
* fix test monodet UT bug & remove ONNXBEVNMS op
2022-10-18 11:23:39 +08:00
tpoisonooo
ace44ae9d9
improvement(scripts): cross build aarch64 ( #1126 )
...
* udpate
* update
* CI(scripts): add auto cross build aarch64
* docs(scripts): add zh_cn doc
* docs(scripts): update
* docs(scripts): update
* fix(tools): update
* docs(zh_cn): update
* fix(scripts): remove gcc-7
* docs(scripts): update result
* udpate
* fix(tools): remove useless option
* docs(en): typo
* Update cross_build_aarch64.md
* Update cross_build_aarch64.md
* fix(tools/scripts): review advices
* fix(tools/scripts): update
* fix(cmake): remove useless option
* Update aarch64-linux-gnu.cmake
2022-10-17 11:15:29 +08:00
Li Zhang
8c164ab3e5
[Fix] Detect filesystem library in CMake ( #1190 )
...
* detect filesystem library in CMake
* add filesystem.cmake
2022-10-14 12:52:16 +08:00
Li Zhang
f389a68dd4
[Enhancement] Add a device field for mmdeploy_mat_t ( #1176 )
...
* add device field for mmdeploy_mat_t
* fix lint
2022-10-11 13:58:49 +08:00
tpoisonooo
5cdf29339b
feat(tools/scripts): add auto install jetson orin ( #1105 )
...
* feat(tools/scripts): add auto install jetson orin
* docs(script): rename file
* fix(script): if clause error
* style(scripts): typo
2022-10-09 15:53:19 +08:00
lvhan028
613acb366c
fix prebuilt error ( #1123 )
2022-09-28 17:52:09 +08:00
Chen Xin
0720ed8404
fix tracer ( #1107 )
2022-09-27 15:24:57 +08:00
Li Zhang
bf887cc8bc
[Enhancement] Refactor SDK pipeline ( #938 )
...
* unify C API naming
* fix demo and move apis/c/* -> apis/c/mmdeploy/*
* fix lint
* WIP refactor pipeline
* backward compatibility
* working pipeline demo
* add text det-recog demo
* add det-pose demo
* fix build
* fix demo
* add environment interface
* add environment to pass scheduler & model info at runtime
* update demos
* add pipeline API for Python
* fix `FromPyObject`
* fix for opencv-4.2
* environment -> context, improve pipeline
* python model interface
* fix cmake
* fix python & cmake
* context & C++ pipeline API
* minor fix
* improve API
* fix shared libs
* refresh C/Python API
* propagate context
* fix python demo
* fix
* add namespace
* fix namespace
* fix mis-changed strings
* fix
* fix python api
* rename
* clean-up
* fix pose detector
* clean-up
* clean-up
* clean-up
* fix python API build
* fix CI
* fix lint
* fix lint
* fix lint & demo
* install pipeline.hpp
* fix MSVC shared library build
* fix sample
* fix MSVC monolithic build
* minor fix
2022-09-26 16:11:14 +08:00
q.yao
0caeaf238c
[CustomOps] TensorRT Gather Topk Ops ( #1033 )
...
* add gather topk
* add shape inference and document
* fix faster rcnn
* reshape topk
* fix
2022-09-19 13:48:26 +08:00
Li Zhang
b602356181
[Fix] Add isolated option for TorchScript SDK backend ( #1002 )
...
* add option for TorchScript SDK backend
* add doc
* format
2022-09-06 12:24:07 +08:00
Chen Xin
6b01a2e649
[Feature] Add option to fuse transform. ( #741 )
...
* add collect_impl.cpp to cuda device
* add dummy compute node wich device elena
* add compiler & dynamic library loader
* add code to compile with gen code(elena)
* move folder
* fix lint
* add tracer module
* add license
* update type id
* add fuse kernel registry
* remove compilier & dynamic_library
* update fuse kernel interface
* Add elena-mmdeploy project in 3rd-party
* Fix README.md
* fix cmake file
* Support cuda device and clang format all file
* Add cudaStreamSynchronize for cudafree
* fix cudaStreamSynchronize
* rename to __tracer__
* remove unused code
* update kernel
* update extract elena script
* update gitignore
* fix ci
* Change the crop_size to crop_h and crop_w in arglist
* update Tracer
* remove cond
* avoid allocate memory
* add build.sh for elena
* remove code
* update test
* Support bilinear resize with float input
* Rename elena-mmdeploy to delete
* Introduce public submodule
* use get_ref
* update elena
* update tools
* update tools
* update fuse transform docs
* add fuse transform doc link to get_started
* fix shape in crop
* remove fuse_transform_ == true check
* remove fuse_transform_ member
* remove elena_int.h
* doesn't dump transform_static.json
* update tracer
* update CVFusion to remove compile warning
* remove mmcv version > 1.5.1 dep
* fix tests
* update docs
* add elena use option
* remove submodule of CVFusion
* update doc
* use auto
* use throw_exception(eEntryNotFound);
* update
Co-authored-by: cx <cx@ubuntu20.04>
Co-authored-by: miraclezqc <969226879@qq.com>
2022-09-05 20:29:18 +08:00
Chen Xin
a0fb3be0df
support coreml ( #760 )
...
* sdk inference
* fix typo
* fix typo
* add convert things
* fix missling name
* add cls support
* add more pytorch rewriter
* add det support
* support det wip
* make Model export model_path
* fix nms
* add output back
* add docstring
* fix lint
* add coreml build action
* add zh docs
* add coreml backend check
* update ci
* update
* update
* update
* update
* update
* fix lint
* update configs
* add return value when error occured
* update docs
* update docs
* update docs
* fix lint
* udpate docs
* udpate docs
* update
Co-authored-by: grimoire <streetyao@live.com>
2022-09-05 19:55:47 +08:00
q.yao
9541be9c0b
TensorRT dot product attention ops ( #949 )
...
* add detr support
* fix softmax
* add placeholder
* add implement
* add docs and ut
* update testcase
* update docs
* update docs
2022-09-05 18:25:39 +08:00
Li Zhang
792c27b054
[Feature] Ascend backend ( #747 )
...
* add acl backend
* support dynamic batch size and dynamic image size
* add preliminary ascend backend
* support dtypes other than float
* support dynamic_dims in SDK
* fix dynamic batch size
* better error handling
* remove debug info
* [WIP] dynamic shape support
* fix static shape
* fix dynamic batch size
* add retinanet support
* fix dynamic image size
* fix dynamic image size
* fix dynamic dims
* fix dynamic dims
* simplify config files
* fix yolox support
* fix negative index
* support faster rcnn
* add seg config
* update benchmark
* fix onnx2ascend dynamic shape
* update docstring and benchmark
* add unit test, update documents
* fix wrapper
* fix ut
* fix for vit
* error handling
* context handling & multi-device support
* build with stub libraries
* add ci
* fix lint
* fix lint
* update doc ref
* fix typo
* down with `target_link_directories`
* setup python
* makedir
* fix ci
* fix ci
* remove verbose logs
* fix UBs
* export Error
* fix lint
* update checkenv
Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
gy77
638e33a964
add_multi_label_postprocess ( #950 )
...
* 'add_multi_label_postprocess'
* fix pre-commit
* delete partial_sort
* delete idx
* delete num_classes and num_classes_
* Fix right brackets and spelling errors in lines 19 and 20
Co-authored-by: gaoying <gaoying@xiaobaishiji.com>
2022-08-30 19:02:42 +08:00
Li Zhang
6c2dde1cf8
[Feature] TorchScript SDK backend ( #890 )
...
* WIP SDK torchscript support
* support detection task
* make torchvision optional
* force link torchvision if enabled
* support torch-1.12
* fix export & sync cuda stream
* hide internal classes
* handle error
* set `MMDEPLOY_USE_CUDA` when CUDA is enabled
2022-08-29 18:01:18 +08:00
Chen Xin
c04dcd2c62
Support risc-v platform ( #910 )
...
* add ppl.nn riscv engine
* update ppl.nn riscv engine
* udpate riscv service (ncnn backend)
* update _build_wrapper for ncnn
* fix build
* fix lint
* update default uri
* update file structure & add cn doc
* remove copy input data
* update docs
* remove ncnn server
* fix docs
* update zh doc
* update toolchain
* remove unused
* update doc
* update doc
* update doc
* rename cross build dirname
* add riscv.md to build_from_source.md
* update cls model
* test ci
* test ci
* test ci
* test ci
* test ci
* update ci
* update ci
2022-08-26 13:54:40 +08:00
lvhan028
91a060fdbb
fix mmdeploy_pplnn_net build error when target device is cpu ( #896 )
2022-08-15 14:51:28 +08:00
Li Zhang
ef56036326
fix typo ( #862 )
2022-08-03 18:30:04 +08:00
Chen Xin
3ecee6f376
fix mmpose python api ( #852 )
2022-08-03 11:44:23 +08:00
lvhan028
a15365e93f
[Enhancement] build sdk python api in standard-alone manner ( #810 )
...
* build sdk python api in standard-alone manner
* enable MMDEPLOY_BUILD_SDK_MONOLITHIC and MMDEPLOY_BUILD_EXAMPLES in prebuild config
* link mmdeploy to python target when monolithic option is on
* checkin README to describe precompiled package build procedure
* use packaging.version.parse(python_version) instead of list(python_version)
* fix according to review results
* rebase master
* rollback cmake.in and apis/python/CMakeLists.txt
* reorganize files in install/example
* let cmake detect visual studio instead of specifying 2019
* rename whl name of precompiled package
* fix according to review results
2022-08-02 10:23:48 +08:00
Li Zhang
1d3ce15e35
import algorithm from buffer ( #793 )
2022-08-01 22:18:12 +08:00
tpoisonooo
2968a18d80
feat(tools/deploy.py): support snpe ( #789 )
...
* fix(tools/deploy.py): support snpe
* improvement(backend/snpe): review advices
* docs(backend/snpe): update build
* docs(backend/snpe): server support specify port
* docs(backend/snpe): update path
* fix(backend/snpe): time counter missing argument
* docs(backend/snpe): add missing argument
* docs(backend/snpe): update download and using
* improvement(snpe_net.cpp): load model with modeldata
2022-08-01 11:08:55 +08:00
Li Zhang
f54854ec1c
[Feature] Add C++ API for SDK ( #831 )
...
* add C++ API
* unify result type & add examples
* minor fix
* install cxx API headers
* fix Mat, add more examples
* fix monolithic build & fix lint
* install examples correctly
* fix lint
2022-07-29 14:36:25 +08:00
tpoisonooo
f54da4e73f
improvement(sdk): add sdk code coverage ( #808 )
...
* feat(doc): add CI
* CI(sdk): add sdk coverage
* style(test): code format
* fix(CI): update coverage.info path
* improvement(CI): use internal image
* improvement(CI): push coverage info once
2022-07-29 13:57:54 +08:00
lvhan028
2c18fbd2c8
[Enhancement] support kwargs in SDK python bindings ( #794 )
...
* support-kwargs
* make '__call__' as single image inference and add 'batch' API to deal with batch images inference
* fix linting error and typo
* fix lint
2022-07-29 12:32:42 +08:00
Chen Xin
b6b22a1b6f
[Feature] support build single sdk library ( #806 )
...
* build single lib for c api
* update csharp doc & project
* update test build
* fix test build
* fix
2022-07-28 14:07:48 +08:00
q.yao
b763611cad
[Fix] Fix setup on non-linux-x64 ( #811 )
...
* fix setup
* replace long to int64_t
2022-07-27 20:33:52 +08:00
Li Zhang
bfd46c1c68
[Fix] Support macOS build ( #762 )
...
* fix macOS build
* fix missing
2022-07-26 21:54:49 +08:00
q.yao
0e1a3aa8c7
[Feature] support MMRotate model with le135 ( #788 )
...
* support MMRotate model with le135
* cse before fuse select assign
* remove unused import
2022-07-25 16:01:05 +08:00
q.yao
5b31d7a60d
[Enhancement] Install Optimizer by setuptools ( #690 )
...
* Add fuse select assign pass
* move code to csrc
* add config flag
* Add fuse select assign pass
* Add CSE for ONNX
* remove useless code
* Install optimizer by setup tools
* fix comment
2022-07-25 13:04:27 +08:00
Li Zhang
ab07c223da
[Enhancement] Support latest ppl.nn & ppl.cv ( #564 )
...
* support latest ppl.nn
* fix pplnn for model convertor
* fix lint
* update memory policy
* import algo from buffer
* update ppl.cv
* use `ppl.cv==0.7.0`
* document supported ppl.nn version
* skip pplnn dependency when building shared libs
2022-07-21 11:47:53 +08:00
Li Zhang
c20bb803db
[Fix] reduce log verbosity & improve error reporting ( #755 )
...
* reduce log verbosity & improve error reporting
* improve error reporting
2022-07-20 22:43:15 +08:00
q.yao
4842823fd0
[Enhancement] Add CSE ONNX pass ( #647 )
...
* Add fuse select assign pass
* move code to csrc
* add config flag
* Add fuse select assign pass
* Add CSE for ONNX
* remove useless code
2022-07-19 14:46:14 +08:00
q.yao
dace58e844
[Enhancement] Support Slide Vertex TRT ( #650 )
...
* reorgnize mmrotate
* fix
* add hbb2obb
* add ut
* fix rotated nms
* update docs
* update benchmark
* update test
* remove ort regression test, remove comment
2022-07-13 16:09:09 +08:00
Li Zhang
14b2bfd524
[Enhancement] Standardize C API ( #634 )
...
* unify C API naming
* fix demo and move apis/c/* -> apis/c/mmdeploy/*
* fix lint
* fix C# project
* fix Java API
2022-07-12 14:04:33 +08:00
tpoisonooo
41ddcafbb4
Rename onnx2ncnn to mmdeploy_onnx2ncnn ( #694 )
...
* improvement(tools/onnx2ncnn.py): rename to mmdeploy_onnx2ncnn
* format(tools/deploy.py): clean code
* fix(init_plugins.py): improve if condition
* fix(CI): update target
* fix(test_onnx2ncnn.py): update desc
* Update init_plugins.py
2022-07-08 09:21:32 +08:00
hanrui1sensetime
d57cf85e1d
[Fix] Fix android build ( #698 )
...
* fix android build
* fix cmake
* fix url link
2022-07-07 14:29:45 +08:00
Li Zhang
8f1508e098
[Fix] fix clang build ( #677 )
...
* fix clang build
* fix ndk build
* fix ndk build
* switch to `std::filesystem` for clang-7 and later
2022-06-29 22:01:51 +08:00
q.yao
58584888ee
[Enhancement] Add fuse select assign pass ( #589 )
...
* Add fuse select assign pass
* move code to csrc
* add config flag
* remove bool cast
2022-06-29 14:43:01 +08:00
hanrui1sensetime
051e1577a3
Add java apis and demos ( #563 )
...
* add java classifier detector
* add segmentor
* fix lint
* add ImageRestorer java apis and demo
* remove useless count parameter for Segmentor and Restorer, add PoseDetector
* add RotatedDetection java api and demo
* add Ocr java demo and apis
* remove mmrotate ncnn java api and demo
* fix lint
* sync java api folder after rebase to master
* fix include
* remove record
* fix java apis dir path in cmake
* add java demo readme
* fix lint mdformat
* add test javaapi ci
* fix lint
* fix flake8
* fix test javaapi ci
* refactor readme.md
* fix install opencv for ci
* fix install opencv : add permission
* add all codebases and mmcv install
* add torch
* install mmdeploy
* fix image path
* fix picture path
* fix import ncnn
* fix import ncnn
* add submodule of pybind
* fix pybind submodule
* change download to git clone for submodule
* fix ncnn dir
* fix README error
* simplify the github ci
* fix ci
* fix yapf
* add JNI as required
* fix Capitalize
* fix Capitalize
* fix copyright
* ignore .class changed
* add OpenJDK installation docs
* install target of javaapi
* simplify ci
* add jar
* fix ci
* fix ci
* fix test java command
* debugging what failed
* debugging what failed
* debugging what failed
* add java version info
* install openjdk
* add java env var
* fix export
* fix export
* fix export
* fix export
* fix picture path
* fix picture path
* fix file name
* fix file name
* fix README
* remove java_api strategy
* fix python version
* format task name
* move args position
* extract common utils code
* show image class result
* add detector result
* segmentation result format
* add ImageRestorer result
* add PoseDetection java result format
* fix ci
* stage ocr
* add visualize
* move utils
* fix lint
* fix ocr bugs
* fix ci demo
* fix java classpath for ci
* fix popd
* fix ocr demo text garbled
* fix ci
* fix ci
* fix ci
* fix path of utils ci
2022-06-29 11:02:08 +08:00
q.yao
dc5f9c3746
[Enhancement] TensorRT Anchor generator plugin ( #646 )
...
* custom trt anchor generator
* add ut
* add docstring, update doc
2022-06-28 16:11:24 +08:00
Li Zhang
82a74d8717
simplify Expand ( #617 )
2022-06-27 18:42:57 +08:00
q.yao
0cac5154a6
[Enhancement] Support two-stage rotated detector TensorRT. ( #530 )
...
* upload
* add fake_multiclass_nms_rotated
* delete unused code
* align with pytorch
* Update delta_midpointoffset_rbbox_coder.py
* add trt rotated roi align
* add index feature in nms
* not good
* fix index
* add ut
* add benchmark
* move to csrc/mmdeploy
* update unit test
Co-authored-by: zytx121 <592267829@qq.com>
2022-06-23 10:35:10 +08:00
Chen Xin
f30eacff17
[Fix] fix csharp api detector release result ( #620 )
...
* fix csharp api detector release result
* fix wrong count arg of xxx_release_result in c# api
2022-06-21 19:19:44 +08:00
Li Zhang
ac0b52f12a
add dim param for Tensor::Squeeze ( #603 )
2022-06-17 14:06:35 +08:00
Li Zhang
a822ba7330
add MMDEPLOY_TASKS & simplify demo cmake ( #606 )
...
* add `MMDEPLOY_TASKS` & simply cmake
* remove debug log
2022-06-17 13:56:45 +08:00
