0effa59440
Split demos of C and C++ SDK into two subdirectories ( #1099 )
...
* Split demos of C and C++ SDK into two subdirectories
* Split demos of C and C++ SDK into two subdirectories
* Split demos of C and C++ SDK into two subdirectories
* Split demos of C and C++ SDK into two subdirectories
* Combine add_example
2022-09-27 13:40:04 +08:00
c5e4fcffbc
docs(quantization.md): remove ppq commit ( #1095 )
2022-09-27 12:35:24 +08:00
107ae8499d
docs(jetsons.md): fix desc ( #1090 )
...
* docs(jetsons.md): fix desc
* docs(jetsons.md): update
2022-09-23 10:14:00 +08:00
fbe7586415
Add result of quantization of TextSnake ( #1074 )
...
* Update result of TextSnake
result from https://github.com/BrokenArrow1404/2022-MMLAB-SUMMERCAMP/blob/main/week4/README.md
* Update result of TextSnake
result from https://github.com/BrokenArrow1404/2022-MMLAB-SUMMERCAMP/blob/main/week4/README.md
* Add deploy config for quantization of TextSnake
* repair lint error
2022-09-21 15:28:28 +08:00
1c5dcb799b
[Fix] fix broken link in docs english version write_config.md ( #1078 )
...
* fix typo error for how to write model config link
* Update write_config.md
zh_cn version does not exist
2022-09-20 17:51:19 +08:00
18ccb15b7b
[Feature] Add Hourglass pose detection quantization evaluation result. ( #1066 )
...
Detail results: https://github.com/Qingrenn/mmdeploy-summer-camp/blob/main/week4/result.md
2022-09-19 14:09:46 +08:00
0caeaf238c
[CustomOps] TensorRT Gather Topk Ops ( #1033 )
...
* add gather topk
* add shape inference and document
* fix faster rcnn
* reshape topk
* fix
2022-09-19 13:48:26 +08:00
cbe767efb1
[Fix] Fix docs under supported-backends fold ( #1061 )
...
* fix docs of supported-backends
* fix docs
2022-09-18 13:36:28 +08:00
a1a19f0fc1
Fixed typo for install commands for TensorRT runtime ( #1025 )
...
* Fixed typo for install commands for TensorRT runtime
* Apply typo-fix on 'cn' documentation
Co-authored-by: Tümer Tosik <tumer_t@hotmail.de>
2022-09-15 20:23:07 +08:00
538c9cfbb1
docs(scripts): update auto install desc ( #1036 )
2022-09-14 17:49:29 +08:00
615668ec63
update api in doc ( #1021 )
2022-09-14 17:47:26 +08:00
b310ba8d3e
bump version to v0.8.0 ( #1009 )
2022-09-07 10:53:50 +08:00
b602356181
[Fix] Add isolated option for TorchScript SDK backend ( #1002 )
...
* add option for TorchScript SDK backend
* add doc
* format
2022-09-06 12:24:07 +08:00
124635ec5f
Add RKNN support. ( #865 )
...
* save codes
* support resnet and yolov3
* support yolox
* fix lint
* add mmseg support and a doc
* add UT
* update supported model list
* fix ci
* refine docstring
* resolve comments
* remote output_tensor_type
* resolve comments
* update readme
2022-09-06 11:48:39 +08:00
6b01a2e649
[Feature] Add option to fuse transform. ( #741 )
...
* add collect_impl.cpp to cuda device
* add dummy compute node wich device elena
* add compiler & dynamic library loader
* add code to compile with gen code(elena)
* move folder
* fix lint
* add tracer module
* add license
* update type id
* add fuse kernel registry
* remove compilier & dynamic_library
* update fuse kernel interface
* Add elena-mmdeploy project in 3rd-party
* Fix README.md
* fix cmake file
* Support cuda device and clang format all file
* Add cudaStreamSynchronize for cudafree
* fix cudaStreamSynchronize
* rename to __tracer__
* remove unused code
* update kernel
* update extract elena script
* update gitignore
* fix ci
* Change the crop_size to crop_h and crop_w in arglist
* update Tracer
* remove cond
* avoid allocate memory
* add build.sh for elena
* remove code
* update test
* Support bilinear resize with float input
* Rename elena-mmdeploy to delete
* Introduce public submodule
* use get_ref
* update elena
* update tools
* update tools
* update fuse transform docs
* add fuse transform doc link to get_started
* fix shape in crop
* remove fuse_transform_ == true check
* remove fuse_transform_ member
* remove elena_int.h
* doesn't dump transform_static.json
* update tracer
* update CVFusion to remove compile warning
* remove mmcv version > 1.5.1 dep
* fix tests
* update docs
* add elena use option
* remove submodule of CVFusion
* update doc
* use auto
* use throw_exception(eEntryNotFound);
* update
Co-authored-by: cx <cx@ubuntu20.04>
Co-authored-by: miraclezqc <969226879@qq.com>
2022-09-05 20:29:18 +08:00
ac3a12026d
fix mmdet ut ( #1001 )
2022-09-05 19:56:19 +08:00
a0fb3be0df
support coreml ( #760 )
...
* sdk inference
* fix typo
* fix typo
* add convert things
* fix missling name
* add cls support
* add more pytorch rewriter
* add det support
* support det wip
* make Model export model_path
* fix nms
* add output back
* add docstring
* fix lint
* add coreml build action
* add zh docs
* add coreml backend check
* update ci
* update
* update
* update
* update
* update
* fix lint
* update configs
* add return value when error occured
* update docs
* update docs
* update docs
* fix lint
* udpate docs
* udpate docs
* update
Co-authored-by: grimoire <streetyao@live.com>
2022-09-05 19:55:47 +08:00
9541be9c0b
TensorRT dot product attention ops ( #949 )
...
* add detr support
* fix softmax
* add placeholder
* add implement
* add docs and ut
* update testcase
* update docs
* update docs
2022-09-05 18:25:39 +08:00
e21cad84e0
fix(backend): disable cublaslt for cu102 ( #947 )
...
* fix(backend): disable cublaslt for cu102
* fix
* fix(backend): update
* fix(tensorrt/util.py): add find cuda version
* fix
* fix(CI): first use cmd to get cuda version
* docs(tensorrt/utils.py): update docstring
2022-09-05 14:52:43 +08:00
792c27b054
[Feature] Ascend backend ( #747 )
...
* add acl backend
* support dynamic batch size and dynamic image size
* add preliminary ascend backend
* support dtypes other than float
* support dynamic_dims in SDK
* fix dynamic batch size
* better error handling
* remove debug info
* [WIP] dynamic shape support
* fix static shape
* fix dynamic batch size
* add retinanet support
* fix dynamic image size
* fix dynamic image size
* fix dynamic dims
* fix dynamic dims
* simplify config files
* fix yolox support
* fix negative index
* support faster rcnn
* add seg config
* update benchmark
* fix onnx2ascend dynamic shape
* update docstring and benchmark
* add unit test, update documents
* fix wrapper
* fix ut
* fix for vit
* error handling
* context handling & multi-device support
* build with stub libraries
* add ci
* fix lint
* fix lint
* update doc ref
* fix typo
* down with `target_link_directories`
* setup python
* makedir
* fix ci
* fix ci
* remove verbose logs
* fix UBs
* export Error
* fix lint
* update checkenv
Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
71e64786b7
Fix mmseg pointrend ( #903 )
...
* support mmseg:pointrend
* update docs
* update docs for torchscript
* resolve comments
2022-09-02 10:55:32 +08:00
f4decda86e
[Enhancement] Support DETR ( #924 )
...
* add detr support
* fix softmax
* add reg test, update document
2022-08-30 10:39:10 +08:00
f7e0905e95
docs(convert_model): update description ( #956 )
2022-08-30 10:37:07 +08:00
c04dcd2c62
Support risc-v platform ( #910 )
...
* add ppl.nn riscv engine
* update ppl.nn riscv engine
* udpate riscv service (ncnn backend)
* update _build_wrapper for ncnn
* fix build
* fix lint
* update default uri
* update file structure & add cn doc
* remove copy input data
* update docs
* remove ncnn server
* fix docs
* update zh doc
* update toolchain
* remove unused
* update doc
* update doc
* update doc
* rename cross build dirname
* add riscv.md to build_from_source.md
* update cls model
* test ci
* test ci
* test ci
* test ci
* test ci
* update ci
* update ci
2022-08-26 13:54:40 +08:00
4534598056
improvement(installation): add script install mmdeploy ( #919 )
...
* feat(tools): add build ubuntu x64 ncnn
* ci(tools): add ncnn auto install
* fix(ci): auto install ncnn
* fix(tools): no interactive
* docs(build): add script build
* CI(ncnn): script install ncnn
* docs(zh_cn): fix error os
* fix
* CI(tools/script): test ort install passed
* update
* CI(tools): support pplnn
* CI(build): add pplnn
* docs(tools): update
* fix
* CI(tools): script install torchscript
* docs(build): add torchscript
* fix(tools): clean code and doc
* update
* fix(CI): requirements install failed
* debug CI
* update
* update
* update
* feat(tools/script): support user specify make jobs
* fix(tools/script): fix build pplnn with cuda
* fix(tools/script): torchscript add tips and simplify install mmcv
* fix(tools/script): check nvcc version first
* fix(tools/scripts): pplnn checkout
* fix(CI): add simple check install succcess
* fix
* debug CI
* fix
* fix(CI): pplnn install mis wheel
* fix(CI): build error
* fix(CI): remove misleading message
2022-08-26 13:53:53 +08:00
21775ce584
docs(mmdet3d): give detail model path ( #940 )
2022-08-24 15:11:58 +08:00
0111e1f10f
[Feature] add swin for cls ( #911 )
...
* add swin for cls
* add ut and doc
* reduce trt batch size
* add regression test
* resolve comments
* remove useless rewriting logic
2022-08-23 17:14:24 +08:00
e1aabf5837
[Doc] How to write a customized TensorRT plugin ( #290 )
...
* first edition
* fix lint
* add 06, 07
* resolve comments
* update index.rst
* update title
* update img
2022-08-22 14:00:28 +08:00
a6e07dac2f
improvement(cmake): simplify build option and doc ( #832 )
...
* improvement(cmake): simplify build option
improvement(cmake): convert target_backends with directory
* fix(dockerfile): build error
* fix(CI): circle CI
* fix(docs): snpe and cmake option
* fix(docs): revert update cmake
* fix(docs): revert
* update(docs): remove useless
2022-08-19 10:54:09 +08:00
3e7e80bcbc
support multi-batch test in profile tool ( #868 )
...
* test batch profile with resnet pspnet yolov3 srcnn
* update doc
* update docs
* fix ut
* fix mmdet
* support batch mmorc and mmrotate
* fix mmcls export to sdk
* resolve comments
* rename to fix #819
* fix conflicts with master
2022-08-17 15:01:06 +08:00
3fa15822b1
docs(zh_cn): add architect ( #882 )
...
* docs(zh_cn): add architect
docs(en): add architect
fix(docs): readthedocs index
* docs(en): update architect.md
* docs(README.md): update
* docs(architecture): fix review advices
2022-08-15 15:16:20 +08:00
127125f641
docs(project): sync en and zh docs ( #842 )
...
* docs(en): update file structure
* docs(zh_cn): update
* docs(structure): update
* docs(snpe): update
* docs(README): update
* fix(CI): update
* fix(CI): index.rst error
* fix(docs): update
* fix(docs): remove mermaid
* fix(docs): remove useless
* fix(docs): update link
* docs(en): update
* docs(en): update
* docs(zh_cn): remove \[
* docs(zh_cn): format
* docs(en): remove blank
* fix(CI): doc link error
* docs(project): remove "./" prefix
* docs(zh_cn): fix mdformat
* docs(en): update title
* fix(CI): update docs
2022-08-15 10:18:17 +08:00
5fb342ea87
Fix doc error of building C examples ( #879 )
...
* fix doc error of building C demo examples
Path error in cmake compilation of C demo examples
* fix en doc error of building C demo examples
Path error in cmake compilation of C demo examples
2022-08-10 11:59:53 +08:00
80d24fc4da
fix error when set device cpu && fix docs error ( #866 )
2022-08-05 11:30:30 +08:00
83b11bc1ca
[Enhancement] Improve get_started documents and bump version to 0.7.0 ( #813 )
...
* simplify commands in get_started
* add installation commands for Windows
* fix typo
* limit markdown and sphinx_markdown_tables version
* adopt html <details open> tag
* bump mmdeploy version
* bump mmdeploy version
* update get_started
* update get_started
* use python3.8 instead of python3.7
* remove duplicate section
* resolve issue #856
* update according to review results
* add reference to prebuilt_package_windows.md
* fix error when build sdk demos
2022-08-04 14:33:27 +08:00
091bfc3011
add prebuild package usage docs on windows ( #816 )
...
* add prebuild package usage docs on windows
* fix lint
* update
* try fix lint
* add en docs
* update
* update
* udpate faq
2022-08-03 15:25:36 +08:00
2cddae776e
support test with multi batch ( #829 )
...
* support test with multi batch
* resolve comment
2022-08-01 21:02:59 +08:00
2968a18d80
feat(tools/deploy.py): support snpe ( #789 )
...
* fix(tools/deploy.py): support snpe
* improvement(backend/snpe): review advices
* docs(backend/snpe): update build
* docs(backend/snpe): server support specify port
* docs(backend/snpe): update path
* fix(backend/snpe): time counter missing argument
* docs(backend/snpe): add missing argument
* docs(backend/snpe): update download and using
* improvement(snpe_net.cpp): load model with modeldata
2022-08-01 11:08:55 +08:00
f80c90ed47
update document for building android sdk ( #817 )
...
Co-authored-by: dwSun <dwsunny@icloud.com>
2022-07-28 21:11:19 +08:00
36b3ca4461
[Feature] Support RoITransRoIHead ( #713 )
...
* [Feature] Support RoITransRoIHead
* Add docs
* Add mmrotate models regression test
* Add a draft for test code
* change the argument name
* fix test code
* fix minor change for not class agnostic case
* fix sample for test code
* fix sample for test code
* Add mmrotate in requirements
* Revert "Add mmrotate in requirements"
This reverts commit 043490075e
2022-07-22 15:19:37 +08:00
ab07c223da
[Enhancement] Support latest ppl.nn & ppl.cv ( #564 )
...
* support latest ppl.nn
* fix pplnn for model convertor
* fix lint
* update memory policy
* import algo from buffer
* update ppl.cv
* use `ppl.cv==0.7.0`
* document supported ppl.nn version
* skip pplnn dependency when building shared libs
2022-07-21 11:47:53 +08:00
58b256a13b
Upgrade Dockerfile to use TensorRT==8.2.4.2 ( #706 )
...
* Upgrade TensorRT to 8.2.4.2
* upgrade pytorch&mmcv in CPU Dockerfile
* Delete redundant port example in Docker
* change 160x160-608x608 to 64x64-608x608 for yolov3
2022-07-20 20:36:22 +08:00
252cabbbc5
Add inference latency test tool ( #665 )
...
* add profile tool
* remove print envs in profile tool
* set cudnn_benchmark to True
* add doc
* update tests
* fix typo
* support test with images from a directory
* update doc
* resolve comments
2022-07-19 14:28:22 +08:00
71d085b1a6
Fix get-started rendering issues in readthedocs ( #740 )
...
* fix mermaid markdown rendering issue in readthedocs
* fix error in C++ example
* fix error in c++ example in zh_cn get_started doc
2022-07-14 11:17:13 +08:00
dace58e844
[Enhancement] Support Slide Vertex TRT ( #650 )
...
* reorgnize mmrotate
* fix
* add hbb2obb
* add ut
* fix rotated nms
* update docs
* update benchmark
* update test
* remove ort regression test, remove comment
2022-07-13 16:09:09 +08:00
14b2bfd524
[Enhancement] Standardize C API ( #634 )
...
* unify C API naming
* fix demo and move apis/c/* -> apis/c/mmdeploy/*
* fix lint
* fix C# project
* fix Java API
2022-07-12 14:04:33 +08:00
41ddcafbb4
Rename onnx2ncnn to mmdeploy_onnx2ncnn ( #694 )
...
* improvement(tools/onnx2ncnn.py): rename to mmdeploy_onnx2ncnn
* format(tools/deploy.py): clean code
* fix(init_plugins.py): improve if condition
* fix(CI): update target
* fix(test_onnx2ncnn.py): update desc
* Update init_plugins.py
2022-07-08 09:21:32 +08:00
d57cf85e1d
[Fix] Fix android build ( #698 )
...
* fix android build
* fix cmake
* fix url link
2022-07-07 14:29:45 +08:00
efd39953d7
Deploy the Swin Transformer on TensorRT. ( #652 )
...
* resolve conflicts
* update ut and docs
* fix ut
* refine docstring
* add comments and refine UT
* resolve comments
* resolve comments
* update doc
* add roll export
* check backend
* update regression test
2022-06-30 10:41:24 +08:00
e49e8a10ed
Update get_started.md ( #676 )
...
Fix backend model assignment
2022-06-29 19:04:58 +08:00
Mengyang Liu
tpoisonooo
BrokenArrow
whooray
Qingren
q.yao
Jingwei Zhang
ichitaka
AllentDan
lvhan028
Li Zhang
Chen Xin
RunningLeon
Chen Xin
OldDreamInWind
孙德伟
Hakjin Lee
hanrui1sensetime
zambranohally