615668ec63
update api in doc ( #1021 )
2022-09-14 17:47:26 +08:00
b310ba8d3e
bump version to v0.8.0 ( #1009 )
2022-09-07 10:53:50 +08:00
b602356181
[Fix] Add isolated option for TorchScript SDK backend ( #1002 )
...
* add option for TorchScript SDK backend
* add doc
* format
2022-09-06 12:24:07 +08:00
124635ec5f
Add RKNN support. ( #865 )
...
* save codes
* support resnet and yolov3
* support yolox
* fix lint
* add mmseg support and a doc
* add UT
* update supported model list
* fix ci
* refine docstring
* resolve comments
* remote output_tensor_type
* resolve comments
* update readme
2022-09-06 11:48:39 +08:00
6b01a2e649
[Feature] Add option to fuse transform. ( #741 )
...
* add collect_impl.cpp to cuda device
* add dummy compute node wich device elena
* add compiler & dynamic library loader
* add code to compile with gen code(elena)
* move folder
* fix lint
* add tracer module
* add license
* update type id
* add fuse kernel registry
* remove compilier & dynamic_library
* update fuse kernel interface
* Add elena-mmdeploy project in 3rd-party
* Fix README.md
* fix cmake file
* Support cuda device and clang format all file
* Add cudaStreamSynchronize for cudafree
* fix cudaStreamSynchronize
* rename to __tracer__
* remove unused code
* update kernel
* update extract elena script
* update gitignore
* fix ci
* Change the crop_size to crop_h and crop_w in arglist
* update Tracer
* remove cond
* avoid allocate memory
* add build.sh for elena
* remove code
* update test
* Support bilinear resize with float input
* Rename elena-mmdeploy to delete
* Introduce public submodule
* use get_ref
* update elena
* update tools
* update tools
* update fuse transform docs
* add fuse transform doc link to get_started
* fix shape in crop
* remove fuse_transform_ == true check
* remove fuse_transform_ member
* remove elena_int.h
* doesn't dump transform_static.json
* update tracer
* update CVFusion to remove compile warning
* remove mmcv version > 1.5.1 dep
* fix tests
* update docs
* add elena use option
* remove submodule of CVFusion
* update doc
* use auto
* use throw_exception(eEntryNotFound);
* update
Co-authored-by: cx <cx@ubuntu20.04>
Co-authored-by: miraclezqc <969226879@qq.com>
2022-09-05 20:29:18 +08:00
ac3a12026d
fix mmdet ut ( #1001 )
2022-09-05 19:56:19 +08:00
a0fb3be0df
support coreml ( #760 )
...
* sdk inference
* fix typo
* fix typo
* add convert things
* fix missling name
* add cls support
* add more pytorch rewriter
* add det support
* support det wip
* make Model export model_path
* fix nms
* add output back
* add docstring
* fix lint
* add coreml build action
* add zh docs
* add coreml backend check
* update ci
* update
* update
* update
* update
* update
* fix lint
* update configs
* add return value when error occured
* update docs
* update docs
* update docs
* fix lint
* udpate docs
* udpate docs
* update
Co-authored-by: grimoire <streetyao@live.com>
2022-09-05 19:55:47 +08:00
9541be9c0b
TensorRT dot product attention ops ( #949 )
...
* add detr support
* fix softmax
* add placeholder
* add implement
* add docs and ut
* update testcase
* update docs
* update docs
2022-09-05 18:25:39 +08:00
e21cad84e0
fix(backend): disable cublaslt for cu102 ( #947 )
...
* fix(backend): disable cublaslt for cu102
* fix
* fix(backend): update
* fix(tensorrt/util.py): add find cuda version
* fix
* fix(CI): first use cmd to get cuda version
* docs(tensorrt/utils.py): update docstring
2022-09-05 14:52:43 +08:00
792c27b054
[Feature] Ascend backend ( #747 )
...
* add acl backend
* support dynamic batch size and dynamic image size
* add preliminary ascend backend
* support dtypes other than float
* support dynamic_dims in SDK
* fix dynamic batch size
* better error handling
* remove debug info
* [WIP] dynamic shape support
* fix static shape
* fix dynamic batch size
* add retinanet support
* fix dynamic image size
* fix dynamic image size
* fix dynamic dims
* fix dynamic dims
* simplify config files
* fix yolox support
* fix negative index
* support faster rcnn
* add seg config
* update benchmark
* fix onnx2ascend dynamic shape
* update docstring and benchmark
* add unit test, update documents
* fix wrapper
* fix ut
* fix for vit
* error handling
* context handling & multi-device support
* build with stub libraries
* add ci
* fix lint
* fix lint
* update doc ref
* fix typo
* down with `target_link_directories`
* setup python
* makedir
* fix ci
* fix ci
* remove verbose logs
* fix UBs
* export Error
* fix lint
* update checkenv
Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
71e64786b7
Fix mmseg pointrend ( #903 )
...
* support mmseg:pointrend
* update docs
* update docs for torchscript
* resolve comments
2022-09-02 10:55:32 +08:00
f4decda86e
[Enhancement] Support DETR ( #924 )
...
* add detr support
* fix softmax
* add reg test, update document
2022-08-30 10:39:10 +08:00
f7e0905e95
docs(convert_model): update description ( #956 )
2022-08-30 10:37:07 +08:00
c04dcd2c62
Support risc-v platform ( #910 )
...
* add ppl.nn riscv engine
* update ppl.nn riscv engine
* udpate riscv service (ncnn backend)
* update _build_wrapper for ncnn
* fix build
* fix lint
* update default uri
* update file structure & add cn doc
* remove copy input data
* update docs
* remove ncnn server
* fix docs
* update zh doc
* update toolchain
* remove unused
* update doc
* update doc
* update doc
* rename cross build dirname
* add riscv.md to build_from_source.md
* update cls model
* test ci
* test ci
* test ci
* test ci
* test ci
* update ci
* update ci
2022-08-26 13:54:40 +08:00
4534598056
improvement(installation): add script install mmdeploy ( #919 )
...
* feat(tools): add build ubuntu x64 ncnn
* ci(tools): add ncnn auto install
* fix(ci): auto install ncnn
* fix(tools): no interactive
* docs(build): add script build
* CI(ncnn): script install ncnn
* docs(zh_cn): fix error os
* fix
* CI(tools/script): test ort install passed
* update
* CI(tools): support pplnn
* CI(build): add pplnn
* docs(tools): update
* fix
* CI(tools): script install torchscript
* docs(build): add torchscript
* fix(tools): clean code and doc
* update
* fix(CI): requirements install failed
* debug CI
* update
* update
* update
* feat(tools/script): support user specify make jobs
* fix(tools/script): fix build pplnn with cuda
* fix(tools/script): torchscript add tips and simplify install mmcv
* fix(tools/script): check nvcc version first
* fix(tools/scripts): pplnn checkout
* fix(CI): add simple check install succcess
* fix
* debug CI
* fix
* fix(CI): pplnn install mis wheel
* fix(CI): build error
* fix(CI): remove misleading message
2022-08-26 13:53:53 +08:00
21775ce584
docs(mmdet3d): give detail model path ( #940 )
2022-08-24 15:11:58 +08:00
0111e1f10f
[Feature] add swin for cls ( #911 )
...
* add swin for cls
* add ut and doc
* reduce trt batch size
* add regression test
* resolve comments
* remove useless rewriting logic
2022-08-23 17:14:24 +08:00
e1aabf5837
[Doc] How to write a customized TensorRT plugin ( #290 )
...
* first edition
* fix lint
* add 06, 07
* resolve comments
* update index.rst
* update title
* update img
2022-08-22 14:00:28 +08:00
a6e07dac2f
improvement(cmake): simplify build option and doc ( #832 )
...
* improvement(cmake): simplify build option
improvement(cmake): convert target_backends with directory
* fix(dockerfile): build error
* fix(CI): circle CI
* fix(docs): snpe and cmake option
* fix(docs): revert update cmake
* fix(docs): revert
* update(docs): remove useless
2022-08-19 10:54:09 +08:00
3e7e80bcbc
support multi-batch test in profile tool ( #868 )
...
* test batch profile with resnet pspnet yolov3 srcnn
* update doc
* update docs
* fix ut
* fix mmdet
* support batch mmorc and mmrotate
* fix mmcls export to sdk
* resolve comments
* rename to fix #819
* fix conflicts with master
2022-08-17 15:01:06 +08:00
3fa15822b1
docs(zh_cn): add architect ( #882 )
...
* docs(zh_cn): add architect
docs(en): add architect
fix(docs): readthedocs index
* docs(en): update architect.md
* docs(README.md): update
* docs(architecture): fix review advices
2022-08-15 15:16:20 +08:00
127125f641
docs(project): sync en and zh docs ( #842 )
...
* docs(en): update file structure
* docs(zh_cn): update
* docs(structure): update
* docs(snpe): update
* docs(README): update
* fix(CI): update
* fix(CI): index.rst error
* fix(docs): update
* fix(docs): remove mermaid
* fix(docs): remove useless
* fix(docs): update link
* docs(en): update
* docs(en): update
* docs(zh_cn): remove \[
* docs(zh_cn): format
* docs(en): remove blank
* fix(CI): doc link error
* docs(project): remove "./" prefix
* docs(zh_cn): fix mdformat
* docs(en): update title
* fix(CI): update docs
2022-08-15 10:18:17 +08:00
5fb342ea87
Fix doc error of building C examples ( #879 )
...
* fix doc error of building C demo examples
Path error in cmake compilation of C demo examples
* fix en doc error of building C demo examples
Path error in cmake compilation of C demo examples
2022-08-10 11:59:53 +08:00
80d24fc4da
fix error when set device cpu && fix docs error ( #866 )
2022-08-05 11:30:30 +08:00
83b11bc1ca
[Enhancement] Improve get_started documents and bump version to 0.7.0 ( #813 )
...
* simplify commands in get_started
* add installation commands for Windows
* fix typo
* limit markdown and sphinx_markdown_tables version
* adopt html <details open> tag
* bump mmdeploy version
* bump mmdeploy version
* update get_started
* update get_started
* use python3.8 instead of python3.7
* remove duplicate section
* resolve issue #856
* update according to review results
* add reference to prebuilt_package_windows.md
* fix error when build sdk demos
2022-08-04 14:33:27 +08:00
091bfc3011
add prebuild package usage docs on windows ( #816 )
...
* add prebuild package usage docs on windows
* fix lint
* update
* try fix lint
* add en docs
* update
* update
* udpate faq
2022-08-03 15:25:36 +08:00
2968a18d80
feat(tools/deploy.py): support snpe ( #789 )
...
* fix(tools/deploy.py): support snpe
* improvement(backend/snpe): review advices
* docs(backend/snpe): update build
* docs(backend/snpe): server support specify port
* docs(backend/snpe): update path
* fix(backend/snpe): time counter missing argument
* docs(backend/snpe): add missing argument
* docs(backend/snpe): update download and using
* improvement(snpe_net.cpp): load model with modeldata
2022-08-01 11:08:55 +08:00
f80c90ed47
update document for building android sdk ( #817 )
...
Co-authored-by: dwSun <dwsunny@icloud.com>
2022-07-28 21:11:19 +08:00
36b3ca4461
[Feature] Support RoITransRoIHead ( #713 )
...
* [Feature] Support RoITransRoIHead
* Add docs
* Add mmrotate models regression test
* Add a draft for test code
* change the argument name
* fix test code
* fix minor change for not class agnostic case
* fix sample for test code
* fix sample for test code
* Add mmrotate in requirements
* Revert "Add mmrotate in requirements"
This reverts commit 043490075e
2022-07-22 15:19:37 +08:00
ab07c223da
[Enhancement] Support latest ppl.nn & ppl.cv ( #564 )
...
* support latest ppl.nn
* fix pplnn for model convertor
* fix lint
* update memory policy
* import algo from buffer
* update ppl.cv
* use `ppl.cv==0.7.0`
* document supported ppl.nn version
* skip pplnn dependency when building shared libs
2022-07-21 11:47:53 +08:00
58b256a13b
Upgrade Dockerfile to use TensorRT==8.2.4.2 ( #706 )
...
* Upgrade TensorRT to 8.2.4.2
* upgrade pytorch&mmcv in CPU Dockerfile
* Delete redundant port example in Docker
* change 160x160-608x608 to 64x64-608x608 for yolov3
2022-07-20 20:36:22 +08:00
252cabbbc5
Add inference latency test tool ( #665 )
...
* add profile tool
* remove print envs in profile tool
* set cudnn_benchmark to True
* add doc
* update tests
* fix typo
* support test with images from a directory
* update doc
* resolve comments
2022-07-19 14:28:22 +08:00
71d085b1a6
Fix get-started rendering issues in readthedocs ( #740 )
...
* fix mermaid markdown rendering issue in readthedocs
* fix error in C++ example
* fix error in c++ example in zh_cn get_started doc
2022-07-14 11:17:13 +08:00
dace58e844
[Enhancement] Support Slide Vertex TRT ( #650 )
...
* reorgnize mmrotate
* fix
* add hbb2obb
* add ut
* fix rotated nms
* update docs
* update benchmark
* update test
* remove ort regression test, remove comment
2022-07-13 16:09:09 +08:00
14b2bfd524
[Enhancement] Standardize C API ( #634 )
...
* unify C API naming
* fix demo and move apis/c/* -> apis/c/mmdeploy/*
* fix lint
* fix C# project
* fix Java API
2022-07-12 14:04:33 +08:00
41ddcafbb4
Rename onnx2ncnn to mmdeploy_onnx2ncnn ( #694 )
...
* improvement(tools/onnx2ncnn.py): rename to mmdeploy_onnx2ncnn
* format(tools/deploy.py): clean code
* fix(init_plugins.py): improve if condition
* fix(CI): update target
* fix(test_onnx2ncnn.py): update desc
* Update init_plugins.py
2022-07-08 09:21:32 +08:00
d57cf85e1d
[Fix] Fix android build ( #698 )
...
* fix android build
* fix cmake
* fix url link
2022-07-07 14:29:45 +08:00
efd39953d7
Deploy the Swin Transformer on TensorRT. ( #652 )
...
* resolve conflicts
* update ut and docs
* fix ut
* refine docstring
* add comments and refine UT
* resolve comments
* resolve comments
* update doc
* add roll export
* check backend
* update regression test
2022-06-30 10:41:24 +08:00
e49e8a10ed
Update get_started.md ( #676 )
...
Fix backend model assignment
2022-06-29 19:04:58 +08:00
051e1577a3
Add java apis and demos ( #563 )
...
* add java classifier detector
* add segmentor
* fix lint
* add ImageRestorer java apis and demo
* remove useless count parameter for Segmentor and Restorer, add PoseDetector
* add RotatedDetection java api and demo
* add Ocr java demo and apis
* remove mmrotate ncnn java api and demo
* fix lint
* sync java api folder after rebase to master
* fix include
* remove record
* fix java apis dir path in cmake
* add java demo readme
* fix lint mdformat
* add test javaapi ci
* fix lint
* fix flake8
* fix test javaapi ci
* refactor readme.md
* fix install opencv for ci
* fix install opencv : add permission
* add all codebases and mmcv install
* add torch
* install mmdeploy
* fix image path
* fix picture path
* fix import ncnn
* fix import ncnn
* add submodule of pybind
* fix pybind submodule
* change download to git clone for submodule
* fix ncnn dir
* fix README error
* simplify the github ci
* fix ci
* fix yapf
* add JNI as required
* fix Capitalize
* fix Capitalize
* fix copyright
* ignore .class changed
* add OpenJDK installation docs
* install target of javaapi
* simplify ci
* add jar
* fix ci
* fix ci
* fix test java command
* debugging what failed
* debugging what failed
* debugging what failed
* add java version info
* install openjdk
* add java env var
* fix export
* fix export
* fix export
* fix export
* fix picture path
* fix picture path
* fix file name
* fix file name
* fix README
* remove java_api strategy
* fix python version
* format task name
* move args position
* extract common utils code
* show image class result
* add detector result
* segmentation result format
* add ImageRestorer result
* add PoseDetection java result format
* fix ci
* stage ocr
* add visualize
* move utils
* fix lint
* fix ocr bugs
* fix ci demo
* fix java classpath for ci
* fix popd
* fix ocr demo text garbled
* fix ci
* fix ci
* fix ci
* fix path of utils ci
2022-06-29 11:02:08 +08:00
5fce1e8f8d
update docs ( #624 )
2022-06-29 10:15:48 +08:00
f568fe7da5
Add partition doc and sample code ( #599 )
...
* update torch2onnx tool to support onnx partition
* add model partition of yolov3
* add cn doc
* update torch2onnx tool to support onnx partition
* add model partition of yolov3
* add cn doc
* add to index.rst
* resolve comment
* resolve comments
* fix lint
* change caption level in docs
2022-06-28 19:46:58 +08:00
05cafab723
Fix typo ( #625 )
...
* Add make install in en docs
* Add make install in zh docs
* Fix typo
* Merge and add windows build
Co-authored-by: tripleMu <865626@163.com>
2022-06-27 19:43:09 +08:00
da8c02e2b4
Support deployment of Segmenter ( #587 )
...
* support segmentor with ncnn
* update regression yml
* replace chunk with split to support ts
* update regression yml
* update docs
* fix segmenter ncnn inference failure brought by #477
* add test
* fix test for ncnn and trt
* fix lint
* export nn.linear to Gemm op in onnx for ncnn
* fix ci
2022-06-27 17:52:05 +08:00
7e8d6eb50f
' -> " ( #655 )
...
same with https://github.com/open-mmlab/mmdeploy/pull/654
2022-06-27 17:32:39 +08:00
0cac5154a6
[Enhancement] Support two-stage rotated detector TensorRT. ( #530 )
...
* upload
* add fake_multiclass_nms_rotated
* delete unused code
* align with pytorch
* Update delta_midpointoffset_rbbox_coder.py
* add trt rotated roi align
* add index feature in nms
* not good
* fix index
* add ut
* add benchmark
* move to csrc/mmdeploy
* update unit test
Co-authored-by: zytx121 <592267829@qq.com>
2022-06-23 10:35:10 +08:00
9c8168f39a
make -install -> make install ( #621 )
...
change `make -install` to `make install`
https://github.com/open-mmlab/mmdeploy/issues/618
2022-06-20 14:46:56 +08:00
296412fd08
[Docs] Replace markdownlint with mdformat and configure myst-parser ( #610 )
...
* replace mdlint with mdformat
* set myst_heading_anchor for doc
* update precommit yml
* format md files
2022-06-17 09:19:10 +08:00
86a50e343a
[Fix] Fix demo link ( #588 )
...
* fix demo link
* update urls
2022-06-13 11:07:34 +08:00
e69b7a5838
[docs] fix readthedocs ( #577 )
...
* Fix readthedocs issues
* fix opencv-python to 4.5.4.60
* update according to reviewer comments
2022-06-08 20:39:34 +08:00
AllentDan
lvhan028
Li Zhang
Chen Xin
RunningLeon
q.yao
tpoisonooo
Chen Xin
梦阳
OldDreamInWind
孙德伟
Hakjin Lee
hanrui1sensetime
zambranohally
tripleMu
Ryan_Huang