Commit Graph

781 Commits (c3986cebe8e3d5125e1b70fdde03bbbecfd0f6b1)
 

Author SHA1 Message Date
Chen Xin a0fb3be0df
support coreml (#760)
* sdk inference

* fix typo

* fix typo

* add convert things

* fix missling name

* add cls support

* add more pytorch rewriter

* add det support

* support det wip

* make Model export model_path

* fix nms

* add output back

* add docstring

* fix lint

* add coreml build action

* add zh docs

* add coreml backend check

* update ci

* update

* update

* update

* update

* update

* fix lint

* update configs

* add return value when error occured

* update docs

* update docs

* update docs

* fix lint

* udpate docs

* udpate docs

* update

Co-authored-by: grimoire <streetyao@live.com>
2022-09-05 19:55:47 +08:00
munhou 3d092bfb39
fix mmdet showresult (#999)
* fix mmdet showresult

* Consider compatibility

* mmdet showresult add *args

* Revert "mmdet showresult add *args"

This reverts commit 82265a31cf.

Co-authored-by: whhuang <whhuang@hitotek.com>
2022-09-05 18:27:02 +08:00
q.yao 9541be9c0b
TensorRT dot product attention ops (#949)
* add detr support

* fix softmax

* add placeholder

* add implement

* add docs and ut

* update testcase

* update docs

* update docs
2022-09-05 18:25:39 +08:00
tpoisonooo e21cad84e0
fix(backend): disable cublaslt for cu102 (#947)
* fix(backend): disable cublaslt for cu102

* fix

* fix(backend): update

* fix(tensorrt/util.py): add find cuda version

* fix

* fix(CI): first use cmd to get cuda version

* docs(tensorrt/utils.py): update docstring
2022-09-05 14:52:43 +08:00
Li Zhang 792c27b054
[Feature] Ascend backend (#747)
* add acl backend

* support dynamic batch size and dynamic image size

* add preliminary ascend backend

* support dtypes other than float

* support dynamic_dims in SDK

* fix dynamic batch size

* better error handling

* remove debug info

* [WIP] dynamic shape support

* fix static shape

* fix dynamic batch size

* add retinanet support

* fix dynamic image size

* fix dynamic image size

* fix dynamic dims

* fix dynamic dims

* simplify config files

* fix yolox support

* fix negative index

* support faster rcnn

* add seg config

* update benchmark

* fix onnx2ascend dynamic shape

* update docstring and benchmark

* add unit test, update documents

* fix wrapper

* fix ut

* fix for vit

* error handling

* context handling & multi-device support

* build with stub libraries

* add ci

* fix lint

* fix lint

* update doc ref

* fix typo

* down with `target_link_directories`

* setup python

* makedir

* fix ci

* fix ci

* remove verbose logs

* fix UBs

* export Error

* fix lint

* update checkenv

Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
RunningLeon 966d737a1b
Fix: skip tests for uninstalled codebases (#987)
* skip tests if codebase not installed

* skip ort run test

* fix mmseg
2022-09-03 15:07:08 +08:00
Hongyi Xiang 9918d29212
add missing sqrt for PAAHead's score calculation (#984)
Co-authored-by: xianghongyi1 <xianghongyi1@sensetime.com>
2022-09-02 18:25:50 +08:00
tpoisonooo 9b3db48de9
fix(CI): ort test all pipeline (#985) 2022-09-02 17:34:22 +08:00
tpoisonooo 306616fc34
fix(CI): typo (#983) 2022-09-02 16:06:53 +08:00
RunningLeon cbedf1cc30
fix regression test (#958)
* fix reg

* set sdk wrapper device id

* resolve comment
2022-09-02 11:28:12 +08:00
RunningLeon 5874f1039b
Add CI to test full pipeline (#966)
* add mmcls full pipeline test ci

* update

* update

* add mmcv

* install torch

* install mmdeploy

* change clone with https

* install mmcls

* update

* change mmcls version

* add mmcv version

* update  mmcls version

* test sdk

* tast with imagnet

* sed pipeline

* print env

* update

* move to backend-ort ci

* install mim
2022-09-02 10:55:53 +08:00
RunningLeon 71e64786b7
Fix mmseg pointrend (#903)
* support mmseg:pointrend

* update docs

* update docs for torchscript

* resolve comments
2022-09-02 10:55:32 +08:00
RunningLeon a6ed7eddc5
fix mmroate (#976) 2022-09-02 10:45:49 +08:00
tpoisonooo 38bcc43256
CI(tools/scripts): add submodule init and update (#977) 2022-09-02 10:28:11 +08:00
Chen Xin 8a40f195bc
remove Release dir in mmdeploy package (#960) 2022-08-31 15:48:42 +08:00
hanrui1sensetime ac9db5b4e7
[Fix] Close onnx optimizer for ncnn (#961)
* close onnx optimizer for ncnn

* fix docformatter

* fix lint
2022-08-31 15:48:08 +08:00
q.yao eed69b14e2
fix ci (#964) 2022-08-31 14:36:15 +08:00
gy77 638e33a964
add_multi_label_postprocess (#950)
* 'add_multi_label_postprocess'

* fix pre-commit

* delete partial_sort

* delete idx

* delete num_classes and num_classes_

* Fix right brackets and spelling errors in lines 19 and 20

Co-authored-by: gaoying <gaoying@xiaobaishiji.com>
2022-08-30 19:02:42 +08:00
q.yao 13920ec1a2
[Enhancement] Rewriter support pre-import function (#899)
* support preimport

* update rewriter

* fix batched nms ort
2022-08-30 12:32:43 +08:00
hanrui1sensetime 47d4e6f733
fix ut failed (#951) 2022-08-30 11:21:18 +08:00
q.yao f4decda86e
[Enhancement] Support DETR (#924)
* add detr support

* fix softmax

* add reg test, update document
2022-08-30 10:39:10 +08:00
tpoisonooo f7e0905e95
docs(convert_model): update description (#956) 2022-08-30 10:37:07 +08:00
q.yao 18321eed51
[Bug] fix setitem with scalar or single element tensor (#941)
* fix setitem

* add copy symbolic
2022-08-29 18:56:17 +08:00
Li Zhang 6c2dde1cf8
[Feature] TorchScript SDK backend (#890)
* WIP SDK torchscript support

* support detection task

* make torchvision optional

* force link torchvision if enabled

* support torch-1.12

* fix export & sync cuda stream

* hide internal classes

* handle error

* set `MMDEPLOY_USE_CUDA` when CUDA is enabled
2022-08-29 18:01:18 +08:00
Chen Xin c04dcd2c62
Support risc-v platform (#910)
* add ppl.nn riscv engine

* update ppl.nn riscv engine

* udpate riscv service (ncnn backend)

* update _build_wrapper for ncnn

* fix build

* fix lint

* update default uri

* update file structure & add cn doc

* remove copy input data

* update docs

* remove ncnn server

* fix docs

* update zh doc

* update toolchain

* remove unused

* update doc

* update doc

* update doc

* rename cross build dirname

* add riscv.md to build_from_source.md

* update cls model

* test ci

* test ci

* test ci

* test ci

* test ci

* update ci

* update ci
2022-08-26 13:54:40 +08:00
tpoisonooo 4534598056
improvement(installation): add script install mmdeploy (#919)
* feat(tools): add build ubuntu x64 ncnn

* ci(tools): add ncnn auto install

* fix(ci): auto install ncnn

* fix(tools): no interactive

* docs(build): add script build

* CI(ncnn): script install ncnn

* docs(zh_cn): fix error os

* fix

* CI(tools/script): test ort install passed

* update

* CI(tools): support pplnn

* CI(build): add pplnn

* docs(tools): update

* fix

* CI(tools): script install torchscript

* docs(build): add torchscript

* fix(tools): clean code and doc

* update

* fix(CI): requirements install failed

* debug CI

* update

* update

* update

* feat(tools/script): support user specify make jobs

* fix(tools/script): fix build pplnn with cuda

* fix(tools/script): torchscript add tips and simplify install mmcv

* fix(tools/script): check nvcc version first

* fix(tools/scripts): pplnn checkout

* fix(CI): add simple check install succcess

* fix

* debug CI

* fix

* fix(CI): pplnn install mis wheel

* fix(CI): build error

* fix(CI): remove misleading message
2022-08-26 13:53:53 +08:00
RunningLeon b1e7579bdd
add cflags explicitly in ci (#945) 2022-08-25 13:54:42 +08:00
tpoisonooo 21775ce584
docs(mmdet3d): give detail model path (#940) 2022-08-24 15:11:58 +08:00
AllentDan 0111e1f10f
[Feature] add swin for cls (#911)
* add swin for cls

* add ut and doc

* reduce trt batch size

* add regression test

* resolve comments

* remove useless rewriting logic
2022-08-23 17:14:24 +08:00
AllentDan e1aabf5837
[Doc] How to write a customized TensorRT plugin (#290)
* first edition

* fix lint

* add 06, 07

* resolve comments

* update index.rst

* update title

* update img
2022-08-22 14:00:28 +08:00
RunningLeon 1f8d889b36
set test_mode for mmdet (#920)
* fix

* update
2022-08-19 10:55:41 +08:00
tpoisonooo a6e07dac2f
improvement(cmake): simplify build option and doc (#832)
* improvement(cmake): simplify build option

improvement(cmake): convert target_backends with directory

* fix(dockerfile): build error

* fix(CI): circle CI

* fix(docs): snpe and cmake option

* fix(docs): revert update cmake

* fix(docs): revert

* update(docs): remove useless
2022-08-19 10:54:09 +08:00
AllentDan cad0092801
[Fix] fix device error in dump-info (#912)
* fix device error in dump-info

* fix UT
2022-08-17 18:01:26 +08:00
RunningLeon 3e7e80bcbc
support multi-batch test in profile tool (#868)
* test batch profile with resnet pspnet yolov3 srcnn

* update doc

* update docs

* fix ut

* fix mmdet

* support batch mmorc and mmrotate

* fix mmcls export to sdk

* resolve comments

* rename to fix #819

* fix conflicts with master
2022-08-17 15:01:06 +08:00
AllentDan 9fbfdd2178
add device backend check (#886)
* add device backend check

* safe check

* only activated for tensorrt and openvino

* resolve comments
2022-08-16 17:20:29 +08:00
tpoisonooo 3fa15822b1
docs(zh_cn): add architect (#882)
* docs(zh_cn): add architect

docs(en): add architect

fix(docs): readthedocs index

* docs(en): update architect.md

* docs(README.md): update

* docs(architecture): fix review advices
2022-08-15 15:16:20 +08:00
lvhan028 91a060fdbb
fix mmdeploy_pplnn_net build error when target device is cpu (#896) 2022-08-15 14:51:28 +08:00
tpoisonooo 127125f641
docs(project): sync en and zh docs (#842)
* docs(en): update file structure

* docs(zh_cn): update

* docs(structure): update

* docs(snpe): update

* docs(README): update

* fix(CI): update

* fix(CI): index.rst error

* fix(docs): update

* fix(docs): remove mermaid

* fix(docs): remove useless

* fix(docs): update link

* docs(en): update

* docs(en): update

* docs(zh_cn): remove \[

* docs(zh_cn): format

* docs(en): remove blank

* fix(CI): doc link error

* docs(project): remove "./" prefix

* docs(zh_cn): fix mdformat

* docs(en): update title

* fix(CI): update docs
2022-08-15 10:18:17 +08:00
RunningLeon 670a504502
fix adaptive_avg_pool exporting to onnx (#857)
* fix adaptive_avg_pool exporting to onnx

* remove debug codes

* fix ci

* resolve comment
2022-08-12 09:38:46 +08:00
梦阳 5fb342ea87
Fix doc error of building C examples (#879)
* fix doc error of building C demo examples

Path error in cmake compilation of C demo examples

* fix en doc error of building C demo examples

Path error in cmake compilation of C demo examples
2022-08-10 11:59:53 +08:00
VVsssssk f957284d54
[Feature]support pointpillar nus version (#391)
* support pointpillar nus version

* support pointpillar nus version

* add regression test config for mmdet3d

* fix exit with no error code

* fix cfg

* fix worksize

* fix worksize

* fix cfg

* support nus pp

* fix yaml

* fix yaml

* fix yaml

* add ut

* fix ut

Co-authored-by: RunningLeon <mnsheng@yeah.net>
2022-08-05 16:37:20 +08:00
OldDreamInWind 80d24fc4da
fix error when set device cpu && fix docs error (#866) 2022-08-05 11:30:30 +08:00
OldDreamInWind 4001a06930
improvement(dockerfile): use make -j$(nporc) when build ncnn (#840)
* use make -j$(nporc) when build ncnn

* improve cpu dockerfile
2022-08-05 10:33:14 +08:00
lvhan028 83b11bc1ca
[Enhancement] Improve get_started documents and bump version to 0.7.0 (#813)
* simplify commands in get_started

* add installation commands for Windows

* fix typo

* limit markdown and sphinx_markdown_tables version

* adopt html <details open> tag

* bump mmdeploy version

* bump mmdeploy version

* update get_started

* update get_started

* use python3.8 instead of python3.7

* remove duplicate section

* resolve issue #856

* update according to review results

* add reference to prebuilt_package_windows.md

* fix error when build sdk demos
2022-08-04 14:33:27 +08:00
Li Zhang ef56036326
fix typo (#862) 2022-08-03 18:30:04 +08:00
Chen Xin 091bfc3011
add prebuild package usage docs on windows (#816)
* add prebuild package usage docs on windows

* fix lint

* update

* try fix lint

* add en docs

* update

* update

* udpate faq
2022-08-03 15:25:36 +08:00
Chen Xin 3ecee6f376
fix mmpose python api (#852) 2022-08-03 11:44:23 +08:00
Chen Xin e12dfddc26
Fix SDK backend (#844) 2022-08-02 11:49:25 +08:00
lvhan028 a15365e93f
[Enhancement] build sdk python api in standard-alone manner (#810)
* build sdk python api in standard-alone manner

* enable MMDEPLOY_BUILD_SDK_MONOLITHIC and MMDEPLOY_BUILD_EXAMPLES in prebuild config

* link mmdeploy to python target when monolithic option is on

* checkin README to describe precompiled package build procedure

* use packaging.version.parse(python_version) instead of list(python_version)

* fix according to review results

* rebase master

* rollback cmake.in and apis/python/CMakeLists.txt

* reorganize files in install/example

* let cmake detect visual studio instead of specifying 2019

* rename whl name of precompiled package

* fix according to review results
2022-08-02 10:23:48 +08:00
Li Zhang 1d3ce15e35
import algorithm from buffer (#793) 2022-08-01 22:18:12 +08:00