Commit Graph

149 Commits (7cb4b9b18a171655de4a2acb216200f19422e900)

Author SHA1 Message Date
q.yao 7cb4b9b18a
[Enhancement] Support tvm (#1216)
* finish framework

* add autotvm and auto-scheduler tuner

* add python deploy api

* add SDK net(WIP

* add sdk support

* support det, support vm

* fix vm sdk

* support two stage detector

* add instance seg support

* add docstring

* update docs and ut

* add quantize

* update doc

* update docs

* synchronize stream

* support dlpack

* remove submodule

* fix stride

* add alignment

* support dlpack

* remove submodule

* replace exclusive_scan

* add backend check

* add build script

* fix comment

* add ci

* fix ci

* ci fix2

* update build script

* update ci

* add pytest

* update sed command

* update sed again

* add xgboost

* remove tvm ut

* update ansor runner

* add stream sync

* fix topk

* sync default stream

* fix tvm net

* fix window
2022-12-12 21:19:40 +08:00
q.yao 1748780c91
[Refactor] ease build wrapper master (#1475)
* ease build wrapper

* import eanum only when necessary

* update docs

* rename manager

* update for comment

* replace staticmethod with classmethod

* fix torchjit
2022-12-09 17:19:34 +08:00
RunningLeon 55a3c8cf78
Bump version to v0.11.0 (#1470)
* bump version v0.11.0

* fix
2022-11-30 17:18:13 +08:00
tpoisonooo f6b35f3b68
fix(CI): ncnn script install (#1459)
* CI(script): fix ncnn install

* docs(build): update ncnn version to 20221128

* fix(CI): trigger
2022-11-29 20:37:06 +08:00
Chen Xin 2c9861555f
[Enhancement] add mmaction.yml for test (#1455)
* add mmaction.yml for test

* t# This is a combination of 2 commits.

add missing file

* fix typo

* remove
2022-11-29 18:48:29 +08:00
Chen Xin 73e095a4b8
[Fix] fix mmaction2 docs (#1410)
* fix typo and add link to README.md

* fix
2022-11-24 16:40:56 +08:00
tpoisonooo b23411d907
fix(tools/scripts): find env file failed (#1385)
* fix(tools/scripts): find env file failed

* Update quantize_model.md
2022-11-22 20:26:55 +08:00
AllentDan 4dd4d4851b
Add rv1126 yolov3 support to sdk (#1280)
* add yolov3 head to SDK

* add yolov5 head to SDK

* fix export-info and lint, add reverse check

* fix lint

* fix export info for yolo heads

* add output_names to partition_config

* fix typo

* config

* normalize config

* fix

* refactor config

* fix lint and doc

* c++ form

* resolve comments

* fix CI

* fix CI

* fix CI

* float strides anchors

* refine pipeline of rknn-int8

* config

* rename func

* refactor

* rknn wrapper dict and fix typo

* rknn wrapper output update,  mmcls use end2end type

* fix typo
2022-11-22 20:16:22 +08:00
Xin Li 522fcc0635
fix bad links (#1396) 2022-11-21 12:57:14 +08:00
tpoisonooo 938ef537a7
Improve mmdet3d doc (#1394)
* docs(mmdet3d): add trt version desc

* docs(mmdet3d): update
2022-11-18 18:34:30 +08:00
lvhan028 b0a350d49e
build opencv for aarch64 with videoio enabled (#1343)
* build opencv for aarch64 with videoio enabled

* update doc

* update

* update

* update
2022-11-11 10:22:15 +08:00
lvhan028 625593d6f3
[Feature] Support rv1126 in sdk (#1238)
* tmp

* refine

* update ssd-lite

* tmp

* tmp

* 0.1

* 0.1.1

* rename to base_dense_head

* remove debug code

* wait stream

* update cmakelists

* add some comments

* fix lint

* fix ci error

* fix according reviewer comments

* update params

* fix

* support normalize with to_float being false

* fix lint

* support rv1126 build ci

* support rv1126 build ci

* change debug level

* fix ci

* update

* update doc

* fix circleci error

* update normalize

* update

* check in build script

* change name
2022-11-07 11:13:47 +08:00
Chen Xin 940fffa075
fix some errors (#1309) 2022-11-04 22:38:28 +08:00
Chen Xin d8e6229dc5
Support mmaction master (#1183)
* cpu format shape

* convert model

* python api

* speedup dataloader

* minor

* add cpp demo

* add visualize

* fix resize param order

* export pipeline.json

* fix three crop

* read SampleFrames from model_cfg

* minor

* lint

* move to a func

* speed up format shape cpu

* use input mat device

* fix comments

* fix comments

* update docs/benchmark

* docs/supported-codebases

* update tests/data

* fix lint

* fix lint
2022-11-04 14:15:36 +08:00
AllentDan c4d428fd7d
Add model conversion support to rv1126 (#1203)
* WIP

* fix interpolate

* support yolov3 and retinanet

* support seg

* support ssd

* supports both partition types for retinanet and ssd

* mean std doc

* update doc, add UT

* support FSAF

* rename configs

* update dump info

* update

* python package installation doc

* update doc

* update doc

* doc
2022-11-02 11:04:22 +08:00
lvhan028 4c34ad74a1
bump version to 0.10.0 (#1259)
* bump version to 0.10.0

* fix circleci workflow error
2022-10-31 19:24:47 +08:00
lansfair b6f8c1c50d
Add mmseg configs for compatibility with Fast-SCNN model in ncnn backend (#1094)
* mmdeploy summer camp

* fix lint

* add note

* add note

* add a comment in interpolate.py

Co-authored-by: root <root@LAPTOP-A20M40H8.localdomain>
2022-10-27 10:36:26 +08:00
AllentDan 114b0b8238
remove imports (#1207)
* remove imports

* update doc

* detailed docstring

* rephrase
2022-10-24 10:45:52 +08:00
LiuYi-Up 27ac0ab002
[Docs] add support for vipnas (#1164)
* add support for vipnas

* add some unit tests

Signed-off-by: LiuYi-Up <1150854440@qq.com>

* Update quantization.md

* resolve some conflicts in docs

Signed-off-by: LiuYi-Up <1150854440@qq.com>

* fix the mdformat

Signed-off-by: LiuYi-Up <1150854440@qq.com>

* fix the layer_norm.py & test_mmcv_cnn.py

Signed-off-by: LiuYi-Up <1150854440@qq.com>

Signed-off-by: LiuYi-Up <1150854440@qq.com>
2022-10-19 10:24:23 +08:00
AllentDan 3eb60ea584
[Feature] Add RKNN support to SDK (#1145)
* add rknn_net [WIP]

* add cmake

* enable mmcls

* remove toTensor in SDK pipeline

* update doc

* translate to Chinese

* update doc and add tool-chain cmake

* use ::framework

* fix lint

* doc and print log

* data map

* refine install doc

* add rknpu2 workflow

* update gcc yaml

* better cmake file

* update doc link

* use vector instead of array

* better env variable

* use soft link

* release ctx

* name rule
2022-10-18 17:52:31 +08:00
Jiahao Sun 8e634059a1
[Feat] Support Monocular 3D Detection and FCOS3D Deployment (#1047)
* add monodet task

* format monodet

* format monodet

* sort test_monocular_detection_model.py import

* add fcos3d deploy

* change doc support model & fcos3d UT

* fix test monodet UT bug & remove ONNXBEVNMS op
2022-10-18 11:23:39 +08:00
OldDreamInWind 161fb01d73
[Feature]add edsr result && super-resolution ncnn-int8 config (#1111)
* add edsr result && ncnn-int8 config

* fix lint error

* fix lint error

* fix lint error && update benchmark.md

* add EDSRx2 pytorch result

* update edsrx4 result in benchmark
2022-10-18 10:04:56 +08:00
tpoisonooo ace44ae9d9
improvement(scripts): cross build aarch64 (#1126)
* udpate

* update

* CI(scripts): add auto cross build aarch64

* docs(scripts): add zh_cn doc

* docs(scripts): update

* docs(scripts): update

* fix(tools): update

* docs(zh_cn): update

* fix(scripts): remove gcc-7

* docs(scripts): update result

* udpate

* fix(tools): remove useless option

* docs(en): typo

* Update cross_build_aarch64.md

* Update cross_build_aarch64.md

* fix(tools/scripts): review advices

* fix(tools/scripts): update

* fix(cmake): remove useless option

* Update aarch64-linux-gnu.cmake
2022-10-17 11:15:29 +08:00
Qingren fd21b98efa
[Docs] add the support information about MMPose Hourglass (#1118)
* [Docs] add the support information about MMPose Hourglass

* * add Hourglass support config

* update benchmark doc

* modify Hourglass AP under pytorch backend

* add regression test for Hourglass

* *update 03-benchmark/benchmark.md

* * modify mmpose.yml to ignore ncnn int8 test

* add trt_fp16 test results

* * add openvino test result

* * modify supported_models.md
2022-10-10 16:38:54 +08:00
tpoisonooo 5cdf29339b
feat(tools/scripts): add auto install jetson orin (#1105)
* feat(tools/scripts): add auto install jetson orin

* docs(script): rename file

* fix(script): if clause error

* style(scripts): typo
2022-10-09 15:53:19 +08:00
达芬奇 895d0749ef
Supplemental a parameter "device" (#1165)
* Supplemental a parameter "device"
补充一个参数“device”

* 补充一个参数“device”
Supplemental a parameter "device"
2022-10-09 14:26:14 +08:00
lvhan028 917643fcac
bump version to 0.9.0 (#1115) 2022-09-29 19:48:52 +08:00
Mengyang Liu 0effa59440
Split demos of C and C++ SDK into two subdirectories (#1099)
* Split demos of C and C++ SDK into two subdirectories

* Split demos of C and C++ SDK into two subdirectories

* Split demos of C and C++ SDK into two subdirectories

* Split demos of C and C++ SDK into two subdirectories

* Combine add_example
2022-09-27 13:40:04 +08:00
tpoisonooo c5e4fcffbc
docs(quantization.md): remove ppq commit (#1095) 2022-09-27 12:35:24 +08:00
tpoisonooo 107ae8499d
docs(jetsons.md): fix desc (#1090)
* docs(jetsons.md): fix desc

* docs(jetsons.md): update
2022-09-23 10:14:00 +08:00
BrokenArrow fbe7586415
Add result of quantization of TextSnake (#1074)
* Update result of TextSnake

result from https://github.com/BrokenArrow1404/2022-MMLAB-SUMMERCAMP/blob/main/week4/README.md

* Update result of TextSnake

result from https://github.com/BrokenArrow1404/2022-MMLAB-SUMMERCAMP/blob/main/week4/README.md

* Add deploy config for quantization of TextSnake

* repair lint error
2022-09-21 15:28:28 +08:00
Qingren 18ccb15b7b
[Feature] Add Hourglass pose detection quantization evaluation result. (#1066)
Detail results: https://github.com/Qingrenn/mmdeploy-summer-camp/blob/main/week4/result.md
2022-09-19 14:09:46 +08:00
q.yao 0caeaf238c
[CustomOps] TensorRT Gather Topk Ops (#1033)
* add gather topk

* add shape inference and document

* fix faster rcnn

* reshape topk

* fix
2022-09-19 13:48:26 +08:00
Jingwei Zhang cbe767efb1
[Fix] Fix docs under supported-backends fold (#1061)
* fix docs of supported-backends

* fix docs
2022-09-18 13:36:28 +08:00
ichitaka a1a19f0fc1
Fixed typo for install commands for TensorRT runtime (#1025)
* Fixed typo for install commands for TensorRT runtime

* Apply typo-fix on 'cn' documentation

Co-authored-by: Tümer Tosik <tumer_t@hotmail.de>
2022-09-15 20:23:07 +08:00
tpoisonooo 538c9cfbb1
docs(scripts): update auto install desc (#1036) 2022-09-14 17:49:29 +08:00
AllentDan 615668ec63
update api in doc (#1021) 2022-09-14 17:47:26 +08:00
lvhan028 b310ba8d3e
bump version to v0.8.0 (#1009) 2022-09-07 10:53:50 +08:00
Li Zhang b602356181
[Fix] Add isolated option for TorchScript SDK backend (#1002)
* add option for TorchScript SDK backend

* add doc

* format
2022-09-06 12:24:07 +08:00
AllentDan 124635ec5f
Add RKNN support. (#865)
* save codes

* support resnet and yolov3

* support yolox

* fix lint

* add mmseg support and a doc

* add UT

* update supported model list

* fix ci

* refine docstring

* resolve comments

* remote output_tensor_type

* resolve comments

* update readme
2022-09-06 11:48:39 +08:00
Chen Xin 6b01a2e649
[Feature] Add option to fuse transform. (#741)
* add collect_impl.cpp to cuda device

* add dummy compute node wich device elena

* add compiler & dynamic library loader

* add code to compile with gen code(elena)

* move folder

* fix lint

* add tracer module

* add license

* update type id

* add fuse kernel registry

* remove compilier & dynamic_library

* update fuse kernel interface

* Add elena-mmdeploy project in 3rd-party

* Fix README.md

* fix cmake file

* Support cuda device and clang format all file

* Add cudaStreamSynchronize for cudafree

* fix cudaStreamSynchronize

* rename to __tracer__

* remove unused code

* update kernel

* update extract elena script

* update gitignore

* fix ci

* Change the crop_size to crop_h and crop_w in arglist

* update Tracer

* remove cond

* avoid allocate memory

* add build.sh for elena

* remove code

* update test

* Support bilinear resize with float input

* Rename elena-mmdeploy to delete

* Introduce public submodule

* use get_ref

* update elena

* update tools

* update tools

* update fuse transform docs

* add fuse transform doc link to get_started

* fix shape in crop

* remove fuse_transform_ == true check

* remove fuse_transform_ member

* remove elena_int.h

* doesn't dump transform_static.json

* update tracer

* update CVFusion to remove compile warning

* remove mmcv version > 1.5.1 dep

* fix tests

* update docs

* add elena use option

* remove submodule of CVFusion

* update doc

* use auto

* use throw_exception(eEntryNotFound);

* update

Co-authored-by: cx <cx@ubuntu20.04>
Co-authored-by: miraclezqc <969226879@qq.com>
2022-09-05 20:29:18 +08:00
RunningLeon ac3a12026d
fix mmdet ut (#1001) 2022-09-05 19:56:19 +08:00
Chen Xin a0fb3be0df
support coreml (#760)
* sdk inference

* fix typo

* fix typo

* add convert things

* fix missling name

* add cls support

* add more pytorch rewriter

* add det support

* support det wip

* make Model export model_path

* fix nms

* add output back

* add docstring

* fix lint

* add coreml build action

* add zh docs

* add coreml backend check

* update ci

* update

* update

* update

* update

* update

* fix lint

* update configs

* add return value when error occured

* update docs

* update docs

* update docs

* fix lint

* udpate docs

* udpate docs

* update

Co-authored-by: grimoire <streetyao@live.com>
2022-09-05 19:55:47 +08:00
q.yao 9541be9c0b
TensorRT dot product attention ops (#949)
* add detr support

* fix softmax

* add placeholder

* add implement

* add docs and ut

* update testcase

* update docs

* update docs
2022-09-05 18:25:39 +08:00
tpoisonooo e21cad84e0
fix(backend): disable cublaslt for cu102 (#947)
* fix(backend): disable cublaslt for cu102

* fix

* fix(backend): update

* fix(tensorrt/util.py): add find cuda version

* fix

* fix(CI): first use cmd to get cuda version

* docs(tensorrt/utils.py): update docstring
2022-09-05 14:52:43 +08:00
Li Zhang 792c27b054
[Feature] Ascend backend (#747)
* add acl backend

* support dynamic batch size and dynamic image size

* add preliminary ascend backend

* support dtypes other than float

* support dynamic_dims in SDK

* fix dynamic batch size

* better error handling

* remove debug info

* [WIP] dynamic shape support

* fix static shape

* fix dynamic batch size

* add retinanet support

* fix dynamic image size

* fix dynamic image size

* fix dynamic dims

* fix dynamic dims

* simplify config files

* fix yolox support

* fix negative index

* support faster rcnn

* add seg config

* update benchmark

* fix onnx2ascend dynamic shape

* update docstring and benchmark

* add unit test, update documents

* fix wrapper

* fix ut

* fix for vit

* error handling

* context handling & multi-device support

* build with stub libraries

* add ci

* fix lint

* fix lint

* update doc ref

* fix typo

* down with `target_link_directories`

* setup python

* makedir

* fix ci

* fix ci

* remove verbose logs

* fix UBs

* export Error

* fix lint

* update checkenv

Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
RunningLeon 71e64786b7
Fix mmseg pointrend (#903)
* support mmseg:pointrend

* update docs

* update docs for torchscript

* resolve comments
2022-09-02 10:55:32 +08:00
q.yao f4decda86e
[Enhancement] Support DETR (#924)
* add detr support

* fix softmax

* add reg test, update document
2022-08-30 10:39:10 +08:00
tpoisonooo f7e0905e95
docs(convert_model): update description (#956) 2022-08-30 10:37:07 +08:00
Chen Xin c04dcd2c62
Support risc-v platform (#910)
* add ppl.nn riscv engine

* update ppl.nn riscv engine

* udpate riscv service (ncnn backend)

* update _build_wrapper for ncnn

* fix build

* fix lint

* update default uri

* update file structure & add cn doc

* remove copy input data

* update docs

* remove ncnn server

* fix docs

* update zh doc

* update toolchain

* remove unused

* update doc

* update doc

* update doc

* rename cross build dirname

* add riscv.md to build_from_source.md

* update cls model

* test ci

* test ci

* test ci

* test ci

* test ci

* update ci

* update ci
2022-08-26 13:54:40 +08:00