Commit Graph

203 Commits (c35099ef0c4e6e6ed4d41270aefb5804fd671eeb)

Author SHA1 Message Date
Qingren fd21b98efa
[Docs] add the support information about MMPose Hourglass (#1118)
* [Docs] add the support information about MMPose Hourglass

* * add Hourglass support config

* update benchmark doc

* modify Hourglass AP under pytorch backend

* add regression test for Hourglass

* *update 03-benchmark/benchmark.md

* * modify mmpose.yml to ignore ncnn int8 test

* add trt_fp16 test results

* * add openvino test result

* * modify supported_models.md
2022-10-10 16:38:54 +08:00
RunningLeon 41fcc2242f
log cmd info for regresstion test (#1146)
* add log to regresstion test

* update for win

* update mmseg reg yml
2022-10-10 16:23:24 +08:00
hanrui1sensetime 161f27d493
fix mmedit test picture (#1131) 2022-09-29 17:13:23 +08:00
AllentDan 23e84f46ff
update mmcls yaml (#1137) 2022-09-29 17:09:17 +08:00
q.yao d282503012
update detyaml (#1133) 2022-09-29 12:14:06 +08:00
Li Zhang bf887cc8bc
[Enhancement] Refactor SDK pipeline (#938)
* unify C API naming

* fix demo and move apis/c/* -> apis/c/mmdeploy/*

* fix lint

* WIP refactor pipeline

* backward compatibility

* working pipeline demo

* add text det-recog demo

* add det-pose demo

* fix build

* fix demo

* add environment interface

* add environment to pass scheduler & model info at runtime

* update demos

* add pipeline API for Python

* fix `FromPyObject`

* fix for opencv-4.2

* environment -> context, improve pipeline

* python model interface

* fix cmake

* fix python & cmake

* context & C++ pipeline API

* minor fix

* improve API

* fix shared libs

* refresh C/Python API

* propagate context

* fix  python demo

* fix

* add namespace

* fix namespace

* fix mis-changed strings

* fix

* fix python api

* rename

* clean-up

* fix pose detector

* clean-up

* clean-up

* clean-up

* fix python API build

* fix CI

* fix lint

* fix lint

* fix lint & demo

* install pipeline.hpp

* fix MSVC shared library build

* fix sample

* fix MSVC monolithic build

* minor fix
2022-09-26 16:11:14 +08:00
q.yao ea7706cbfd
fix layer norm (#1015) 2022-09-21 16:24:47 +08:00
AllentDan e3859004ba
add mod rewriter for TRT (#1024) 2022-09-21 14:47:36 +08:00
q.yao 0caeaf238c
[CustomOps] TensorRT Gather Topk Ops (#1033)
* add gather topk

* add shape inference and document

* fix faster rcnn

* reshape topk

* fix
2022-09-19 13:48:26 +08:00
AllentDan 124635ec5f
Add RKNN support. (#865)
* save codes

* support resnet and yolov3

* support yolox

* fix lint

* add mmseg support and a doc

* add UT

* update supported model list

* fix ci

* refine docstring

* resolve comments

* remote output_tensor_type

* resolve comments

* update readme
2022-09-06 11:48:39 +08:00
Chen Xin 6b01a2e649
[Feature] Add option to fuse transform. (#741)
* add collect_impl.cpp to cuda device

* add dummy compute node wich device elena

* add compiler & dynamic library loader

* add code to compile with gen code(elena)

* move folder

* fix lint

* add tracer module

* add license

* update type id

* add fuse kernel registry

* remove compilier & dynamic_library

* update fuse kernel interface

* Add elena-mmdeploy project in 3rd-party

* Fix README.md

* fix cmake file

* Support cuda device and clang format all file

* Add cudaStreamSynchronize for cudafree

* fix cudaStreamSynchronize

* rename to __tracer__

* remove unused code

* update kernel

* update extract elena script

* update gitignore

* fix ci

* Change the crop_size to crop_h and crop_w in arglist

* update Tracer

* remove cond

* avoid allocate memory

* add build.sh for elena

* remove code

* update test

* Support bilinear resize with float input

* Rename elena-mmdeploy to delete

* Introduce public submodule

* use get_ref

* update elena

* update tools

* update tools

* update fuse transform docs

* add fuse transform doc link to get_started

* fix shape in crop

* remove fuse_transform_ == true check

* remove fuse_transform_ member

* remove elena_int.h

* doesn't dump transform_static.json

* update tracer

* update CVFusion to remove compile warning

* remove mmcv version > 1.5.1 dep

* fix tests

* update docs

* add elena use option

* remove submodule of CVFusion

* update doc

* use auto

* use throw_exception(eEntryNotFound);

* update

Co-authored-by: cx <cx@ubuntu20.04>
Co-authored-by: miraclezqc <969226879@qq.com>
2022-09-05 20:29:18 +08:00
RunningLeon ac3a12026d
fix mmdet ut (#1001) 2022-09-05 19:56:19 +08:00
q.yao 9541be9c0b
TensorRT dot product attention ops (#949)
* add detr support

* fix softmax

* add placeholder

* add implement

* add docs and ut

* update testcase

* update docs

* update docs
2022-09-05 18:25:39 +08:00
Li Zhang 792c27b054
[Feature] Ascend backend (#747)
* add acl backend

* support dynamic batch size and dynamic image size

* add preliminary ascend backend

* support dtypes other than float

* support dynamic_dims in SDK

* fix dynamic batch size

* better error handling

* remove debug info

* [WIP] dynamic shape support

* fix static shape

* fix dynamic batch size

* add retinanet support

* fix dynamic image size

* fix dynamic image size

* fix dynamic dims

* fix dynamic dims

* simplify config files

* fix yolox support

* fix negative index

* support faster rcnn

* add seg config

* update benchmark

* fix onnx2ascend dynamic shape

* update docstring and benchmark

* add unit test, update documents

* fix wrapper

* fix ut

* fix for vit

* error handling

* context handling & multi-device support

* build with stub libraries

* add ci

* fix lint

* fix lint

* update doc ref

* fix typo

* down with `target_link_directories`

* setup python

* makedir

* fix ci

* fix ci

* remove verbose logs

* fix UBs

* export Error

* fix lint

* update checkenv

Co-authored-by: grimoire <yaoqian@sensetime.com>
2022-09-05 12:08:36 +08:00
RunningLeon 966d737a1b
Fix: skip tests for uninstalled codebases (#987)
* skip tests if codebase not installed

* skip ort run test

* fix mmseg
2022-09-03 15:07:08 +08:00
RunningLeon cbedf1cc30
fix regression test (#958)
* fix reg

* set sdk wrapper device id

* resolve comment
2022-09-02 11:28:12 +08:00
RunningLeon 71e64786b7
Fix mmseg pointrend (#903)
* support mmseg:pointrend

* update docs

* update docs for torchscript

* resolve comments
2022-09-02 10:55:32 +08:00
q.yao eed69b14e2
fix ci (#964) 2022-08-31 14:36:15 +08:00
q.yao 13920ec1a2
[Enhancement] Rewriter support pre-import function (#899)
* support preimport

* update rewriter

* fix batched nms ort
2022-08-30 12:32:43 +08:00
hanrui1sensetime 47d4e6f733
fix ut failed (#951) 2022-08-30 11:21:18 +08:00
q.yao f4decda86e
[Enhancement] Support DETR (#924)
* add detr support

* fix softmax

* add reg test, update document
2022-08-30 10:39:10 +08:00
q.yao 18321eed51
[Bug] fix setitem with scalar or single element tensor (#941)
* fix setitem

* add copy symbolic
2022-08-29 18:56:17 +08:00
AllentDan 0111e1f10f
[Feature] add swin for cls (#911)
* add swin for cls

* add ut and doc

* reduce trt batch size

* add regression test

* resolve comments

* remove useless rewriting logic
2022-08-23 17:14:24 +08:00
AllentDan cad0092801
[Fix] fix device error in dump-info (#912)
* fix device error in dump-info

* fix UT
2022-08-17 18:01:26 +08:00
RunningLeon 670a504502
fix adaptive_avg_pool exporting to onnx (#857)
* fix adaptive_avg_pool exporting to onnx

* remove debug codes

* fix ci

* resolve comment
2022-08-12 09:38:46 +08:00
VVsssssk f957284d54
[Feature]support pointpillar nus version (#391)
* support pointpillar nus version

* support pointpillar nus version

* add regression test config for mmdet3d

* fix exit with no error code

* fix cfg

* fix worksize

* fix worksize

* fix cfg

* support nus pp

* fix yaml

* fix yaml

* fix yaml

* add ut

* fix ut

Co-authored-by: RunningLeon <mnsheng@yeah.net>
2022-08-05 16:37:20 +08:00
tpoisonooo f54da4e73f
improvement(sdk): add sdk code coverage (#808)
* feat(doc): add CI

* CI(sdk): add sdk coverage

* style(test): code format

* fix(CI): update coverage.info path

* improvement(CI): use internal image

* improvement(CI): push coverage info once
2022-07-29 13:57:54 +08:00
Chen Xin b6b22a1b6f
[Feature] support build single sdk library (#806)
* build single lib for c api

* update csharp doc & project

* update test build

* fix test build

* fix
2022-07-28 14:07:48 +08:00
Li Zhang bfd46c1c68
[Fix] Support macOS build (#762)
* fix macOS build

* fix missing
2022-07-26 21:54:49 +08:00
q.yao 0e1a3aa8c7
[Feature] support MMRotate model with le135 (#788)
* support MMRotate model with le135

* cse before fuse select assign

* remove unused import
2022-07-25 16:01:05 +08:00
q.yao 5b31d7a60d
[Enhancement] Install Optimizer by setuptools (#690)
* Add fuse select assign pass

* move code to csrc

* add config flag

* Add fuse select assign pass

* Add CSE for ONNX

* remove useless code

* Install optimizer by setup tools

* fix comment
2022-07-25 13:04:27 +08:00
AllentDan 36c35b6e88
[Fix] fix triu (#792)
* fix triu

* triu -> triu_default
2022-07-22 16:31:00 +08:00
Hakjin Lee 36b3ca4461
[Feature] Support RoITransRoIHead (#713)
* [Feature] Support RoITransRoIHead

* Add docs

* Add mmrotate models regression test

* Add a draft for test code

* change the argument name

* fix test code

* fix minor change for not class agnostic case

* fix sample for test code

* fix sample for test code

* Add mmrotate in requirements

* Revert "Add mmrotate in requirements"

This reverts commit 043490075e.
2022-07-22 15:19:37 +08:00
hanrui1sensetime 4b79124a97
[Fix] fix cascade mask rcnn (#787)
* fix cascade mask rcnn

* fix lint

* add regression
2022-07-22 12:09:12 +08:00
Hakjin Lee 58b256a13b
Upgrade Dockerfile to use TensorRT==8.2.4.2 (#706)
* Upgrade TensorRT to 8.2.4.2

* upgrade pytorch&mmcv in CPU Dockerfile

* Delete redundant port example in Docker

* change 160x160-608x608 to 64x64-608x608 for yolov3
2022-07-20 20:36:22 +08:00
q.yao 0310c168dc
[Enhancement] Better index put ONNX export. (#704)
* Add rewriter for tensor setitem

* add version check
2022-07-20 19:32:46 +08:00
AllentDan ebba5ff6c9
[Fix] fix yolox point_generator (#758)
* fix yolox point_generator

* add a UT

* resolve comments

* fix comment lines
2022-07-20 14:18:48 +08:00
q.yao 4842823fd0
[Enhancement] Add CSE ONNX pass (#647)
* Add fuse select assign pass

* move code to csrc

* add config flag

* Add fuse select assign pass

* Add CSE for ONNX

* remove useless code
2022-07-19 14:46:14 +08:00
RunningLeon 252cabbbc5
Add inference latency test tool (#665)
* add profile tool

* remove print envs in profile tool

* set cudnn_benchmark to True

* add doc

* update tests

* fix typo

* support test with images from a directory

* update doc

* resolve comments
2022-07-19 14:28:22 +08:00
AllentDan 394fb55809
fix satrn for ORT (#753)
* fix satrn for ORT

* move rewrite into pytorch
2022-07-19 09:47:42 +08:00
hanrui1sensetime d216af885d
[Fix] set default topk for dump info (#702)
* set default topk for dump info

* remove redundant docstrings

* add ci densenet

* fix classification warnings

* fix mmcls version

* fix logger.warnings
2022-07-14 17:32:22 +08:00
q.yao dace58e844
[Enhancement] Support Slide Vertex TRT (#650)
* reorgnize mmrotate

* fix

* add hbb2obb

* add ut

* fix rotated nms

* update docs

* update benchmark

* update test

* remove ort regression test, remove comment
2022-07-13 16:09:09 +08:00
Li Zhang 14b2bfd524
[Enhancement] Standardize C API (#634)
* unify C API naming

* fix demo and move apis/c/* -> apis/c/mmdeploy/*

* fix lint

* fix C# project

* fix Java API
2022-07-12 14:04:33 +08:00
hanrui1sensetime 112b11469c
[Fix] Fix mmdet ort static shape bug (#687)
* fix shape

* add device

* fix yapf

* fix rewriter for transforms

* reverse image shape

* fix ut of distance2bbox

* fix rewriter name
2022-07-09 07:20:15 +08:00
hanrui1sensetime affc5ae3ff
[Fix] fix ssd ncnn ut (#692)
* fix ssd ncnn ut

* fix yapf
2022-07-04 15:17:30 +08:00
RunningLeon 17a7d60c7d
pass img_metas while exporting to onnx (#681)
* pass img_metas while exporting to onnx

* remove try-catch in tools for beter debugging

* use get

* fix typo
2022-06-30 17:33:24 +08:00
AllentDan efd39953d7
Deploy the Swin Transformer on TensorRT. (#652)
* resolve conflicts

* update ut and docs

* fix ut

* refine docstring

* add comments and refine UT

* resolve comments

* resolve comments

* update doc

* add roll export

* check backend

* update regression test
2022-06-30 10:41:24 +08:00
Li Zhang 8f1508e098
[Fix] fix clang build (#677)
* fix clang build

* fix ndk build

* fix ndk build

* switch to `std::filesystem` for clang-7 and later
2022-06-29 22:01:51 +08:00
q.yao 58584888ee
[Enhancement] Add fuse select assign pass (#589)
* Add fuse select assign pass

* move code to csrc

* add config flag

* remove bool cast
2022-06-29 14:43:01 +08:00
lvhan028 30d62e97a1
update the circleci config file by adding workflows both for linux, windows and linux-gpu (#368)
* update circleci by adding more workflows

* fix test workflow failure on windows platform

* fix docker exec command for SDK unittests
2022-06-29 12:05:56 +08:00