mirrors
/
mmdeploy
mirror of https://github.com/open-mmlab/mmdeploy.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
982 Commits
16 Branches
23 Tags
187 MiB
Commit Graph

291 Commits (eff61a3860f5df052f8b73c4bfa9c9c4b4a6f0aa)

Author SHA1 Message Date
Chen Xin 091bfc3011
add prebuild package usage docs on windows (#816) 
* add prebuild package usage docs on windows

* fix lint

* update

* try fix lint

* add en docs

* update

* update

* udpate faq
 2022-08-03 15:25:36 +08:00
RunningLeon 2cddae776e
support test with multi batch (#829) 
* support test with multi batch

* resolve comment
 2022-08-01 21:02:59 +08:00
tpoisonooo 2968a18d80
feat(tools/deploy.py): support snpe (#789) 
* fix(tools/deploy.py): support snpe

* improvement(backend/snpe): review advices

* docs(backend/snpe): update build

* docs(backend/snpe): server support specify port

* docs(backend/snpe): update path

* fix(backend/snpe): time counter missing argument

* docs(backend/snpe): add missing argument

* docs(backend/snpe): update download and using

* improvement(snpe_net.cpp): load model with modeldata
 2022-08-01 11:08:55 +08:00
孙德伟 f80c90ed47
update document for building android sdk (#817) 
Co-authored-by: dwSun <dwsunny@icloud.com>
 2022-07-28 21:11:19 +08:00
Hakjin Lee 36b3ca4461
[Feature] Support RoITransRoIHead (#713) 
* [Feature] Support RoITransRoIHead

* Add docs

* Add mmrotate models regression test

* Add a draft for test code

* change the argument name

* fix test code

* fix minor change for not class agnostic case

* fix sample for test code

* fix sample for test code

* Add mmrotate in requirements

* Revert "Add mmrotate in requirements"

This reverts commit 043490075e.
 2022-07-22 15:19:37 +08:00
Li Zhang ab07c223da
[Enhancement] Support latest ppl.nn & ppl.cv (#564) 
* support latest ppl.nn

* fix pplnn for model convertor

* fix lint

* update memory policy

* import algo from buffer

* update ppl.cv

* use `ppl.cv==0.7.0`

* document supported ppl.nn version

* skip pplnn dependency when building shared libs
 2022-07-21 11:47:53 +08:00
Hakjin Lee 58b256a13b
Upgrade Dockerfile to use TensorRT==8.2.4.2 (#706) 
* Upgrade TensorRT to 8.2.4.2

* upgrade pytorch&mmcv in CPU Dockerfile

* Delete redundant port example in Docker

* change 160x160-608x608 to 64x64-608x608 for yolov3
 2022-07-20 20:36:22 +08:00
RunningLeon 252cabbbc5
Add inference latency test tool (#665) 
* add profile tool

* remove print envs in profile tool

* set cudnn_benchmark to True

* add doc

* update tests

* fix typo

* support test with images from a directory

* update doc

* resolve comments
 2022-07-19 14:28:22 +08:00
lvhan028 71d085b1a6
Fix get-started rendering issues in readthedocs (#740) 
* fix mermaid markdown rendering issue in readthedocs

* fix error in C++ example

* fix error in c++ example in zh_cn get_started doc
 2022-07-14 11:17:13 +08:00
q.yao dace58e844
[Enhancement] Support Slide Vertex TRT (#650) 
* reorgnize mmrotate

* fix

* add hbb2obb

* add ut

* fix rotated nms

* update docs

* update benchmark

* update test

* remove ort regression test, remove comment
 2022-07-13 16:09:09 +08:00
Li Zhang 14b2bfd524
[Enhancement] Standardize C API (#634) 
* unify C API naming

* fix demo and move apis/c/* -> apis/c/mmdeploy/*

* fix lint

* fix C# project

* fix Java API
 2022-07-12 14:04:33 +08:00
tpoisonooo 41ddcafbb4
Rename onnx2ncnn to mmdeploy_onnx2ncnn (#694) 
* improvement(tools/onnx2ncnn.py): rename to mmdeploy_onnx2ncnn

* format(tools/deploy.py): clean code

* fix(init_plugins.py): improve if condition

* fix(CI): update target

* fix(test_onnx2ncnn.py): update desc

* Update init_plugins.py
 2022-07-08 09:21:32 +08:00
hanrui1sensetime d57cf85e1d
[Fix] Fix android build (#698) 
* fix android build

* fix cmake

* fix url link
 2022-07-07 14:29:45 +08:00
AllentDan efd39953d7
Deploy the Swin Transformer on TensorRT. (#652) 
* resolve conflicts

* update ut and docs

* fix ut

* refine docstring

* add comments and refine UT

* resolve comments

* resolve comments

* update doc

* add roll export

* check backend

* update regression test
 2022-06-30 10:41:24 +08:00
zambranohally e49e8a10ed
Update get_started.md (#676) 
Fix backend model assignment
 2022-06-29 19:04:58 +08:00
zambranohally 3bc766e6f8
Update get_started.md (#675) 
Fix backend model assignment
 2022-06-29 19:02:20 +08:00
hanrui1sensetime 051e1577a3
Add java apis and demos (#563) 
* add java classifier detector

* add segmentor

* fix lint

* add ImageRestorer java apis and demo

* remove useless count parameter for Segmentor and Restorer, add PoseDetector

* add RotatedDetection java api and demo

* add Ocr java demo and apis

* remove mmrotate ncnn java api and demo

* fix lint

* sync java api folder after rebase to master

* fix include

* remove record

* fix java apis dir path in cmake

* add java demo readme

* fix lint mdformat

* add test javaapi ci

* fix lint

* fix flake8

* fix test javaapi ci

* refactor readme.md

* fix install opencv for ci

* fix install opencv : add permission

* add all codebases and mmcv install

* add torch

* install mmdeploy

* fix image path

* fix picture path

* fix import ncnn

* fix import ncnn

* add submodule of pybind

* fix pybind submodule

* change download to git clone for submodule

* fix ncnn dir

* fix README error

* simplify the github ci

* fix ci

* fix yapf

* add JNI as required

* fix Capitalize

* fix Capitalize

* fix copyright

* ignore .class changed

* add OpenJDK installation docs

* install target of javaapi

* simplify ci

* add jar

* fix ci

* fix ci

* fix test java command

* debugging what failed

* debugging what failed

* debugging what failed

* add java version info

* install openjdk

* add java env var

* fix export

* fix export

* fix export

* fix export

* fix picture path

* fix picture path

* fix file name

* fix file name

* fix README

* remove java_api strategy

* fix python version

* format task name

* move args position

* extract common utils code

* show image class result

* add detector result

* segmentation result format

* add ImageRestorer result

* add PoseDetection java result format

* fix ci

* stage ocr

* add visualize

* move utils

* fix lint

* fix ocr bugs

* fix ci demo

* fix java classpath for ci

* fix popd

* fix ocr demo text garbled

* fix ci

* fix ci

* fix ci

* fix path of utils ci
 2022-06-29 11:02:08 +08:00
RunningLeon 5fce1e8f8d
update docs (#624) 2022-06-29 10:15:48 +08:00
RunningLeon f568fe7da5
Add partition doc and sample code (#599) 
* update torch2onnx tool to support onnx partition

* add model partition of yolov3

* add cn doc

* update torch2onnx tool to support onnx partition

* add model partition of yolov3

* add cn doc

* add to index.rst

* resolve comment

* resolve comments

* fix lint

* change caption level in docs
 2022-06-28 19:46:58 +08:00
q.yao dc5f9c3746
[Enhancement] TensorRT Anchor generator plugin (#646) 
* custom trt anchor generator

* add ut

* add docstring, update doc
 2022-06-28 16:11:24 +08:00
tripleMu 05cafab723
Fix typo (#625) 
* Add make install in en docs

* Add make install in zh docs

* Fix typo

* Merge and add windows build

Co-authored-by: tripleMu <865626@163.com>
 2022-06-27 19:43:09 +08:00
RunningLeon da8c02e2b4
Support deployment of Segmenter (#587) 
* support segmentor with ncnn

* update regression yml

* replace chunk with split to support ts

* update regression yml

* update docs

* fix segmenter ncnn inference failure brought by #477

* add test

* fix test for ncnn and trt

* fix lint

* export nn.linear to Gemm op in onnx for ncnn

* fix ci
 2022-06-27 17:52:05 +08:00
Ryan_Huang 7e8d6eb50f
' -> " (#655) 
same with https://github.com/open-mmlab/mmdeploy/pull/654
 2022-06-27 17:32:39 +08:00
Ryan_Huang 49608b4289
' -> " (#654) 
If there is a variable in the string, single quotes will ignored it, while double quotes will bring the variable into the string after parsing
 2022-06-27 17:32:14 +08:00
q.yao 0cac5154a6
[Enhancement] Support two-stage rotated detector TensorRT. (#530) 
* upload

* add fake_multiclass_nms_rotated

* delete unused code

* align with pytorch

* Update delta_midpointoffset_rbbox_coder.py

* add trt rotated roi align

* add index feature in nms

* not good

* fix index

* add ut

* add benchmark

* move to csrc/mmdeploy

* update unit test

Co-authored-by: zytx121 <592267829@qq.com>
 2022-06-23 10:35:10 +08:00
Ryan_Huang 9c8168f39a
make -install -> make install (#621) 
change `make -install` to `make install`

https://github.com/open-mmlab/mmdeploy/issues/618
 2022-06-20 14:46:56 +08:00
RunningLeon 296412fd08
[Docs] Replace markdownlint with mdformat and configure myst-parser (#610) 
* replace mdlint with mdformat

* set myst_heading_anchor for doc

* update precommit yml

* format md files
 2022-06-17 09:19:10 +08:00
RunningLeon 3e594b28f6
Fix index.rst and add check ci (#607) 
* move doc link check to lint ci and add index.rst file check

* fix filename
 2022-06-16 18:45:04 +08:00
Li Zhang 86a50e343a
[Fix] Fix demo link (#588) 
* fix demo link

* update urls
 2022-06-13 11:07:34 +08:00
Liu Qingchen e84bc30f4a
fix a typo in Build for Jetson (#586) 
fix a typo described in issue #585
 2022-06-10 13:37:15 +08:00
lvhan028 e69b7a5838
[docs] fix readthedocs (#577) 
* Fix readthedocs issues

* fix opencv-python to 4.5.4.60

* update according to reviewer comments
 2022-06-08 20:39:34 +08:00
lvhan028 594c835b6b merge master and fix the conflicts 2022-06-07 19:04:29 +08:00
lvhan028 e929201827
[Docs] reorganize the documents in English and update the contents based on v0.5.0 status (#531) 
* checkout qq group qrcode

* update the cover image

* update build doc

* reorganize chapters

* update readme

* remove index of build on different platforms in readthedocs

* update benchmark

* update get started document in Chinese based on the prebuild package

* update get_started

* re-style benchmark

* update get_started in zh_cn

* update get_started in english

* update get_started in english

* update get_started in english

* update get_started doc

* update according to reviewer comments

* update linker ci

* fix(.github/scripts/check_doc_linker.py): skip code block

* specify PYTHONPATH

* update get_started

* update diagram

* rename some documents

* fix according to reviewer comments

Co-authored-by: tpoisonooo <khj.application@aliyun.com>
 2022-06-07 18:05:51 +08:00
q.yao 74243dc98b
[Enhancement] Add ONNX passes support (#390) 
* add merge_shape_concate

* add some peephole optimization

* bug fixing

* fix for torch1.9

* add flatten cls head

* add subgraph matcher with attribute

* add ut

* fix lint

* remove onnx2ncnn

* add opset version

* axis name

* fix peephole

* fix symbol compare

* add docs
 2022-06-06 21:30:31 +08:00
lzhangzz 567ec62296
[Fix] Fix recent build problems (#544) 
* simplify deps management

* skip visibility flags for MSVC

* simplify cuda deps

* naming

* workaround for cmake<3.17

* add spdlog dependency

* move the enablement of CUDA to top level CMakeLists.txt

* fix MSVC build

* fix lint

* fix build for backend ops only

* remove comment

* allow to use apis/python as a standalone project

* remove redundant cmake code

* control shared or static lib using `MMDEPLOY_SHARED_LIBS` instead of `BUILD_SHARED_LIBS`

* fix MSVC build

* update docs
 2022-06-06 11:19:34 +08:00
RunningLeon 51f630b22c
Fix test ncnn failure in regression test (#551) 
* fix ncnn test in regression test

* update doc

* fix docstring
 2022-06-06 10:00:02 +08:00
AllentDan ee878b539b
change resolution and fix regression test for mmocr (#534) 2022-06-02 18:29:41 +08:00
tpoisonooo f969d5a104
docs(do_regression_test): fix-typo (#547) 
* docs(do_regression_test): fix-typo

* improvement(apis/__init__.py): add print

* fix(CI): lint

* revert(apis/__init__.py): remove logging
 2022-06-02 17:07:53 +08:00
q.yao ea1122ce88
[Docs] Update doc for dependency (#543) 
* Update doc for dependency

* update requirements
 2022-06-01 15:39:34 +08:00
q.yao b32fc41bed
[Refactor][API2.0] Api refactor2.0 (#529) 
* [refactor][API2.0]  Add onnx export and jit trace (#419)

* first commit

* add async call

* add new api onnx export and jit trace

* add decorator

* fix ci

* fix torchscript ci

* fix loader

* better pipemanager

* remove comment, better import

* add kwargs

* remove comment

* better pipeline manager

* remove print

* [Refactor][API2.0] Api partition calibration (#433)

* first commit

* add async call

* add new api onnx export and jit trace

* add decorator

* fix ci

* fix torchscript ci

* fix loader

* better pipemanager

* remove comment, better import

* add partition

* move calibration

* Better create_calib_table

* better deploy

* add kwargs

* remove comment

* better pipeline manager

* rename api, remove reduant variable, and misc

* [Refactor][API2.0] Api ncnn openvino (#435)

* first commit

* add async call

* add new api onnx export and jit trace

* add decorator

* fix ci

* fix torchscript ci

* fix loader

* better pipemanager

* remove comment, better import

* add ncnn api

* finish ncnn api

* add openvino support

* add kwargs

* remove comment

* better pipeline manager

* merge fix

* merge util and onnx2ncnn

* fix docstring

* [Refactor][API2.0] API for TensorRT (#519)

* first commit

* add async call

* add new api onnx export and jit trace

* add decorator

* fix ci

* fix torchscript ci

* fix loader

* better pipemanager

* remove comment, better import

* add partition

* move calibration

* Better create_calib_table

* better deploy

* add kwargs

* remove comment

* Add tensorrt API

* better pipeline manager

* add tensorrt new api

* remove print

* rename api, remove reduant variable, and misc

* add docstring

* [Refactor][API2.0] Api ppl other (#528)

* first commit

* add async call

* add new api onnx export and jit trace

* add decorator

* fix ci

* fix torchscript ci

* fix loader

* better pipemanager

* remove comment, better import

* add kwargs

* Add new APIS for pplnn sdk and misc

* remove comment

* better pipeline manager

* merge fix

* update tools/onnx2pplnn.py

* rename function
 2022-05-31 09:18:18 +08:00
Yifan Zhou 6fa1787a04
Tutorial 05: ONNX Model Editing (#517) 
* tutorial 05

* Upload image

* resolve comments

* resolve comment
 2022-05-28 15:19:14 +08:00
HinGwenWoong aabab46d8a
[Enhancement] Improve MMDeploy Regression test (#425) 
* make regression test as a module under project

* using `--codebase` instead of  `--deploy-yml`

* Improve doc for `--codebase`

* Add shorter arg  `-p` for `--performance`

* make `checopoint-dir` as an arg for the script

* Gen error log when convert fail.

* Improve res code for testing

* Doc add sdk test detail

* Doc add env setup

* Fix lint

* Fix doc lint

* Improve model path in report

* Improve report title

* Improve report checkpoint path

* Fix lint

* move test yaml under `tests/regression`

* Improve the test yaml path

* Fix lint

* Improve doc

* make func `update_report` code better

* move doc to new location

* Fix arg

* Update arg details

* Use cpu when openvino and onnxruntime cpu package

* Fix word

* Fix func of openpyxl 3.0.9

* Add some info

* Fix lint

* Fix filename

* Fix doc link

* Fix dir name with space when is not sdk

* Add args `--models` for test specific model(s)

* not saving report when no model in codebase when using `--models`

* Fix doc

* Fix lint

* Add table for metric in doc

* Improve table for doc

* Using `None` install of `['all']`

* Improce doc

* set device type properly

* Increate popen bufsize

* Add `precision_type` in `work-dir`

* Fix popen stuck

* Fix lint

* Fix lint

* Fix popen stuck by using file handler

* Make metric dataset as a list

* Update mmseg.yml

* Remove 'FPS' in the report

* Update do_regression_test.md

* Improve log

* Fix codespell

* Fix doc

* ncnn only save `xxx.param` as checkpoint name in the report

Co-authored-by: maningsheng <mnsheng@yeah.net>
 2022-05-27 17:08:32 +08:00
AllentDan 571b240500
[Docs] adding new backends when using MMDeploy as a third package (#482) 
* update doc

* refine expression

* cn doc
 2022-05-27 14:23:28 +08:00
tpoisonooo ea0a9e5d43
feat(tools/deploy.py): support ncnn quantization (#476) 
* feat(tools): add onnx2ncnn_quant_table

* feat(tools): add quantization image dataset

* feat(tools): add image dataset

* feat(tools/deploy.py): support quant

* fix(CI): lint

* fix(CI): format

* docs(zh_cn): add quantization usage

* docs(zh_cn): add benchmark

* feat(tools): add onnx2ncnn_quant_table

* docs(zh_cn): add more test result

* CI(github): add quant script

* CI(.github/scripts): add test quant

* fix(CI): remove pushd and popd

* feat(CI): debug

* fix(CI): path error

* fix(CI): fix path

* fix(CI): install wget

* fix(CI): review advices

* improvement(mmdeploy): review advice

* fix(tools): rename to onnx2ncnn_quant_table.py

* improvement(tools): rename file

* improvement(test): remove useless

* fix(tools/quant_image_dataset): remove loadFile in test.pipeline

* docs(quantization.md): update description

* fix(CI): protobuf version

* fix(CI): pip install

* docs(quantization): review advice

* fix(CI): revert mmcv version

* fix(CI): udpate pb version

* fix(CI): update
 2022-05-26 19:53:56 +08:00
Yue Zhou 89204d16ce
[Feature] Support two stage rotated detector in MMRotate (#473) 
* upload

* add fake_multiclass_nms_rotated

* delete unused code

* align with pytorch

* Update delta_midpointoffset_rbbox_coder.py

* rewrite atan2

* Update bbox_nms.py
 2022-05-25 13:41:16 +08:00
Yifan Zhou d16720b127
Tutorial 04: onnx custom op (#508) 
* Add tutorial04

* lint

* add image

* resolve comment
 2022-05-24 11:33:01 +08:00
q.yao e3a8baac4c
[Enhancement] Support RotatedRetinaNet TensorRT (#422) 
* add rotated nms trt plugin

* fix ops output shape

* rebase

* fix lint

* add fp16, benchmark

* format docs

* remove unused definition, add ut

* add docs

* update docs

* add doc
 2022-05-24 10:34:22 +08:00
Zhiqiang Wang 57baf217f1
[docs] Fix typo in tutorial (#509) 2022-05-23 14:29:05 +08:00
AllentDan 9eee75b98f
More ocr models (#446) 
* rewrite sync batchnorm

* export panet and psenet

* resolution

* align fp16 for panet

* refine codes

* enable satrn for trt

* refine docs

* docstring

* docstring

* add ut and refine codes

* fix ut

* resolve comments and move panet-fp16 to doc

* remove ut

* refine ut

* resolve comments

* use size instead of img_scale

* use size of MultiScaleAug

Co-authored-by: dongchunyu.vendor <dongchunyu@pjlab.org.cn>
 2022-05-20 21:52:36 +08:00
q.yao a4b7bced55
[Feature] Support reppoints TensorRT (#457) 
* Support reppoints tensorrt

* add ut and docs

* update zh_cn documents

* update document
 2022-05-18 11:54:45 +08:00
Lakshantha Dissanayake 69111a6b95
Update: Optimize document (#484) 
* Update: Optimize document

- Minor fixes in styling and grammar
- Add support for Jetson Xavier NX (Tested and worked)
- Add hardware recommendation
- Change JetPack installation guide URL from jp5.0 to jp4.6.1
- Add a note to select "Jetson SDK Components" when using NVIDIA SDK Manager
- Change PyTorch wheel save location
- Add more dependencies needed for torchvision installation. Otherwise installation error
- Simplify torchvision git cloning branch
- Add installation times for torchvision, MMCV, versioned-hdf5, ppl.cv, model converter, SDK libraries
- Delete "snap" from cmake removal as "apt-get purge" is enough
- Add a note on which scenarios you need to append cu da path and libraries to PATH and LD_LIBRARY_PATH
- Simplify MMCV git cloning branch
- Delete "skip if you don't need MMDeploy C/C++ Inference SDK", because that is the only available inference SDK at the moment
- Add more details to object detection demo using C/C++ Inference SDK such as installing MMDetection and converting a model
- Add image of inference result
- Delete "set env for pip" in troubleshooting because this is already mentioned under "installing Archiconda"

Signed-off-by: Lakshantha Dissanayake <lakshanthad@seeed.cc>

* Fix: note style on doc

* Fix: Trim trailing whitespaces

* Update: add source image before inference
 2022-05-17 20:40:44 +08:00
chaoqun 21c2a85721
[Docs] Minor fixes and translation of installation tutorial for Jetson (#415) 
* minor fixes

* add Jetson installation

* updated zh_cn based on new en version
 2022-05-16 15:39:34 +08:00
tpoisonooo 9a4028bd49
fix(zh_CN): doc link (#447) 
* docs(zh_CN): fix link missing

* docs(benchmark.md): fix pytorch typo
 2022-05-12 12:22:50 +08:00
Zaida Zhou 3786856660
[Docs] Fix API documentation (#443) 
* [Docs] Fix API documentation

* add onnx dependency in readthedocs.txt

* fix dependencies
 2022-05-09 22:27:19 +08:00
Johannes L 94148cbe56
Version comments added, torch install steps added. (#449) 2022-05-09 22:22:00 +08:00
tpoisonooo 5f59b4464f
docs(docs/zh_cn): update doc and link checker (#418) 
* docs(docs/zh_cn): add doc and link checker

* docs(REAME): update

* docs(docs/zh_cn): update

* docs(benchmark): update table

* docs(zh_cn/benchmark): update link

* CI(docs): update link check

* ci(doc): update checker

* docs(zh_cn): update

* style(ci): remove useless para

* style(ci): update

* docs(zh_cn): update

* docs(benchmark.md): fix mobilnet link error

* docs(docs/zh_cn): add doc and link checker

* docs(REAME): update

* docs(docs/zh_cn): update

* docs(benchmark): update table

* docs(zh_cn/benchmark): update link

* CI(docs): update link check

* ci(doc): update checker

* docs(zh_cn): update

* style(ci): remove useless para

* style(ci): update

* docs(zh_cn): update

* docs(benchmark.md): fix mobilnet link error

* docs(zh_cn/do_regression_test.md): rebase

* docs(docs/zh_cn): add doc and link checker

* Update README_zh-CN.md

* Update README_zh-CN.md

* Update index.rst

* Update check-doc-link.yml

* [Fix] Fix ci (#426)

* fix ci

* add nvidia key

* remote torch

* recover pytorch

* ci(codecov): ignore ci

* docs(zh_cn): add get_started.md

* docs(zh_cn): fix review advice

* docs(readthedocs): update

* docs(zh_CN): update

* docs(zh_CN): revert

* fix(docs): review advices

* fix(docs): review advices

* fix(docs): review

Co-authored-by: q.yao <streetyao@live.com>
 2022-05-09 10:18:10 +08:00
HinGwenWoong f45c1f09b1
[Doc] Improve Jetson tutorial install doc (#381) 
* Improve Jetson build doc

* add torchvision in the doc

* Fix lint

* Fix lint

* Fix lint

* Fix arg bug

* remove incorrect process

* Improve doc

* Add more detail on `Conda`

* Add python version detail

* Install `onnx` instead of `onnxruntime`

* Fix gramma

* Fix gramma

* Update Installation detail and fix some doc detail

* Update how_to_install_mmdeploy_on_jetsons.md

* Fix tensorrt and cudnn path

* Improve FAQ

* Improve FAQs

* pplcv not switch branch since the `sm_53` missing

* Update how_to_install_mmdeploy_on_jetsons.md

* Update how_to_install_mmdeploy_on_jetsons.md

* Update how_to_install_mmdeploy_on_jetsons.md

* Update how_to_install_mmdeploy_on_jetsons.md

* Improve doc

* Update how_to_install_mmdeploy_on_jetsons.md

* export `TENSORRT_DIR`

* Using pre-build cmake to update

* Improve sentence and add jetpack version

* Improve sentence

* move TENSORRT_DIR in the `Make TensorRT env` step

* Improve CUDA detail

* Update how_to_install_mmdeploy_on_jetsons.md

* Update how_to_install_mmdeploy_on_jetsons.md

* Improve conda installation

* Improve TensorRT installation

* Fix lint

* Add pip crash detail and FAQ

* Improve pip crash

* refine the jetson installation guide

* Improve python version

* Improve doc, added some detail

* Fix lint

* Add detail for `Runtime` problem

* Fix word

* Update how_to_install_mmdeploy_on_jetsons.md

Co-authored-by: lvhan028 <lvhan_028@163.com>
 2022-05-07 19:38:25 +08:00
Yue Zhou 42dc5bc316
Support single stage rotated detector in MMRotate (#428) 
* fix lint

* fix lint

* add mmrotate part

* update

* update

* fix

* remove init_detector

* success run with bs=1

* nms_rotated support batch

* support [batch_id, class_id, box_id]

* fix

* fix

* Create test_mmrotate_core.py

* add ut

* add ut

* Update nms_rotated.py

* fix

* Revert "fix"

This reverts commit f792387fb4.

* add mmrotate into requirements

* add ut

* update doc

* update

* skip test because mmcv version < 1.4.6

* update

* Update rotated-detection_static.py

* Update rotated-detection_static.py

* Update rotated-detection_static.py

* fix bug of memory leak.

* Update rotated_detection_model.py
 2022-05-07 16:11:43 +08:00
hanrui1sensetime aa85760531
[Enhancement] Support litehrnet for ncnn (#316) 
* support for litehrnet

* support ncnn vulkan

* update supported models

* add docstring

* add one ut and fix wrapper

* add test_shuffleunit

* add test_stem_forward

* add last ut

* fix flake8

* fix yapf

* fix lint

* fix yapf

* fix comments

* unified chunk

* mv adaptive_avg_pool

* fix lint

* move adaptive_avg_pool_ncnn

* fix lint

* symbolic rewriter of adaptive_avg_pool2d

* fix lint

* fix yapf

* fix ci
 2022-04-29 16:46:19 +08:00
HinGwenWoong 22652175bc
[Feature] Regression test for mmdeploy (#302) 
* Add regression test script

* Add doc

* Add test yaml for mmdet

* evaluate_outputs Add return result

(cherry picked from commit c8c9cd75df)

* object_detection return metric after eval

(cherry picked from commit 1b8dcaa39e)

* move `deploy_config_dir` to `global_info` in test yaml

* fix path error

* Improve test yaml structure

* Add test env for saving regression report

* Fix SDK test report will crash

* Get SDK FPS

* Add mmcls regression test yaml

* Using CMD to test the backend result

* Get metric from log file

* Imporve coding

* Imporve coding

* restructure test yaml

* resturcture the test yaml and coding, using pipeline style

* Fixed wont saving into report when cant find `backend_test` and `sdk_config`

* set `metric_info` in test yaml

* improve test yaml

* Fixed will get black checkpoint file name

* Fix lint

* Fix yaml

* Add common in test yaml

* Resturcture mmcla test yaml

* Resturcture mmcla test yaml

* Improve mmcls test yaml

* mmcls test success

* Improve tes yaml field

* Add `--test-img` only when `test_img_path` is not None

* Add `precision_type` in report

* Not saving pkl result file any more

* Add 'x' install of '-' when script crash

* Fix some field in mmcls test yaml

* Add mmseg test yaml

* Add unknown backend final file name

* Improve backend file dict

* Add mmseg success

* unify the checkpoint path to relate path

* unify the checkpoint path to relate path

* Add mmpose, need to test

* Support backend file list to `--model` when test the backend

* Fix lint

* Add some common

* FPS get from log always get 1:10 line

* Add dataset in report when test backend

* Get dataset type from model config file

* Replace pipeline.json topk

* SDK report add backend name

* Add txt report, it will save each test

* update mmcls config

* Add `calib-dataset-cfg` in cmd when it exist  in tset yaml

* make model path shorter by cutting the work_dir_root

* Add `task_name` in test yaml

* Add `task_name` in report

* Improve test yaml

* Add mmocr test yaml

* Get mmocr fps metric success

* Add `dataset` feild in test yaml

* Report will skip when the dataset name not in test yaml

* Add dbnet in mmocr test yaml and success get metric

* Add mmedit test yaml

* Improve some common

* Add mmedit success

* Fix lint

* Fix isort lint

* Fix yapf lint

* Undo some changes in `evaluate_outputs`

* Undo some changes in `evaluate_outputs`

* Improve test requirement.txt

* Undo some changes in `evaluate_outputs`

* Improve doc

* Improve mmedit test yaml

* Using `--divice`

* Fix lint

* Using `--performance` replace `--test-type`

* Fix lint

* Fix page link

* Fix backend name

* Using `logger` instead of `print`

* Fix lint

* Add TorchScript in the doc

* Add type hint for all the funcs

* Fix docformatter lint

* Fix path in report have the root of work dir

* mmdet add other backend in tast yaml

* mmdet add other backend in tast yaml

* mmocr add other backend in tast yaml

* mmedit add other backend in tast yaml

* mmpose add other backend in tast yaml

* Delete filed `codebase_model_config_dir` in test yaml

* Using `Config` in metafile.yml instal of `Name` from allmodel config files.

* Fix yapf lint

* update mmpose mmseg config

* Fix lint

* Imporve mmcls test yaml

* Imporve mmedit test yaml

* Imporve mmedit test yaml

* Imporve mmseg test yaml

* update mmdet yml

* Not using pth when conver sucess when in only convert mode

* Using metafile dataset when can not get `model_cfg.dataset_type`

* Fixed `model_name` incorrect in some codebase

* Improve mmcls test yaml image

* Improve mmedit test yaml image

* Improve mmocr test yaml image

* Improve mmseg test yaml image

* Fix test yaml bug

* Support overwirte `metric_tolerance`

* Add `metric_tolerance` in mmcls

* Fixed yaml bug

* mmcls add all models, which had already supported, in test yaml

* Fix report will not replace to ${WORK_DIR}

* Add metric tolerance in mmcls test yaml

* Modefied mmcls global metric tolreance

* remove `metric_tolerance` in each pipeline

* Improve mmcls test yaml

* mmcls add TODO

* imporve test yaml `pp`l -> `pplnn`

* mmdet add all models, which had already supported, in test yaml

* mmedit add all models, which had already supported, in test yaml

* mmocr add all models, which had already supported, in test yaml

* mmpose add all models, which had already supported, in test yaml

* Replace `sdk_xxx_fp32` to `sdk_xxx`

* mmseg add all models, which had already supported, in test yaml

* Import the backend order of test yaml

* Fix mmseg test yaml pplnn static config

* Add notes for Windows user in the doc

* Fix get metric from different metric name but correct dataset name.

* Fix mmedit dataset incorrect

* Fix test yaml of mmedit

* Fix lint

* Fix mmpose can't find metric

* Improve mmseg trt testing config

* Add dataset in mmdet test yaml

* Add logs when continue in the code

* Fix mmpose get metric log error

* Fix mmdet can not get metric

* Add merge report into one

* Fix lint

* Add version in the report

* log2file for each backend

* Fix lint

* Improve report merge

* update mmseg yml to shape 1024x2048

* Fix dependences for merging report

* Imporve mmcls yaml, add `ShuffleNetV1` and `ShuffleNetV2`

* Fix name of model in test yaml with a space will crash when convert

* Add commons for test yaml metric tolerance

* Add mmdet seg detail config in test yaml

* Improve mmdet test yaml

* Fix mmdet mskrcnn metric

Co-authored-by: maningsheng <mnsheng@yeah.net>
 2022-04-28 08:03:59 +08:00
RunningLeon 95603486b0
fix benchmark (#411) 2022-04-27 10:30:03 +08:00
Yue Zhou 01a44c00c9
Add roi_align_rotated op for onnxruntime (#277) 
* init

* add doc

* add

* Update test_ops.py

* fix bug

* fix pose demo and windows build (#307)

* add postprocessing_masks gpu version (#276)

* add postprocessing_masks gpu version

* default device cpu

* pre-commit fix

Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>

* fixed a bug causes text-recognizer to fail when (non-NULL) empty bboxes list is passed (#310)

* [Fix] include missing <type_traits> for formatter.h (#313)

* fix formatter

* relax GCC version requirement

* fix lint

* Update onnxruntime.md

* fix lint

Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: Shengxi Li <982783556@qq.com>
Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
 2022-04-26 17:46:28 +08:00
Song Lin f6fcee5f12
Fix docs (#398) 2022-04-25 11:37:50 +08:00
hanrui1sensetime 85f17789d1
[Docs] fix ncnn docs (#378) 
* fix ncnn docs`

* update 0216
 2022-04-24 11:18:33 +08:00
Yifan Zhou 9dad97e1b7
Tutorial 03: torch2onnx (#365) 
* upload doc

* add images

* resolve comments

* update translation
 2022-04-24 11:15:40 +08:00
Yue Zhou 9411fe0466
Add nms_rotated ort op (#312) 
* fix pose demo and windows build (#307)

* init

* Update nms_rotated.cpp

* add postprocessing_masks gpu version (#276)

* add postprocessing_masks gpu version

* default device cpu

* pre-commit fix

Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>

* fixed a bug causes text-recognizer to fail when (non-NULL) empty bboxes list is passed (#310)

* [Fix] include missing <type_traits> for formatter.h (#313)

* fix formatter

* relax GCC version requirement

* fix

* fix lint

* fix lint

* [Fix] MMEditing cannot save results when testing (#336)

* fix show

* lint

* remove redundant codes

* resolve comment

* type hint

* docs(build): fix typo (#352)

* docs(build): add missing build option

* docs(build): add onnx install

* style(doc): trim whitespace

* docs(build): revert install onnx

* docs(build): add ncnn LD_LIBRARY_PATH

* docs(build): fix path error

* fix openvino export tmp model, add binary flag (#353)

* init circleci (#348)

* fix wrong input mat type (#362)

* fix wrong input mat type

* fix lint

* fix(docs): remove redundant doc tree (#360)

* fix missing ncnn_DIR & InferenceEngine_DIR (#364)

* update doc

Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: Shengxi Li <982783556@qq.com>
Co-authored-by: hadoop-basecv <hadoop-basecv@set-gh-basecv-serving-classify11.mt>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: tpoisonooo <khj.application@aliyun.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
 2022-04-18 17:14:47 +08:00
tpoisonooo 88062e90a4
fix(docs): remove redundant doc tree (#360) 2022-04-15 14:47:49 +08:00
tpoisonooo 89ce8e20a1
docs(build): fix typo (#352) 
* docs(build): add missing build option

* docs(build): add onnx install

* style(doc): trim whitespace

* docs(build): revert install onnx

* docs(build): add ncnn LD_LIBRARY_PATH

* docs(build): fix path error
 2022-04-14 22:13:26 +08:00
lvhan028 9306bcec80
Dev v0.4.0 (#301) 
* bump version to v0.4.0

* [Enhancement] Make rewriter more powerful (#150)

* Finish function tests

* lint

* resolve comments

* Fix tests

* docstring & fix

* Complement informations

* lint

* Add example

* Fix version

* Remove todo

Co-authored-by: RunningLeon <mnsheng@yeah.net>

* Torchscript support (#159)

* support torchscript

* add nms

* add torchscript configs and update deploy process and dump-info

* typescript -> torchscript

* add torchscript custom extension support

* add ts custom ops again

* support mmseg unet

* [WIP] add optimizer for torchscript (#119)

* add passes

* add python api

* Torchscript optimizer python api (#121)

* add passes

* add python api

* use python api instead of executable

* Merge Master, update optimizer (#151)

* [Feature] add yolox ncnn (#29)

* add yolox ncnn

* add ncnn android performance of yolox

* add ut

* fix lint

* fix None bugs for ncnn

* test codecov

* test codecov

* add device

* fix yapf

* remove if-else for img shape

* use channelshuffle optimize

* change benchmark after channelshuffle

* fix yapf

* fix yapf

* fuse continuous reshape

* fix static shape deploy

* fix code

* drop pad

* only static shape

* fix static

* fix docstring

* Added mask overlay to output image, changed fprintf info messages to … (#55)

* Added mask overlay to output image, changed fprintf info messages to stdout

* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds

* clang-format

* Support UNet in mmseg (#77)

* Repeatdataset in train has no CLASSES & PALETTE

* update result for unet

* update docstring for mmdet

* remove ppl for unet in docs

* fix ort wrap about input type (#81)

* Fix memleak (#86)

* delete []

* fix build error when enble MMDEPLOY_ACTIVE_LEVEL

* fix lint

* [Doc] Nano benchmark and tutorial (#71)

* add cls benchmark

* add nano zh-cn benchmark and en tutorial

* add device row

* add doc path to index.rst

* fix typo

* [Fix] fix missing deploy_core (#80)

* fix missing deploy_core

* mv flag to demo

* target link

* [Docs] Fix links in Chinese doc (#84)

* Fix docs in Chinese link

* Fix links

* Delete symbolic link and add links to html

* delete files

* Fix link

* [Feature] Add docker files (#67)

* add gpu and cpu dockerfile

* fix lint

* fix cpu docker and remove redundant

* use pip instead

* add build arg and readme

* fix grammar

* update readme

* add chinese doc for dockerfile and add docker build to build.md

* grammar

* refine dockerfiles

* add FAQs

* update Dpplcv_DIR for SDK building

* remove mmcls

* add sdk demos

* fix typo and lint

* update FAQs

* [Fix]fix check_env (#101)

* fix check_env

* update

* Replace convert_syncbatchnorm in mmseg (#93)

* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv

* change logger

* [Doc] Update FAQ for TensorRT (#96)

* update FAQ

* comment

* [Docs]: Update doc for openvino installation (#102)

* fix docs

* fix docs

* fix docs

* fix mmcv version

* fix docs

* rm blank line

* simplify non batch nms (#99)

* [Enhacement] Allow test.py to save evaluation results (#108)

* Add log file

* Delete debug code

* Rename logger

* resolve comments

* [Enhancement] Support mmocr v0.4+ (#115)

* support mmocr v0.4+

* 0.4.0 -> 0.4.1

* fix onnxruntime wrapper for gpu inference (#123)

* fix ncnn wrapper for ort-gpu

* resolve comment

* fix lint

* Fix typo (#132)

* lock mmcls version (#131)

* [Enhancement] upgrade isort in pre-commit config (#141)

* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87

* fix lint

* remove .isort.cfg and put its known_third_party to setup.cfg

* Fix ci for mmocr (#144)

* fix mmocr unittests

* remove useless

* lock mmdet maximum version to 2.20

* pip install -U numpy

* Fix capture_output (#125)

Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* configs for all tasks

* use torchvision roi align

* remote unnecessary code

* fix ut

* fix ut

* export

* det dynamic

* det dynamic

* add ut

* fix ut

* add ut and docs

* fix ut

* skip torchscript ut if no ops available

* add torchscript option to build.md

* update benchmark and resolve comments

* resolve conflicts

* rename configs

* fix mrcnn cuda test

* remove useless

* add version requirements to docs and comments to codes

* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN

* rebase

* update example for torchscript.md

* update FAQs for torchscript.md

* resolve comments

* only use torchvision roi_align for torchscript

* fix ut

* use torchvision roi align when pool model is avg

* resolve comments

Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* Update supported mmseg models (#181)

* fix ocrnet cascade decoder

* update mmseg support models

* update mmseg configs

* support emanet and icnet

* set max K of TopK for tensorrt

* update supported models for mmseg in docs

* add test for emamodule

* add configs and update docs

* Update docs

* update benchmark

* [Features]Support mmdet3d (#103)

* add mmdet3d code

* add code

* update code

* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model

* add tensorrt config

* fix config

* update

* support for tensorrt

* add config

* fix config`

* fix apis about torch2onnx

* update

* mmdet3d deploy version1.0

* map is ok

* fix code

* version1.0

* fix code

* fix visual

* fix bug

* tensorrt support success

* add docstring

* add docs

* fix docs

* fix comments

* fix comment

* fix comment

* fix openvino wrapper

* add unit test

* fix device about cpu

* fix comment

* fix show_result

* fix lint

* fix requirments

* remove ci about det3d

* fix ut

* add ut data

* support for new version pointpillars

* fix comment

* fix support_list

* fix comments

* fix config name

* [Enhancement] Update pad logic in detection heads (#168)

* pad with register

* fix lint

Co-authored-by: AllentDan <dongchunyu@sensetime.com>

* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178)

* Add mo args.

* [Docs]: update docs and argument descriptions (#196)

* bump version to v0.4.0

* update docs and argument descriptions

* revert version change

* fix unnecessary change of config for dynamic exportation (#199)

* fix mmcls get classes (#215)

* fix mmcls get classes

* resolve comment

* resolve comment

* Add ModelOptimizerOptions.

* Fix merge bugs.

* Update mmpose.md (#224)

* [Dostring]add example in apis docstring (#214)

* add example in apis docstring

* add backend example in docstring

* rm blank line

* Fixed get_mo_options_from_cfg args

* fix l2norm test

Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>

* [Enhancement] Switch to statically typed Value::Any (#209)

* replace std::any with StaticAny

* fix __compare_typeid

* remove fallback id support

* constraint on traits::TypeId<T>::value

* fix includes

* [Enhancement] TensorRT DCN support (#205)

* add tensorrt dcn support

* fix lint

* remove roi_align plugin for ORT (#258)

* remove roi_align plugin

* remove ut

* skip single_roi_extractor UT for ORT in CI

* move align to symbolic and update docs

* recover UT

* resolve comments

* [Enhancement]: Support fcn_unet deployment with dynamic shape (#251)

* support mmseg fcn+unet dynamic shape

* add test

* fix ci

* fix units

* resolve comments

* [Enhancement] fix-cmake-relocatable (#223)

* require user to specify xxx_dir

* fix line ending

* fix end-of-file-fixer

* try to fix ld cudart cublas

* add ENV var search

* fix CMAKE_CUDA_COMPILER

* cpu, cuda should all work well

* remove commented code

* fix ncnn example find ncnn package (#282)

* table format is wrong (#283)

* update pre-commit (#284)

* update pre-commit

* fix clang-format

* fix mmseg config (#281)

* fix mmseg config

* fix mmpose evaluate outputs

* fix lint

* update pre-commit config

* fix lint

* Revert "update pre-commit config"

This reverts commit c3fd71611f.

* miss code symbol (#296)

* refactor cmake build (#295)

* add-mmpose-sdk (#259)

* Torchscript support (#159)

* support torchscript

* add nms

* add torchscript configs and update deploy process and dump-info

* typescript -> torchscript

* add torchscript custom extension support

* add ts custom ops again

* support mmseg unet

* [WIP] add optimizer for torchscript (#119)

* add passes

* add python api

* Torchscript optimizer python api (#121)

* add passes

* add python api

* use python api instead of executable

* Merge Master, update optimizer (#151)

* [Feature] add yolox ncnn (#29)

* add yolox ncnn

* add ncnn android performance of yolox

* add ut

* fix lint

* fix None bugs for ncnn

* test codecov

* test codecov

* add device

* fix yapf

* remove if-else for img shape

* use channelshuffle optimize

* change benchmark after channelshuffle

* fix yapf

* fix yapf

* fuse continuous reshape

* fix static shape deploy

* fix code

* drop pad

* only static shape

* fix static

* fix docstring

* Added mask overlay to output image, changed fprintf info messages to … (#55)

* Added mask overlay to output image, changed fprintf info messages to stdout

* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds

* clang-format

* Support UNet in mmseg (#77)

* Repeatdataset in train has no CLASSES & PALETTE

* update result for unet

* update docstring for mmdet

* remove ppl for unet in docs

* fix ort wrap about input type (#81)

* Fix memleak (#86)

* delete []

* fix build error when enble MMDEPLOY_ACTIVE_LEVEL

* fix lint

* [Doc] Nano benchmark and tutorial (#71)

* add cls benchmark

* add nano zh-cn benchmark and en tutorial

* add device row

* add doc path to index.rst

* fix typo

* [Fix] fix missing deploy_core (#80)

* fix missing deploy_core

* mv flag to demo

* target link

* [Docs] Fix links in Chinese doc (#84)

* Fix docs in Chinese link

* Fix links

* Delete symbolic link and add links to html

* delete files

* Fix link

* [Feature] Add docker files (#67)

* add gpu and cpu dockerfile

* fix lint

* fix cpu docker and remove redundant

* use pip instead

* add build arg and readme

* fix grammar

* update readme

* add chinese doc for dockerfile and add docker build to build.md

* grammar

* refine dockerfiles

* add FAQs

* update Dpplcv_DIR for SDK building

* remove mmcls

* add sdk demos

* fix typo and lint

* update FAQs

* [Fix]fix check_env (#101)

* fix check_env

* update

* Replace convert_syncbatchnorm in mmseg (#93)

* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv

* change logger

* [Doc] Update FAQ for TensorRT (#96)

* update FAQ

* comment

* [Docs]: Update doc for openvino installation (#102)

* fix docs

* fix docs

* fix docs

* fix mmcv version

* fix docs

* rm blank line

* simplify non batch nms (#99)

* [Enhacement] Allow test.py to save evaluation results (#108)

* Add log file

* Delete debug code

* Rename logger

* resolve comments

* [Enhancement] Support mmocr v0.4+ (#115)

* support mmocr v0.4+

* 0.4.0 -> 0.4.1

* fix onnxruntime wrapper for gpu inference (#123)

* fix ncnn wrapper for ort-gpu

* resolve comment

* fix lint

* Fix typo (#132)

* lock mmcls version (#131)

* [Enhancement] upgrade isort in pre-commit config (#141)

* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87

* fix lint

* remove .isort.cfg and put its known_third_party to setup.cfg

* Fix ci for mmocr (#144)

* fix mmocr unittests

* remove useless

* lock mmdet maximum version to 2.20

* pip install -U numpy

* Fix capture_output (#125)

Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* configs for all tasks

* use torchvision roi align

* remote unnecessary code

* fix ut

* fix ut

* export

* det dynamic

* det dynamic

* add ut

* fix ut

* add ut and docs

* fix ut

* skip torchscript ut if no ops available

* add torchscript option to build.md

* update benchmark and resolve comments

* resolve conflicts

* rename configs

* fix mrcnn cuda test

* remove useless

* add version requirements to docs and comments to codes

* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN

* rebase

* update example for torchscript.md

* update FAQs for torchscript.md

* resolve comments

* only use torchvision roi_align for torchscript

* fix ut

* use torchvision roi align when pool model is avg

* resolve comments

Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* Update supported mmseg models (#181)

* fix ocrnet cascade decoder

* update mmseg support models

* update mmseg configs

* support emanet and icnet

* set max K of TopK for tensorrt

* update supported models for mmseg in docs

* add test for emamodule

* add configs and update docs

* Update docs

* update benchmark

* [Features]Support mmdet3d (#103)

* add mmdet3d code

* add code

* update code

* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model

* add tensorrt config

* fix config

* update

* support for tensorrt

* add config

* fix config`

* fix apis about torch2onnx

* update

* mmdet3d deploy version1.0

* map is ok

* fix code

* version1.0

* fix code

* fix visual

* fix bug

* tensorrt support success

* add docstring

* add docs

* fix docs

* fix comments

* fix comment

* fix comment

* fix openvino wrapper

* add unit test

* fix device about cpu

* fix comment

* fix show_result

* fix lint

* fix requirments

* remove ci about det3d

* fix ut

* add ut data

* support for new version pointpillars

* fix comment

* fix support_list

* fix comments

* fix config name

* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178)

* Add mo args.

* [Docs]: update docs and argument descriptions (#196)

* bump version to v0.4.0

* update docs and argument descriptions

* revert version change

* fix unnecessary change of config for dynamic exportation (#199)

* fix mmcls get classes (#215)

* fix mmcls get classes

* resolve comment

* resolve comment

* Add ModelOptimizerOptions.

* Fix merge bugs.

* Update mmpose.md (#224)

* [Dostring]add example in apis docstring (#214)

* add example in apis docstring

* add backend example in docstring

* rm blank line

* Fixed get_mo_options_from_cfg args

* fix l2norm test

Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>

* add-mmpose-codebase

* fix ci

* fix img_shape after TopDownAffine

* rename TopDown module -> XheadDecode & implement regression decode

* align keypoints_from_heatmap

* remove hardcode keypoint_head, need refactor, current only support topdown config

* add mmpose python api

* update mmpose-python code

* can't clip fake box

* fix rebase error

* fix rebase error

* link mspn decoder to base decoder

* fix ci

* compile with gcc7.5

* remove no use code

* fix

* fix prompt

* remove unnecessary cv::parallel_for_

* rewrite TopdownHeatmapMultiStageHead.inference_model

* add comment

* add more detail docstring why use _cs2xyxy in sdk backend

* fix Registry name

* remove no use param & add comment of output result

Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>

* update faq about WinError 1455 (#297)

* update faq about WinError 1455

* Update faq.md

* Update faq.md

* fix ci

Co-authored-by: chenxin2 <chenxin2@sensetime.com>

* [Feature]Support centerpoint (#252)

* bump version to v0.4.0

* [Enhancement] Make rewriter more powerful (#150)

* Finish function tests

* lint

* resolve comments

* Fix tests

* docstring & fix

* Complement informations

* lint

* Add example

* Fix version

* Remove todo

Co-authored-by: RunningLeon <mnsheng@yeah.net>

* Torchscript support (#159)

* support torchscript

* add nms

* add torchscript configs and update deploy process and dump-info

* typescript -> torchscript

* add torchscript custom extension support

* add ts custom ops again

* support mmseg unet

* [WIP] add optimizer for torchscript (#119)

* add passes

* add python api

* Torchscript optimizer python api (#121)

* add passes

* add python api

* use python api instead of executable

* Merge Master, update optimizer (#151)

* [Feature] add yolox ncnn (#29)

* add yolox ncnn

* add ncnn android performance of yolox

* add ut

* fix lint

* fix None bugs for ncnn

* test codecov

* test codecov

* add device

* fix yapf

* remove if-else for img shape

* use channelshuffle optimize

* change benchmark after channelshuffle

* fix yapf

* fix yapf

* fuse continuous reshape

* fix static shape deploy

* fix code

* drop pad

* only static shape

* fix static

* fix docstring

* Added mask overlay to output image, changed fprintf info messages to … (#55)

* Added mask overlay to output image, changed fprintf info messages to stdout

* Improved box filtering (filter area/score), make sure roi coordinates stay within bounds

* clang-format

* Support UNet in mmseg (#77)

* Repeatdataset in train has no CLASSES & PALETTE

* update result for unet

* update docstring for mmdet

* remove ppl for unet in docs

* fix ort wrap about input type (#81)

* Fix memleak (#86)

* delete []

* fix build error when enble MMDEPLOY_ACTIVE_LEVEL

* fix lint

* [Doc] Nano benchmark and tutorial (#71)

* add cls benchmark

* add nano zh-cn benchmark and en tutorial

* add device row

* add doc path to index.rst

* fix typo

* [Fix] fix missing deploy_core (#80)

* fix missing deploy_core

* mv flag to demo

* target link

* [Docs] Fix links in Chinese doc (#84)

* Fix docs in Chinese link

* Fix links

* Delete symbolic link and add links to html

* delete files

* Fix link

* [Feature] Add docker files (#67)

* add gpu and cpu dockerfile

* fix lint

* fix cpu docker and remove redundant

* use pip instead

* add build arg and readme

* fix grammar

* update readme

* add chinese doc for dockerfile and add docker build to build.md

* grammar

* refine dockerfiles

* add FAQs

* update Dpplcv_DIR for SDK building

* remove mmcls

* add sdk demos

* fix typo and lint

* update FAQs

* [Fix]fix check_env (#101)

* fix check_env

* update

* Replace convert_syncbatchnorm in mmseg (#93)

* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv

* change logger

* [Doc] Update FAQ for TensorRT (#96)

* update FAQ

* comment

* [Docs]: Update doc for openvino installation (#102)

* fix docs

* fix docs

* fix docs

* fix mmcv version

* fix docs

* rm blank line

* simplify non batch nms (#99)

* [Enhacement] Allow test.py to save evaluation results (#108)

* Add log file

* Delete debug code

* Rename logger

* resolve comments

* [Enhancement] Support mmocr v0.4+ (#115)

* support mmocr v0.4+

* 0.4.0 -> 0.4.1

* fix onnxruntime wrapper for gpu inference (#123)

* fix ncnn wrapper for ort-gpu

* resolve comment

* fix lint

* Fix typo (#132)

* lock mmcls version (#131)

* [Enhancement] upgrade isort in pre-commit config (#141)

* [Enhancement] upgrade isort in pre-commit config by refering to mmflow pr #87

* fix lint

* remove .isort.cfg and put its known_third_party to setup.cfg

* Fix ci for mmocr (#144)

* fix mmocr unittests

* remove useless

* lock mmdet maximum version to 2.20

* pip install -U numpy

* Fix capture_output (#125)

Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* configs for all tasks

* use torchvision roi align

* remote unnecessary code

* fix ut

* fix ut

* export

* det dynamic

* det dynamic

* add ut

* fix ut

* add ut and docs

* fix ut

* skip torchscript ut if no ops available

* add torchscript option to build.md

* update benchmark and resolve comments

* resolve conflicts

* rename configs

* fix mrcnn cuda test

* remove useless

* add version requirements to docs and comments to codes

* enable empty image exporting for torchscript and accelerate ORT inference for MRCNN

* rebase

* update example for torchscript.md

* update FAQs for torchscript.md

* resolve comments

* only use torchvision roi_align for torchscript

* fix ut

* use torchvision roi align when pool model is avg

* resolve comments

Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* Update supported mmseg models (#181)

* fix ocrnet cascade decoder

* update mmseg support models

* update mmseg configs

* support emanet and icnet

* set max K of TopK for tensorrt

* update supported models for mmseg in docs

* add test for emamodule

* add configs and update docs

* Update docs

* update benchmark

* [Features]Support mmdet3d (#103)

* add mmdet3d code

* add code

* update code

* [log]This commit finish pointpillar export and evaluate on onnxruntime.The model is sample with nvidia repo model

* add tensorrt config

* fix config

* update

* support for tensorrt

* add config

* fix config`

* fix apis about torch2onnx

* update

* mmdet3d deploy version1.0

* map is ok

* fix code

* version1.0

* fix code

* fix visual

* fix bug

* tensorrt support success

* add docstring

* add docs

* fix docs

* fix comments

* fix comment

* fix comment

* fix openvino wrapper

* add unit test

* fix device about cpu

* fix comment

* fix show_result

* fix lint

* fix requirments

* remove ci about det3d

* fix ut

* add ut data

* support for new version pointpillars

* fix comment

* fix support_list

* fix comments

* fix config name

* [Enhancement] Update pad logic in detection heads (#168)

* pad with register

* fix lint

Co-authored-by: AllentDan <dongchunyu@sensetime.com>

* [Enhancement] Additional arguments support for OpenVINO Model Optimizer (#178)

* Add mo args.

* [Docs]: update docs and argument descriptions (#196)

* bump version to v0.4.0

* update docs and argument descriptions

* revert version change

* fix unnecessary change of config for dynamic exportation (#199)

* fix mmcls get classes (#215)

* fix mmcls get classes

* resolve comment

* resolve comment

* Add ModelOptimizerOptions.

* Fix merge bugs.

* Update mmpose.md (#224)

* [Dostring]add example in apis docstring (#214)

* add example in apis docstring

* add backend example in docstring

* rm blank line

* Fixed get_mo_options_from_cfg args

* fix l2norm test

Co-authored-by: RunningLeon <mnsheng@yeah.net>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>

* [Enhancement] Switch to statically typed Value::Any (#209)

* replace std::any with StaticAny

* fix __compare_typeid

* remove fallback id support

* constraint on traits::TypeId<T>::value

* fix includes

* support for centerpoint

* [Enhancement] TensorRT DCN support (#205)

* add tensorrt dcn support

* fix lint

* add docstring and dcn model support

* add centerpoint ut and docs

* add config and fix input rank

* fix merge error

* fix a bug

* fix comment

* [Doc] update benchmark add supported-model-list (#286)

* update benchmark add supported-model-list

* fix lint

* fix lint

* loc mmocr maximum version

* fix ut

Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>

Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: grimoire <streetyao@live.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Co-authored-by: Johannes L <tehkillerbee@users.noreply.github.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: 杨培文 (Yang Peiwen) <915505626@qq.com>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: AllentDan <dongchunyu@sensetime.com>
Co-authored-by: Haofan Wang <frankmiracle@outlook.com>
Co-authored-by: lzhangzz <lzhang329@gmail.com>
Co-authored-by: Chen Xin <xinchen.tju@gmail.com>
Co-authored-by: chenxin2 <chenxin2@sensetime.com>
 2022-04-01 18:14:23 +08:00
AllentDan 47b8e6e71c
[Doc] update benchmark add supported-model-list (#286) 
* update benchmark add supported-model-list

* fix lint

* fix lint

* loc mmocr maximum version
 2022-04-01 12:26:34 +08:00
lvhan028 116d2316fc
Update build doc (#203) 
* check in initial version of linux build documents

* update en/build/linux.md

* remove line break

* update build doc

* check in build documents in Chinese

* reorg chapter

* update build documents for windows platform

* update zh_cn/windows.md

* simplify build commands

* update build docs

* update build.md

* update

* reorg the chapters

* refine words

* correct the commands for windows build

* correct build commands for windows

* Trim Trailing Whitespace

* use prebuilt cmake instead of building it from source

* move <br> bewtween <pre><code> and </code></pre> cuz it isn't rendered correctly in github

* add build chapter about torchscript

* rebase master and update android

* fix lint

* correct the command of building ppl.cv
 2022-03-28 13:45:08 +08:00
hanrui1sensetime 6948e3d04b
Ncnn demo sdk (#164) 
* fix different dims and data sync and fp16 macro

* fix pad is negative bug, but still need debugging info

* split detection_output to dets and labels

* fix clang++ compile bug

* for fp16 compile macro of cmake

* fix pad_val dict input

* fix yolox missing normalization and get int tensor

* about score_threshold

* remove -lstdc++fs for android

* move -pthread for android

* fix link libraries for CLANG++;

* fix clang-format

* for mobileyolov3 conf_thre

* fix lint

* fix bug

* support ncnn vulkan net

* remove unused debugging info;

* Change INFO to DEBUG

* support vulkan precision mapping

* fix pad

* optimize getdetslabels

* remove EVAL_MODE

* ncnn_net support 4-dim data.

* remove FP16 compile options

* remove use_gpu_vulkan compile options

* fix pad.cpp

* fix yapf

* fix clang-format

* rm redundant lines

* fix pad according to mmdet

* add android build docs

* fix lint

* use cpp style string comparision

* fix use after free bug

* Add missing -DBUILD_SHARED_LIBS=OFF for en

* Add missing -DBUILD_SHARED_LIBS=OFF for ZH-CN

* reset img2tensor_impl

* reset img2tensor_impl

* add blank line

* sync android.md docs

* fix some dirs

* fix docs

* update docs

* fix code
 2022-03-25 23:28:16 +08:00
AllentDan f01506c62a
[Docs] add faq to `How to install mmdeploy on Jetsons` (#243) 
* add faq

* rephrase

* add assert

* get arch in host

* use thresh 1000 for pre_top_k

* enable ignoring soft link of work_dirs in codebase directory

* assert -> warning

* fix lint

* fix lint
 2022-03-23 10:58:11 +08:00
张文俊 51e003bec5
Fix docker build for users inside (#227) 
* fix the related questions of Connection failed [IP: 91.189.88.152 80] or [IP: 91.189.88.142 80] in Dockerfile

* add an ARG to control whether to change the download source for GPU and CPU Dockerfile, and update corresponding changes to the documents

* add an ARG to control whether to change the download source for GPU and CPU Dockerfile, and update corresponding changes to the documents

* update documentation

* update documentation

* fix lint error

Co-authored-by: zhangwenjun <zhangwenjun@clustar.ai>
 2022-03-17 21:25:25 +08:00
lvhan028 b6ff258935
check in the 2nd tutorial (#228) 
* check in the 2nd tutorial

* update index

* add new line

* trailing whitespace

* describe how to get srcnn.pth and face.png

* rename file name

* update index
 2022-03-11 11:12:38 +08:00
Haofan Wang 0096aacd3e
Update mmpose.md (#224) 2022-03-10 11:33:14 +08:00
RunningLeon 8552d35ceb
[Docs]: update docs and argument descriptions (#196) 
* bump version to v0.4.0

* update docs and argument descriptions

* revert version change
 2022-03-08 16:53:11 +08:00
Joson 24c7f478a3
[Docs]add "How to support new backends"中文翻译 (#176) 
* Add files via upload

* Update how_to_support_new_backends.md

* Update how_to_support_new_backends.md

* Delete how_to_support_new_backends.md

* Add files via upload

* Update how_to_support_new_backends.md

* Update how_to_support_new_backends.md

* Update how_to_support_new_backends.md

* Update how_to_support_new_backends.md

* 麻了

* fix

* fix

* fix

* fix

* fix

* fix

* fix
 2022-03-08 16:11:46 +08:00
lvhan028 8adb41fb72
Tutorial-01: introduction to model deployment (#207) 
* introduction to model deployment

* remove comments

* trim trailing whitespace

* add link
 2022-03-07 17:20:15 +08:00
HinGwenWoong 8a43621ce0
[Docs] Improve Chinese and English build.md (#191) 
* Improve build.md

* Improve chinese build.md

* Imporve Chinese doc, using 您 when translate 'you'

* Update build.md, change pip install cmd
 2022-03-07 17:19:03 +08:00
Richard-mei ba5351e209
add gfl_trt (#124) 
* add gfl_trt

* add gfl_head.py

* add batch_integral

* lint code

* add gfl unit test

* fix unit test

* add gfl benchmark

* fix unit test bug

* Update gfl_head.py

* Update __init__.py

remove '**_forward_single'

* fix lint error and ut error

* fix docs and benchmark

Co-authored-by: VVsssssk <shenkun@pjlab.org.cn>
 2022-02-28 16:28:00 +08:00
lzhangzz 640aa03538
Support Windows (#106) 
* minor changes

* support windows

* fix GCC build

* fix lint

* reformat

* fix Windows build

* fix GCC build

* search backend ops for onnxruntime

* fix lint

* fix lint

* code clean-up

* code clean-up

* fix clang build

* fix trt support

* fix cmake for ncnn

* fix cmake for openvino

* fix SDK Python API

* handle ops for other backends (ncnn, trt)

* handle SDK Python API library location

* robustify linkage

* fix cuda

* minor fix for openvino & ncnn

* use CMAKE_CUDA_ARCHITECTURES if set

* fix cuda preprocessor

* fix misc

* fix pplnn & pplcv, drop support for pplcv<0.6.0

* robustify cmake

* update build.md (#2)

* build dynamic modules as module library & fix demo (partially)

* fix candidate path for mmdeploy_python

* move "enable CUDA" to cmake config for demo

* refine demo cmake

* add comment

* fix ubuntu build

* revert docs/en/build.md

* fix C API

* fix lint

* Windows build doc (#3)

* check in docs related to mmdeploy build on windows

* update build guide on windows platform

* update build guide on windows platform

* make path of thirdparty libraries consistent

* make path consistency

* correct build command for custom ops

* correct build command for sdk

* update sdk build instructions

* update doc

* correct build command

* fix lint

* correct build command and fix lint

Co-authored-by: lvhan <lvhan@pjlab.org>

* trailing whitespace (#4)

* minor fix

* fix sr sdk model

* fix type deduction

* fix cudaFree after driver shutting down

* update ppl.cv installation warning (#5)

* fix device allocator threshold & fix lint

* update doc (#6)

* update ppl.cv installation warning

* missing 'git clone'

Co-authored-by: chenxin <chenxin2@sensetime.com>
Co-authored-by: zhangli <zhangli@sensetime.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
Co-authored-by: lvhan <lvhan@pjlab.org>
 2022-02-24 20:08:44 +08:00
tripleMu 486d45e739
[FIX] update docs and configs about openvino ssd deployment (#175) 
* add openvino static config for docs' ssd deploy

* fix docs of openvino.md

* fix ssd openvino deployment

* rename openvino config

* remove some files
 2022-02-24 16:09:58 +08:00
Haofan Wang 141d956636
[Docs] Update get_started.md (#173) 
* Update get_started.md

* Update get_started.md
 2022-02-22 15:31:21 +08:00
TheSeriousProgrammer 59470fef0b
Lock pplcv to v0.6.1 (#143) 
* Lock pplcv to v0.6.1

To avoid breaking changes which arose from recent updates in pplcv , fix pplcv to v0.6.1

* Mentioned Version as ARG

* Mentioned Version changes of pplcv in build.md

* Update docs/en/build.md

Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>

* Change version stuff in cn_build.md

Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
 2022-02-16 11:54:29 +08:00
RunningLeon 787ebc2392
[Feature]: Support mmpose (#94) 
* add mmpose code

* update

* update

* add rewrites

* test trt

* test litehrnet with trt

* revert unused change

* add docs about mmpose

* add docstring and staticmethod

* update

* update

* update docs

* fix config name and docs

* add pose_detection ut

* add pose data

* fix lint of model.py

* add pose_detection_model ut

* fix docs and docstrinf

* add test_mmpose_models.py

* fix yapf

* fix lint

* fix create input

* support ort ut

* fix yapf

* fix docs

* fix createinput

* test ci bug

* rm test1.py

* fix yapf

* fix flake8

* fix yapf

* add config and update benchmark

* fix table format

* update mmpose benchmark

* update benchmark for mmpose

* run mmpose tests seperately in ci

* fix lint

* resolve comments

* add trt ut config

* fix test

* fix tests

* resolve comments

* resolve comments

* update tests

Co-authored-by: VVsssssk <shenkun@pjlab.org.cn>
Co-authored-by: hanrui1sensetime <hanrui1@sensetime.com>
 2022-02-16 11:03:12 +08:00
uniyushu a42c44008a
[Docs] Update Chinese how_to_write_config.md (#137) 
* add zh-cn documentations

* Update how_to_write_config.md

* Update how_to_write_config.md

* Update how_to_write_config.md

* add zh-cn documentation

* refactor doc

* refactor doc

* [DOC] add zh-cn tutorials

* [Feature] Add Chinese how to write config doc

* Update how_to_write_config.md

* Update how_to_write_config.md

* Update how_to_write_config.md

* Update how_to_write_config.md

* Update how_to_write_config.md

* Update how_to_write_config.md

* Update how_to_write_config.md

* [Docs] Update Chinese how_to_write_config.md

* [Docs] Update Chinese how_to_write_config.md

* [Docs] Update Chinese how_to_write_config.md

* [Docs] Update Chinese how_to_write_config.md

* [Docs] Update Chinese how_to_write_config.md

Co-authored-by: yushu <uniyushu@163.com>
Co-authored-by: uniyushu <aaayushu@gmail.com >
 2022-02-15 14:30:11 +08:00
Yifan Zhou 668fb16abc
[Doc] Update Nvidia Jetson TX2 benchmark (#109) 
* Update benchmark

* Update table format

* Fix content

* format

* format
 2022-02-14 17:49:49 +08:00
MingJian.L c3c7600967
Create How to support new model.md (#147) 
* Create How to support new model.md

Translated the document into Chinese and create the doc in the  /docs/zh_cn/tutorials/How to support new model.md

* Update and rename How to support new model.md to How_to_support_new_model.md

* Update and rename How_to_support_new_model.md to how_to_support_new_model.md

* Update how_to_support_new_model.md
 2022-02-14 14:28:15 +08:00
RunningLeon 3eff20d2ac
update mmcv install (#149) 2022-02-11 20:03:00 +08:00
Semyon Bevzyuk af13086466
Fix capture_output (#125) 2022-02-10 16:03:26 +08:00
杨培文 (Yang Peiwen) 89372d8659
Fix typo (#132) 2022-02-08 16:59:33 +08:00
Yifan Zhou 230596bad9
[Enhacement] Allow test.py to save evaluation results (#108) 
* Add log file

* Delete debug code

* Rename logger

* resolve comments
 2022-01-26 19:57:00 +08:00
VVsssssk a543d41159
[Docs]: Update doc for openvino installation (#102) 
* fix docs

* fix docs

* fix docs

* fix mmcv version

* fix docs

* rm blank line
 2022-01-26 17:51:23 +08:00
q.yao d522874eec
[Doc] Update FAQ for TensorRT (#96) 
* update FAQ

* comment
 2022-01-26 16:06:44 +08:00
RunningLeon 0556feec79
Replace convert_syncbatchnorm in mmseg (#93) 
* replace convert_syncbatchnorm with revert_sync_batchnorm from mmcv

* change logger
 2022-01-26 11:07:28 +08:00
AllentDan 57a9d9b642
[Feature] Add docker files (#67) 
* add gpu and cpu dockerfile

* fix lint

* fix cpu docker and remove redundant

* use pip instead

* add build arg and readme

* fix grammar

* update readme

* add chinese doc for dockerfile and add docker build to build.md

* grammar

* refine dockerfiles

* add FAQs

* update Dpplcv_DIR for SDK building

* remove mmcls

* add sdk demos

* fix typo and lint

* update FAQs
 2022-01-25 15:11:50 +08:00
Yifan Zhou c9b063cdec
[Docs] Fix links in Chinese doc (#84) 
* Fix docs in Chinese link

* Fix links

* Delete symbolic link and add links to html

* delete files

* Fix link
 2022-01-25 14:46:57 +08:00
AllentDan eeddd8afe5
[Doc] Nano benchmark and tutorial (#71) 
* add cls benchmark

* add nano zh-cn benchmark and en tutorial

* add device row

* add doc path to index.rst

* fix typo
 2022-01-24 14:43:38 +08:00
RunningLeon 8ceb001d31
Support UNet in mmseg (#77) 
* Repeatdataset in train has no CLASSES & PALETTE

* update result for unet

* update docstring for mmdet

* remove ppl for unet in docs
 2022-01-19 19:11:04 +08:00
hanrui1sensetime e6e32a9db4
[Feature] add yolox ncnn (#29) 
* add yolox ncnn

* add ncnn android performance of yolox

* add ut

* fix lint

* fix None bugs for ncnn

* test codecov

* test codecov

* add device

* fix yapf

* remove if-else for img shape

* use channelshuffle optimize

* change benchmark after channelshuffle

* fix yapf

* fix yapf

* fuse continuous reshape

* fix static shape deploy

* fix code

* drop pad

* only static shape

* fix static

* fix docstring
 2022-01-19 13:54:45 +08:00
RunningLeon 76f96f09bc
remove partition configs and docs (#59) 2022-01-11 18:38:54 +08:00
hanrui1sensetime de367b72bf
ncnn version 1208 (#47) 2022-01-07 11:04:28 +08:00
VVsssssk 48bea16b31
【Docs】fix docs (#32) 
* fix docs

* fix cn docs log link

* fix

* fix log link
 2021-12-31 14:36:55 +08:00
AllentDan 6383da6db0
fix pplnn results for mmseg (#31) 2021-12-30 17:52:48 +08:00
Yifan Zhou db00e847c2
[Docs] add switch-language (#25) 
* add switch-language

* Update shared menu

* Modify logo

* Modify image

* Modify image

* Modify css

* transparent logo
 2021-12-30 12:36:01 +08:00
RunningLeon f2594c624b
add openvino.md to index.rst (#11) 2021-12-27 20:21:08 +08:00
AllentDan 26d40fe883
fix (#10) 2021-12-27 13:45:35 +08:00
q.yao 466ed64739
update links (#9) 
* update links

* remove link
 2021-12-27 13:01:27 +08:00
AllentDan 3a8b9837ce
Url (#7) 
* fix url Co-authored-by: maningsheng@sensetime.com

* fix url

Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>

* fix url

Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>

Co-authored-by: maningsheng <mnsheng@yeah.net>
Co-authored-by: Semyon Bevzyuk <semen.bevzuk@gmail.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
 2021-12-27 11:08:21 +08:00
AllentDan cfd41d03e2
add ncnn latency benchmark to zh_cn (#5) 2021-12-27 10:20:15 +08:00
VVsssssk 09f14fa4b7
[Docs]Remove cn docs (#335) 
* remove cn docs

* fix index.rst

* fix index.rst
 2021-12-24 18:14:45 +08:00
VVsssssk 15bdafed1f
[Docs]Add a support model list. (#333) 
* add docs about support model

* fix docs

* fix support list

* fix docs

* fix format

* fix how to convert model

* fix en and cn docs about convert model

* fix bash

* fix docs format

* fix readme

* fix benchmark

* fix cn docs link

* rename support models

* rename

* fix docs

* fix cn benchmark

* fix benchmark
 2021-12-24 17:20:06 +08:00
q.yao 02e033ba5b
[Docs] Add zh_cn get_started (#327) 
* start up

* zh-cn v0.1

* [Docs] Add a from-scratch example for "Get Started" (#326)

* Add a from-scratch example

* Fix typo

* resolve comment

* bachslash

* Resolve comments

* Refine commands

* add cn docs

* Correct commands

* fixing...

* update zn-cn docs

* update en link

* add sdk's get-started (#331)

* add sdk's get-started

* add SDK build command

* fix chinglish

* add sdk get start zh_cn

* update zh_cn cite

* fix command

* add selfsup/razor readme

* Fix command

Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: lvhan028 <lvhan_028@163.com>
 2021-12-24 15:26:50 +08:00
hanrui1sensetime 8e19a08bcf
[Doc] Add other ncnn ops docs. (#329) 
* add other ops

* fix comments

* add ncnn.md

* remove gpu
 2021-12-24 14:27:03 +08:00
hanrui1sensetime e355aad45f
[Docs] add ncnn latency benchmark (#314) 
* WIP add benchmark.md

* add mmocr already

* add retina

* add mask rcnn none

* update mmdet benchmark

* fill mmcls benchmark

* add mmocr and mmedit

* add some mmseg benchmark of cpu

* add all data

* add platform

* remove mmseg mmedit ncnn and dbnet ncnn

* fix grammar typo

* fix comments

* fix typo
 2021-12-24 10:39:31 +08:00
lzhangzz 4bb37c54a2
Fix logo and intro (#334) 
* crop logo

* fix README_zh-CN.md

* remoe empty files
 2021-12-23 20:14:35 +08:00
VVsssssk e37ce3cf28
[Doc]: MMDet benchmark (#265) 
* add mmdet benchmark

* fix docs

* fix docs

* fix docs

* add fp16

* add some int8 model

* add yolov3 benchmark

* add some benchmark

* fix docs

* add comment about mask-rcnn

* fix mmdet docs

* add ppl benchmark

* refactor benchmark

* refactor format

* add fcos and atss fp16

* fix benchmark

* fix mmdet docs

* fix docs

* fix docs

* fix docs

* add cn benchmark about mmdet
 2021-12-23 17:42:14 +08:00
VVsssssk fce37d4594
【Docs】Fix docs about codebase (#317) 
* fix codebase docs

* fix edit

* fix mmcls docs

* fix docs
 2021-12-23 17:35:59 +08:00
RunningLeon 49b47ff614
[Doc]: Add build doc of CN (#323) 
* update build cn

* update

* add introduction to build sdk

* add note

* update doc

* remove unused html tag

Co-authored-by: lvhan028 <lvhan_028@163.com>
 2021-12-23 16:10:04 +08:00
lvhan028 cdd0cf0988
[Docs] add sdk's build instructions (#324) 
* add sdk's build instructions

* update according to review comments
 2021-12-23 14:54:56 +08:00
RunningLeon f76ac64cfe
update backend docs (#319) 2021-12-23 13:23:39 +08:00
AllentDan 199253ce94
[Doc] Refine benchmark (#318) 
* add to index

* fix link

* add chinese benchmark

* add openvino to backends

* add codebase name

* add benchmark to bechmark model zoo

* update chinese mmcls benchmark
 2021-12-23 11:25:45 +08:00
hanrui1sensetime 9e22c75b70
[Docs] add ncnn ops docs samples (#313) 
* add ncnn ops docs samples

* link ops to ncnn.md

* fix ncnn.md grammar

* fix grammar typo
 2021-12-22 15:50:11 +08:00
Yifan Zhou 543777fe27
[Docs] Update mmcls pplnn benchmark (#316) 
* Update mmcls pplnn benchmark

* Update supported model list
 2021-12-22 10:43:39 +08:00
Yifan Zhou c1ed41c465
[Docs] Refactor document structure (#310) 
* Refactor docs

* Fix path

* Update logo
 2021-12-21 13:59:07 +08:00
Yifan Zhou 0f9f0a60e4
[Enhancement]: Update configs for OpenVINO (#306) 
* Update config for OpenVINO

* Update test

* Update better test

* Update instance-seg config of OpenVINO
 2021-12-20 17:56:25 +08:00
Yifan Zhou f442dbbe83
[Docs]: MMCLS benchmark (#300) 
* add doc

* Update benchmark

* Update benchmark

* Restore missing words
 2021-12-17 14:12:26 +08:00
RunningLeon 31e8aed862
update ppl benchmark (#293) 2021-12-17 10:44:49 +08:00
lvhan028 1ed55f86f2
Update README (#288) 
* update README and add three blank docs that are going to present SDK

* check in mmdeploy's logo image

* remove comments in README

* update acknowledgement

* development->deployment

* add Human3D link

* use captical word in citation
 2021-12-16 19:22:14 +08:00
Yifan Zhou de6fc147bd
[Feature]: Add onnx2pplnn tool (#296) 
* Add onnx2pplnn tool

* format

* typo

* update opt-shapes and wrapper

* Update opt-shape

* Update comment

* lint
 2021-12-16 17:01:33 +08:00
AllentDan 3eabeae071
Add new configs for ocr (#295) 
* save configs

* add to benchmark

* add datasets to benchmark

* lock mmcor version to 0.3.0
 2021-12-15 19:51:38 +08:00
q.yao 43256977fa
Add onnx2ncnn tool (#276) 
* Add onnx2ncnn tool

* fix docs

* fix lint
 2021-12-15 18:43:09 +08:00
q.yao b1a202ef04
Add onnx2tensorrt tool (#275) 
* add onnx2tensorrt

* add docs

* fix log

* fix docs
 2021-12-15 11:20:10 +08:00
AllentDan 0dea300714
[Fix] Reanme ppl to pplnn for all cases (#273) 
* add speed benchmark for pplnn and replace all ppl in docs with pplnn

* replace ppl with pplnn for all codes

* docs zh

* fix crnn config path

* update docstring

* rename

* update ppl to pplnn in readme_zh

Co-authored-by: maningsheng <mnsheng@yeah.net>
 2021-12-14 15:04:39 +08:00
RunningLeon 0b23c744fc
remove trt in config (#280) 2021-12-13 19:57:15 +08:00
AllentDan 105acc9de9
[Fix] Dbnet performance of trt8 (#278) 
* compatible trt version for dbnet

* judge inside rewrite
 2021-12-13 16:44:05 +08:00
Semyon Bevzyuk a96e5f9d76
[Fix] Fix VFNet test (#281) 
* [Fix] fix bugs for mmcls performance test (#269)

* fix bugs for mmcls performance test

* fix yapf

* add comments of CLASSES attribute

* Fix test_get_bboxes_of_vfnet_head

* Fix

Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
 2021-12-13 10:43:39 +08:00
VVsssssk 54885e5972
【Feature】Support for mmdet2.19 (#253) 
* add one-stage support

* add two-stage support

* fix docstring

* add base_dense_head docstring

* fix docstrign

* fix ncnn code

* fix anchor head

* fix unit test about mmdet model

* fix unit test

* fix base dense head bug:

* fix basehead

* fix basedense head

* fix pad bug

* fix bboxhead

* add rewrite about decode

* fix decode

* rename func

* fix test_mmdet_core and test_object_detection_model

* format test

* fix comments

* remove to(device)

* fix requirements

* fix docs

* fix yolox evaluate butg
 2021-12-10 14:03:23 +08:00
RunningLeon 499d06d844
Add mmseg performance (#254) 
* update doc and config

* test with ncnn

* update docs

* rename config

* update test result with openvino

* merge master

* resolve comments

* update dbnet
 2021-12-09 20:17:00 +08:00
AllentDan fd4297a2a3
add speed benchmark for pplnn and replace all ppl in docs with pplnn (#264) 2021-12-09 16:37:36 +08:00
q.yao ad72c19482
[Feature] Add torch2onnx tools (#260) 
* Add torch2onnx tools

* fix lint

* update docs

* fix docs2

* fix log
 2021-12-09 14:38:54 +08:00
Yifan Zhou fa33b89261
[Docs]: Add MMEdit benchmark and supported model list (#252) 
* doc

* update support

* update

* Resolve comments

* Update data
 2021-12-09 11:27:20 +08:00
RunningLeon d96ee9e9f3
Change op domain (#262) 
* change domain to mmdeploy

* update tests

* resolve comments
 2021-12-08 15:06:41 +08:00
AllentDan f424fca509
[Doc] add mmocr performance benchmark (#240) 
* add mmocr performance benchmark

* add notes

* fix typo

* add openvino for mmocr and use T4 results for dbnet18
 2021-12-08 10:31:57 +08:00
lvhan028 4f70434070
[Fix] correct ncnn_DIR (#261) 
* correct ncnn_DIR

* change NCNN_DIR to ncnn_DIR
 2021-12-08 10:29:07 +08:00
AllentDan bca8cc0897
[fix] align the names of configs (#256) 
* align names of configs

* set input_shape to None for all ppl
 2021-12-07 21:06:44 +08:00
lvhan028 36124f6205
Merge sdk (#251) 
* check in cmake

* move backend_ops to csrc/backend_ops

* check in preprocess, model, some codebase and their c-apis

* check in CMakeLists.txt

* check in parts of test_csrc

* commit everything else

* add readme

* update core's BUILD_INTERFACE directory

* skip codespell on third_party

* update trt_net and ort_net's CMakeLists

* ignore clion's build directory

* check in pybind11

* add onnx.proto. Remove MMDeploy's dependency on ncnn's source code

* export MMDeployTargets only when MMDEPLOY_BUILD_SDK is ON

* remove useless message

* target include directory is wrong

* change target name from mmdeploy_ppl_net to mmdeploy_pplnn_net

* skip install directory

* update project's cmake

* remove useless code

* set CMAKE_BUILD_TYPE to Release by force if it isn't set by user

* update custom ops CMakeLists

* pass object target's source lists

* fix lint end-of-file

* fix lint: trailing whitespace

* fix codespell hook

* remove bicubic_interpolate to csrc/backend_ops/

* set MMDEPLOY_BUILD_SDK OFF

* change custom ops build command

* add spdlog installation command

* update docs on how to checkout pybind11

* move bicubic_interpolate to backend_ops/tensorrt directory

* remove useless code

* correct cmake

* fix typo

* fix typo

* fix install directory

* correct sdk's readme

* set cub dir when cuda version < 11.0

* change directory where clang-format will apply to

* fix build command

* add .clang-format

* change clang-format style from google to file

* reformat csrc/backend_ops

* format sdk's code

* turn off clang-format for some files

* add -Xcompiler=-fno-gnu-unique

* fix trt topk initialize

* check in config for sdk demo

* update cmake script and csrc's readme

* correct config's path

* add cuda include directory, otherwise compile failed in case of tensorrt8.2

* clang-format onnx2ncnn.cpp

Co-authored-by: zhangli <lzhang329@gmail.com>
Co-authored-by: grimoire <yaoqian@sensetime.com>
 2021-12-07 10:57:55 +08:00
hanrui1sensetime eceeaf0159
[Docs] fix ncnn docs (#249) 
* fix ncnn docs

* add prepare for protobuf

* move install protob position
 2021-12-06 19:03:18 +08:00
Semyon Bevzyuk 2f6f6f87a1
Add get_mo_command. (#247) 2021-12-06 10:31:32 +08:00